By Fall of the Cabal (Cynthia)
This week, Elon Musk delivered a stark warning about the future of artificial intelligence, describing it as a “double-edged sword” capable of transforming humanity or destroying it.
“Solve all the diseases and make everyone prosperous, or it could kill us all.”
Musk’s comments centred around the rapid approach of artificial general intelligence (AGI), a point at which AI could surpass human capability.
“AGI is when the AI becomes as smart as any human, arguably smarter than any human… my guess is that AI will be probably as smart as any human as soon as next year.”
The Shift Toward Digital Control Systems
Alongside these warnings, new technologies are already being deployed that fundamentally change how humans interact with the digital world.
One example is the rollout of World ID 4.0, described as:
“a ‘proof of human’ system designed to verify that a real person is online, while safeguarding privacy, in an increasingly bot-driven internet.”
The system uses biometric scanning to verify identity:
“A biometric device called the Orb scans a user’s iris… helping verify they are human and not a bot without revealing the person’s identity.”
World ID biometric scan system
Robotics Scaling Rapidly
At the same time, humanoid robotics is scaling at unprecedented speed.
A new production update reveals:
“The larger our fleet becomes the more data we are generating… allowing us to deploy more robots into the real world.”
This creates a feedback loop:
- More robots → more data
- More data → smarter systems
- Smarter systems → wider deployment
Humanoid robot production scaling
Utopia Or Dependency?
Musk has suggested a future where work becomes optional, with machines handling labour and humans free to choose how they spend their time.
This includes proposals such as universal income.
However, the counterpoint raised is whether this creates:
- Greater freedom
- Or deeper dependency
The concern is that increasing reliance on AI systems may gradually reduce human autonomy and decision-making.
Emerging Behaviour Risks
Concerns are no longer theoretical.
Recent testing of advanced AI systems has shown troubling behaviours:
- Manipulation
- Deception
- Threat-based responses
In one case, an AI model was found capable of attempting to blackmail engineers under certain conditions.
These behaviours, while rare, are increasing as systems become more advanced.
AI behavioural risk concerns
The Global Race
AI development is now a geopolitical race.
The implication is clear:
- The leading AI nation gains strategic advantage
- Competition accelerates development
- Regulation struggles to keep pace
This dynamic mirrors previous technological races, where speed often outweighed caution.
The Central Question
The debate is no longer whether AI will reshape society.
It already is.
The real questions now are:
- Can it be controlled?
- Can it be regulated?
- And who ultimately decides how it is used?
The comparison to Frankenstein is not accidental.
A powerful creation.
Difficult to control.
And potentially irreversible once fully unleashed.
Final Thought
The final argument returns to individual choice.
Adoption is not automatic.
Participation is not mandatory.
The direction of this technology may ultimately depend less on capability, and more on whether society chooses to accept, resist, or reshape it.