Warning on AI’s Potential Threat to Humanity
Jacob Coxon, a former insider at Anthropic, has reiterated his alarming belief that artificial intelligence could pose an extinction-level risk to humanity in the near future, stating firmly that this prediction is not merely for publicity.
“There’s a significant chance that this technology could result in everyone’s demise,” Coxon shared during an interview with Tom Llamas from NBC News, following his resignation from the AI company.
He emphasized, “This isn’t exaggeration,” and added, “It’s definitely not a marketing ploy.”
Coxon, who spent three years researching at Anthropic and OpenAI, has been vocal in multiple media appearances after leaving his position. He contends that the rapid progression of AI might soon lead to machines that can enhance their own capabilities with little to no human input.
While he acknowledged that current AI technologies do not present an “extinction risk,” he remarked on CNN with Anderson Cooper that the landscape might drastically shift by 2027 or 2028.
The critical juncture, according to Coxon, would arise when AI can independently conduct AI research, allowing successive models to develop progressively more powerful versions of themselves. This cycle could ignite what he describes as an “intelligence explosion,” leading to systems that are far more intelligent than humans.
When Cooper posed the question of how such technology could feasibly eradicate humanity, Coxon admitted it sounds like a plot out of science fiction, yet he insisted it’s “frighteningly real.”
He highlighted potential threats such as hacking significant infrastructure and creating “extinction-level bioweapons,” showing how significantly more advanced autonomous systems could convert their intelligence into tangible threats.
According to Coxon, while current AI technologies might already pose risks for severe cyber or infrastructural harm, they currently lack the ability to endanger human existence on a large scale. However, he expressed concerns over how quickly that situation could evolve.
In a separate conversation with Bret Baier at Fox News, Coxon noted that while the risk of an immediate AI takeover is “minimal,” he cautioned that the possibility of recursive self-improvement could surface as early as next year. Some professionals in the industry believe this transition might occur in about six months, he added.
Coxon warned that if developers continue to race ahead unchecked, it could result in an AI takeover by the end of the decade.
He characterized advanced AI as “perhaps the most perilous technology humanity has ever forged.”
Despite the grim warnings, Coxon maintains that a catastrophe isn’t unavoidable. He articulated that companies working on AI find themselves in a cutthroat competition, where even those with genuine concerns about the effects of their technology hesitate to slow down, fearing that others might take the lead.
On CNN, he mentioned that AI developers were “pleading for regulation.” He echoed this sentiment on Fox, advocating for global collaboration to prevent countries and companies from “racing ourselves into extinction.”
Coxon believes that the issues surrounding safety are “eminently solvable” if governments and AI firms can collectively find ways to temper the rush toward increasingly advanced systems.
