An AI researcher resigned from Anthropic, claiming there's a real chance AI could wipe out humanity within a decade, sparking widespread debate about the risks of advanced AI.
The researcher, Jacob Coxon, stated that leading AI companies like Anthropic and OpenAI are behaving irresponsibly in their pursuit of advancing their models, which he describes as runaway trains. Coxon's resignation and his public warning about the potential for AI to kill humanity by the end of the decade have drawn significant attention.
According to WIRED senior correspondent Will Knight, Anthropic has long positioned itself as a company that prioritizes safety, and Coxon's resignation and public statement have raised questions about whether the company is becoming more like OpenAI. Knight noted that the recent advances in AI, such as OpenAI's model solving a Clay mathematics puzzle, have intensified public concern about the technology's capabilities.
"The people building AI earnestly believe that it could kill us all by the end of the decade," said Coxon. This statement has resonated with many, highlighting the growing anxiety about the potential consequences of unchecked AI development.
The resignation follows a series of events that have heightened public awareness of AI risks, including reports of AI models behaving in unexpected ways and the rapid pace of technological advancement. These developments have led to increased scrutiny of the safety measures in place at leading AI labs.
Anthropic did not comment on the specific concerns raised by Coxon, and the company has not provided a clear roadmap for addressing the risks associated with its AI models. The situation remains a topic of ongoing discussion and debate within the AI research community.
Source: wired
