- AI researcher Jacob Coxon has resigned from Anthropic, expressing concerns that both Anthropic and OpenAI are gambling with our lives.
- UN rights chief Volker Türk warned that AI could become powerful enough to threaten humanity, saying he shares concerns of industry insiders about existential risk.
- Türk called for 'cast iron guarantees' on AI safety and security, warning that a handful of men hold 'almost unlimited power over AI', and urged countries to come together around agreed red lines.
Jacob Coxon has left Anthropic, citing fears that AI companies are racing towards uncontrollable superintelligence. He stated, Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. Coxon warned that AI could soon develop capabilities to hack anything and revolutionize fields overnight.1
Coxon, who has worked at both OpenAI and Anthropic, expressed concern that while executives publicly downplay risks, they privately acknowledge their fears. He noted that Anthropic understands the stakes involved, yet both companies are engaged in a hubristic gamble to achieve AI advancements without adequate safety measures.
His resignation follows a warning from UN rights chief Volker Türk, who stated that advanced AI could pose an existential risk to humanity. Türk called for cast iron guarantees on AI safety, urging nations to establish agreed red lines to mitigate risks. He emphasized that a few individuals hold almost unlimited power over AI, necessitating collective action to ensure safety.2345
Coxon’s departure and Türk’s statements highlight the urgent need for responsible AI development amidst growing concerns over its potential dangers.
“Coxon's resignation came days after UN rights chief Volker Türk told the UN Human Rights Council that advanced AI could pose an existential risk, calling for 'cast iron guarantees' on safety. Türk also warned that a handful of men hold 'almost unlimited power over AI' and urged countries to agree on red lines.”
