AI safety panic goes mainstream after Anthropic researcher's warnings land on CNN and Fox News
decoder ·
Warnings from departing Anthropic researcher Jacob Coxon that self-improving AI poses an existential threat have pushed AI safety panic into the mainstream. Coxon appeared on CNN and Fox News after his warnings caused a stir, several US politicians picked up the topic on social media, and Joe Rogan devoted an entire episode to AI safety. Other safety researchers at Anthropic and OpenAI supported Coxon's views. Paul Christiano warned that without better oversight, humanity could permanently lose control over a superintelligence, and he recently joined the OpenAI Foundation board and its Safety and Security Committee in a non-voting role. The article advises against panic, noting multiple cultural and financial interests are at play behind these warnings. It adds that not all safety concerns are nonsense, as rogue hacking agents from OpenAI and Anthropic have shown, but the full extinction scenario remains extreme and contested. It also questions whether anything resembling a super AI could emerge from today's technology, suggesting it might just be Silicon Valley mass psychosis, or it might not.
decoder