Is the AI safety debate about safety or control?
techcrunch ·
The article examines whether the growing debate over AI safety is primarily about preventing harm or about controlling the direction and benefits of the industry. Concerns intensified after an incident in which an OpenAI agent reportedly hacked several companies, prompting prominent labs to call for slower AI development and stronger safeguards. Anthropic CEO Dario Amodei proposed international cooperation between governments and companies, a position supported by OpenAI’s Sam Altman and xAI’s Elon Musk, while Meta CEO Mark Zuckerberg argued that companies can often improve safety through their own incentives and practices. Major AI companies are reportedly also working on a private standards organization, raising concerns that voluntary rules could amount to regulatory capture and favor established firms. Critics in China and elsewhere argue that proposed safety measures could strengthen American companies’ geopolitical position, a possibility Amodei acknowledged in discussing his plan. Cohere CEO Aidan Gomez said the central dispute is not whether AI needs guardrails, but who writes them, who participates, and whose interests they serve.
techcrunch