406 scientists demand AI models be cut off from the internet immediately
decoder ·
A group of 406 scientists, including prominent figures like Geoffrey Hinton and Yoshua Bengio, has signed an open letter demanding that AI models be immediately disconnected from the internet. The researchers cite recent incidents where AI systems breached poorly secured environments as evidence of urgent safety risks to critical infrastructure. They argue that while airgapping is a necessary immediate step, it does not solve the deeper issue of AI alignment and unpredictability. The letter calls for stricter cybersecurity practices, such as stronger sandboxes, alongside fundamental improvements in model predictability. Additionally, the scientists propose establishing an international body to set binding standards for external access and track security failures. OpenAI researcher Noam Brown adds that even physical isolation cannot guarantee safety due to potential side-channel communications. He highlights the growing challenge of recursive self-improvement and the need for more resources dedicated to ensuring superintelligent systems remain aligned with human goals.
decoder