Google's Agent Compute Engine gives every Gemini agent its own hardware-isolated micro virtual machine
decoder ·
Google has announced the Agent Compute Engine, a new service designed to provide each Gemini AI agent with its own hardware-isolated micro virtual machine. This infrastructure leverages Google's Titanium chip to ensure security and efficiency for agentic systems. When agents are not actively processing tasks, their virtual machines automatically pause, allowing resources to be freed up for other users. To further reduce costs, the system utilizes shared memory between these virtual machines. Additionally, Google has open-sourced Agent Substrate, a Kubernetes runtime that reportedly allows ten times as many agents to run on a single server. In testing involving 200,000 agents, the time required to suspend and resume operations was measured at under 500 milliseconds. The company also introduced oversight features such as token tracking, model routing, and support for third-party identity providers like Ping Identity and SailPoint. These controls will eventually extend to Cloud Run, GKE, and managed endpoints, with a public preview expected in the coming months.
decoder