Skip to content
Google Developers Blog·· 1 d agoAI score38

Google: Size GKE Node Pools for AI Agent Sessions, Not Requests

Agents are sessions, not requests: size GKE node pools for AI agent sessions

AI summary

Google argues AI agent sessions should be sized differently from web requests on GKE, since a GitHub Copilot trace study found agents wait for the user about 80% of the time. Agent Substrate 1.0, now generally available on GKE, suspends idle actors to object storage and frees their workers, letting more agents share the same compute.

Source:Google Developers Blog · developers.googleblog.com