Google Developers Blog·· 1 d agoAI score38
Google: Size GKE Node Pools for AI Agent Sessions, Not Requests
Agents are sessions, not requests: size GKE node pools for AI agent sessions
AI summary
Google argues AI agent sessions should be sized differently from web requests on GKE, since a GitHub Copilot trace study found agents wait for the user about 80% of the time. Agent Substrate 1.0, now generally available on GKE, suspends idle actors to object storage and frees their workers, letting more agents share the same compute.
Source:Google Developers Blog · developers.googleblog.com