iCreatAI News
Skip to content
Google Developers Blog·· 18 hr agoAI score42

Agents are sessions, not requests: size GKE node pools for AI agent sessions

Agents are sessions, not requests: size GKE node pools for AI agent sessions

AI summary

This article argues that AI coding agent sessions stay open all day but work only part of the time—about 22% of an 8-hour day at 2 prompts an hour—so sizing GKE node pools for open sessions overpays for idle time. It describes how Agent Substrate and AX park idle sandboxes in object storage and free their workers, with a cost model showing parking saves 40% of the node bill for 100 coding agents at 2 prompts an hour, while one Pod per session becomes cheaper above roughly 4.5 prompts an hour. It also notes that Agent Substrate does not suspend idle actors on its own, that the warm pool must be sized for the busiest hour, and that the pool should be scaled to zero after hours with a scheduled job.

Source: Google Developers Blog · developers.googleblog.com