AWS and UC Berkeley's open Infinity runtime fits 75,000 waiting agents in 8 GB
Infinity, released under Apache 2.0, pauses an agent whenever it calls a tool: it saves the conversation, frees the process, and resumes the agent when the result arrives. That means a tool call can take days with nothing running in between, which also suits serverless platforms. In AWS's benchmark, memory grew at about 100 KB per idle agent, so about 75,000 agents fit in the 8 GB of a Raspberry Pi 5. It is an early research release.