Why hundreds of LLM agents slowed the system: a hidden CPU bottleneck
When Planck scaled its LLM‑agent fleet to hundreds, latency jumped not because of the LLM APIs but due to a flood of tiny async CPU tasks. The authors pinpointed the hidden CPU contention and rewrote the dispatcher to eliminate the bottleneck, restoring fast response times.