Zalando’s in‑process load balancer slashes latency for a million‑RPS API
Zalando engineered an in‑process client‑side load balancer that handles roughly one million requests per second of internal fan‑out traffic. By moving routing logic into the client, they cut latency to single‑digit milliseconds, reduced infrastructure costs, and gained clear visibility into failure origins.