Coinbase halves AI spend with a 1,200‑agent multi‑model routing system
Coinbase’s internal AI gateway runs 1,200 agents that automatically route requests to the cheapest model that can do the job. By defaulting to open‑weight models, routing by task type, and boosting cache hits from 5% to 60%, the firm halved its AI bill while token usage kept rising.