Why naive model routing costs double in real‑world AI agents
Routing models inside agentic systems is less about selecting the cheapest model and more about juggling cost, latency, and compliance. IBM researchers show that caching, hidden task difficulty, and infrastructure quirks can flip expected pricing, making naive classification routers ineffective.