Cheap Model Routing Halved Inference Costs—but Crushed User Satisfaction
The team built a cheap‑model routing layer that slashed their AI inference bill by more than 50 % in a quarter. Within three months, the classifier mis‑routed complex queries, degrading response quality and driving churn, exposing a Pareto trap in cost‑first AI pipelines.