Microsoft’s playbook for scaling AI agents to 80k enterprises
Microsoft runs over 80,000 enterprise AI agents on its Foundry platform, including the 20‑million‑user Microsoft 365 Copilot. Its playbook treats retrieval as a sub‑agent, gives each agent a distinct identity, and enforces guardrails with rubric‑based evals and auto‑improvement loops. The approach shows why prototype agents fail in production and how to build reliable, scalable AI services.