NVIDIA open‑sources Switchyard, a Rust proxy for routing LLM traffic across providers
Switchyard is a Rust library and proxy that translates between OpenAI Chat, OpenAI Responses, and Anthropic Message formats, letting you route requests to vLLM, NVIDIA NIM, Ollama, or any OpenAI‑compatible endpoint. It adds Prometheus metrics and pluggable routing algorithms, making multi‑model A/B testing and signal‑driven routing easier for developers building AI‑powered apps.