Edge0 model plugs into vLLM and local runtimes
You can run Edge0/Edge0-145B-NVFP4 locally or serve it through an OpenAI-compatible API, instead of wiring up a custom client. The page gives ready-to-run paths for vLLM, llama.cpp, Ollama, LM Studio, Jan, Docker Model Runner, and other apps, including a vLLM command that starts the server and a curl request for chat completions.