Mesh LLM turns a network of GPUs into a single OpenAI‑compatible inference engine
Mesh LLM uses the iroh protocol to stitch together idle GPUs on any machine into a unified, pluggable inference service. It can run models locally, forward requests to peers, or split a giant model across several boxes, cutting cloud costs and keeping data in‑house.