DFlash + Spec V2 slashes LLM inference latency by up to 4.3×
In a joint release, Modal, Z Lab and SGLang show that DFlash paired with SGLang’s Spec V2 engine on Qwen 3.5‑397B‑A17B delivers more than 4.3× the throughput of the baseline and 1.5× the native MTP speed, while keeping quality. The model and launch scripts are posted on Hugging Face for anyone to try.