LodeHQ
AI news for people who shipFree, by email

AI · arxiv.org · Monday, 9 November 2026

ChainFlow gives speculative decoding a 39% lift over EAGLE-3

ChainFlow makes LLM serving faster by using a one- or two-step drafter that predicts through compressed hidden states, rather than generating draft tokens one at a time or denoising from noise. On Qwen3.5 models in vLLM, it beat EAGLE-3 by 39% and DFlash by 11% when drafter size and training data were matched. The paper also releases its code and drafter models.

Read the source: arxiv.org ↗In the 9 November issue →