ChainFlow gives speculative decoding a 39% lift over EAGLE-3
ChainFlow makes LLM serving faster by using a one- or two-step drafter that predicts through compressed hidden states, rather than generating draft tokens one at a time or denoising from noise. On Qwen3.5 models in vLLM, it beat EAGLE-3 by 39% and DFlash by 11% when drafter size and training data were matched. The paper also releases its code and drafter models.