vLLM makes DeepSeek-V4.1-Flash 5.3x faster for agent workloads
Serving DeepSeek-V4.1-Flash with vLLM now delivers 5.3x more throughput under a 150 tokens-per-second constraint, giving teams more headroom for interactive agent workloads. The gain comes from replaying only the recent sliding window of cached context, then fusing and parallelizing GPU operations instead of rebuilding and running them separately. At low concurrency, the result is a 1.9x speedup; vLLM says the optimizations were developed with Inferact over three weeks.