LodeHQ
AI news for people who shipFree, by email

AI · recipes.vllm.ai · Monday, 12 October 2026

vLLM makes Qwen3.8-Flash-Next deployable with 262K context

You can now serve Qwen3.8-Flash-Next through vLLM, but its 262,144-token context still needs serious memory planning. The 125B-parameter model activates 6B parameters per token, while a separate 51B N-gram embedding table can be offloaded to host memory; the official recipe requires at least 51GB for that table plus runtime headroom. Use vLLM's dedicated Docker image, since PyPI installation is not supported.

Read the source: recipes.vllm.ai ↗In the 12 October issue →