LodeHQ
AI news for people who shipFree, by email

AI · github.com · Monday, 17 August 2026

Ling 3.0 MoE runs locally now that llama.cpp merged bailingmoe3

llama.cpp merged the bailingmoe3 architecture, unlocking local inference for Ling 3.0 models including the 124B MoE flash variant (5.1B active) and the tiny 8B. Builds from this PR onward load official Ling GGUF with hybrid KDA/MLA attention, MTP draft support, and Q-LoRA attention.

Read the source: github.com ↗In the 17 August issue →