MiniMax’s MSA sparse attention powers 1‑million‑token context
MiniMax introduced MiniMax Sparse Attention (MSA), a new sparse attention architecture that reduces quadratic complexity and lets its M3 model handle up to 1 million tokens. The redesign cuts per‑token compute to a twentieth of its predecessor, delivering 9× faster prefilling and 15× faster decoding while preserving capability.