SubQ LLM breaks quadratic attention, promises 12‑M token context and massive speed gains
Subquadratic unveiled SubQ, the first commercial LLM that abandons the quadratic attention bottleneck. Its 12‑million‑token context window claims 52× faster inference at 1 M tokens and up to 1 000× compute savings at full length, potentially slashing costs for long‑context applications. If validated, it could render many RAG pipelines obsolete.