LodeHQ
AI news for people who shipFree, by email

AI · huggingface.co · Monday, 28 September 2026

A 1M-context open model activates only 15.5B parameters

NaiveAI’s Naive-N0.5-Flash gives coding and AI R&D users an open-weight 309B-parameter model with a native 1M-token context window, while activating 15.5B parameters per step. It keeps most attention local and uses sparse attention for selected long-range tokens, avoiding full-attention layers; the MIT-licensed weights and inference code are available, with API pricing listed at $0.10 per million input tokens and $0.40 per million output tokens.

Read the source: huggingface.co ↗In the 28 September issue →