LodeHQ
AI news for people who shipFree, by email

AI · lesswrong.com · Friday, 13 November 2026

LLMs can reason through filler tokens, but serial depth still limits them

Models can solve some multi-step tasks while emitting only dots or other filler, so visible chain-of-thought is not required for every reasoning gain. The training setup makes each filler position carry a hidden reasoning step, with attention passing information between positions; it worked on three of seven tasks across Qwen3.6-35B-A3B and gpt-oss-20b. Filler tokens add parallel computation, but not unlimited serial steps.

Read the source: lesswrong.com ↗In the 13 November issue →