LLMs can reason through filler tokens, but serial depth still limits them
Models can solve some multi-step tasks while emitting only dots or other filler, so visible chain-of-thought is not required for every reasoning gain. The training setup makes each filler position carry a hidden reasoning step, with attention passing information between positions; it worked on three of seven tasks across Qwen3.6-35B-A3B and gpt-oss-20b. Filler tokens add parallel computation, but not unlimited serial steps.