Reasoning Training May Need Just One or Two Tokens
Post-training usually treats every generated token as a teaching opportunity. This paper finds that one or two supervised tokens per reasoning trajectory, just 0.05% of the total, can match or beat full-token training across nine teacher-student setups, with checks on coding and reinforcement learning. If it holds up, the expensive part of reasoning training may be the wrong thing to optimize.