Latent Reasoning Faithfulness Declines During Training, Varies by Answer Format
The paper shows that latent‑reasoning modules lose causal influence on answers as training progresses, and that faithfulness varies by answer type—dropping for binary choices but rising for open‑ended outputs. This means evaluating only final checkpoints can mask unfaithful behavior, suggesting developers must audit models throughout training.