LLMs Correct Feature Errors, Not Just Superpose Them
The authors show that large language models not only store features in superposition but also perform feature‑specific error correction. Across six open‑source models they detect privileged "pure" feature directions that resist perturbations, challenging prevailing assumptions about how LLMs represent and fix internal mistakes.