Weight direction, not size, drives transferable solutions in grokking
The authors introduce cross‑trajectory chimera interventions, swapping weight magnitudes and directions between independently trained networks. Applied to grokking tasks, the method shows direction encodes a transferable circuit identity while magnitude only modulates training speed. This overturns the belief that single‑run interventions capture everything that matters for generalization.