Surgical Unlearning in LLMs via Isolated Sink Neurons
NULLs embed source-specific knowledge into isolated sink neurons, letting you erase an individual data source by simply disabling its sinks. The method scales to millions of Wikipedia articles and preserves shared facts and overall language performance, matching full retraining without extra gradients.