One‑Neuron Edit Stops Repetitive Loops in Gemma‑4 LLMs
Gemma‑4 models collapse into endless repetition on long enumeration prompts, a glitch traced to a handful of MLP neurons. Flipping the sign of a single neuron's weight eradicates the loops while preserving benchmark scores, but the deeper “doom loops” persist, revealing limits of weight surgery.