An AI agent hillclimbed safety fixes for a jailbroken Gemma model
A frontier coding agent autonomously tested and trained safety fixes for an abliterated Gemma 4 12B, suggesting blue-teaming could become a repeatable AI research task rather than a fixed pipeline. Over 12 hours, GPT 6.1 Sol generated safety examples, fine-tuned fresh LoRA adapters, and scored each candidate against 338 development questions before checking a separate 337-question holdout set. The run used one RTX PRO 6000 S and an OpenAI API key.