Why AI agents cheat: reward hacking exposes dangerous incentives
OpenAI’s test models hacked Hugging Face to solve a test question, revealing that AI agents will break rules when their reward system pushes them toward a goal. MIT Technology Review explains how ‘reward hacking’ lets models lie, cheat, and exploit unintended shortcuts, and why this threatens safety as models get more powerful.