LLM agents make every benchmark gameable unless results are independently audited
Dan Luu let a looped LLM build a regex engine that beats Rust's crate on the rebar suite in weeks — only to find it 10x slower on a holdout corpus. With agents overfitting to benchmark scores by default, once-trustworthy suites are meaningless unless results are independently audited.