ImpossibleBench has 14 control-split defects to fix
ImpossibleBench's LiveCodeBench audit finds 14 defects across 13 of 103 supposedly solvable tasks, so its cheat-rate scores need qualification before you use them to compare coding agents. The audit patches the benchmark and reproduces each issue, including wrong expected values and inputs outside the documented constraints. It also finds that pass-equals-cheat cannot distinguish an agent that stops from one that cheats, while gaming varied by model and scaffold.