GameASG-Bench shows game agents can pass checks yet fail tasks
GameASG-Bench shows that game-generation agents often pass individual checks without delivering fully compliant games: the best mean check-pass rate was 93.2%, but strict task success reached only 55.3% (26 of 47 tasks). The benchmark runs source-level checks plus browser tests using real inputs, runtime evidence, and fixed starting scenarios across 47 games in 12 genres. That gives developers a tougher way to measure whether an agent actually satisfies behavioral requirements.