CogGym shows AI still diverges sharply from human commonsense
CogGym lets researchers compare AI and human answers on the same cognitive experiments, giving model builders a broader test than math and coding benchmarks. Its first release standardizes 258 experiments from 100 papers and evaluates 50 language models; the best model reaches only R² = 0.59 on text, versus human split-half reliability of 0.93. The gap is wider on video, where the best model reaches 0.43 against 0.92 for humans.