Half of Language Model Benchmarks Are Already Saturating, Study Finds
A systematic analysis of 60 language‑model benchmarks shows that nearly 50 % have hit saturation, and older benchmarks saturate faster. The authors link resilience to expert‑curated test sets, not just public data, suggesting redesigning benchmarks to extend their useful lifespan.