Evaluation Scores for LLMs Expire Like Perishable Goods, New Paper Shows
A new position paper warns that averaging diverse LLM evaluation signals creates "trust inflation" and that scores should be treated as epistemic claims with formalities, scope, and expiration dates. On the HELM leaderboard, mean‑aggregated top models are entirely different from those selected by a weakest‑link method, exposing the fragility of current practices.