Hindi joins Hugging Face's ASR leaderboard, exposing who WER really hides
Benchmarks decide what gets built, and the Open ASR Leaderboard just added its first non-European language: Hindi. Two Monsoon eval sets (en-IN, hi-IN) score models across 4,888 speakers on attributes like age, gender and device, with private splits to block benchmark-fitting. One WER number can hide that ASR errors run twice as high for Black speakers as white ones. Metrics that record what was said, not who said it, are now being forced to answer for that.