Chatbot Arena launches a blind ‘Pepsi Challenge’ to separate top LLMs
The LMSYS Chatbot Arena turns LLM evaluation into a blind, crowdsourced showdown—a “Pepsi Challenge” that pits anonymous models against each other. Using a Bradley‑Terry rating system, it surfaces real‑world helpfulness and separates even top models on coding, reasoning, and long‑context tasks, giving developers a clear view of which model truly outperforms the rest for their use‑case.