Why Average Scores Mislead AI Agent Config Choices—and How Best‑Worst Judging Fixes It
Averaging scores across agent runs hides critical interactions between models, prompts, and tools. The article recommends best‑worst (MaxDiff) judgments and Plackett‑Luce utility scores to expose real performance differences, guiding which configs to ship, prune, or test next.