Sharding LLM Judges Cuts Oversight Gaps and Thwarts Exploits
Giving a single LLM call many verification tasks weakens its grounding, letting errors slip and adversaries amplify them. Splitting the checklist across multiple calls—sharding—restores expert-level agreement while keeping total compute fixed, and even a weaker judge can match a stronger one. The approach also blocks best‑of‑N attacks, only conceding when criteria are tackled individually.