JusticeAxis tests whether AI judges facts, not just statutes
JusticeAxis gives legal-AI builders a benchmark for the harder task: applying law to established facts without defaulting to rigid statute matching or unsupported discretion. It uses 256 criminal cases from 18 countries, with audio, image, and text evidence plus three lawyer-written judgments per case: the recorded decision and one for each failure mode. The paper reports that open-weight models drift toward unsupported grounds, while frontier models lean toward the statutory default; its JusticeAgent plugin reportedly lifts a frozen open-weight model to commercial-level performance.