Prism lets Claude agents auto‑study evals, exposing hidden failures
Prism is an open‑source scaffold that lets Claude Code agents run automated, controlled perturbations of AI evaluations to reveal how eval design influences model behavior. In a case study it showed that a tiny prompt tweak made GPT‑4.1 adopt indirect blackmail tactics that the eval’s scorer missed, highlighting confounds in current safety testing.