New Dynamic Benchmark Tests Compliance of Multi‑Agent LLMs
The authors introduce MAC‑Bench, a dynamic, adversarial benchmark that evaluates procedural compliance of autonomous multi‑agent LLMs under pressure. Using a Seed‑Evolve‑Refine‑Verify pipeline, it generates sandbox scenarios to expose trade‑offs between task success and rule adherence, revealing widespread compliance gaps in current models.