Frontier LLMs Score Below 50% on IBM's New ITBench-AA SRE Benchmark
IBM and Artificial Analysis introduced ITBench-AA, a benchmark that tasks LLMs with real‑world SRE incident response on Kubernetes. In the first release, leading models such as Claude Opus 4.7 and GPT‑5.5 topped at just 47% and 46% accuracy, leaving all frontier models under the 50% threshold. The results highlight the challenge of agentic enterprise IT tasks for current AI systems.