Introducing o11y-bench: an open benchmark for AI agents running observability workflows
Grafana Labs released o11y-bench, an open benchmark for evaluating LLM agents on observability and SRE tasks. Built on Harbor, it runs agents against a real Grafana stack with Prometheus, Loki, and Tempo, providing deterministic grading and HTML reports. The project includes task specs, a default agent, and a public leaderboard.