LodeHQ
AI news for people who shipFree, by email

AI · lesswrong.com · Saturday, 15 August 2026

Claude Code and Codex Can't Accurately Predict Their Own Runtime

A MATS 10 study evaluated Claude Code and Codex on ProgramBench and a custom suite, asking each CLI agent to forecast wall‑clock time and later estimate how long it actually ran. Both models mis‑predict, especially on short tasks, and show overconfidence, exposing a gap in time awareness that hampers reliable automation pipelines.

Read the source: lesswrong.com ↗In the 15 August issue →