LodeHQ
AI news for people who shipFree, by email

AI · arxiv.org · Monday, 9 November 2026

Two shell-debugging runs beat mixing in an interactive debugger

For coding-agent builders, adding an interactive debugger is not automatically better: across both GPT-OSS-120B and Nemotron-3-Ultra-550B, two bash-based runs beat one bash run paired with one debugger run on SWE-bench Verified. The study held the agent scaffold fixed across all 500 instances, then introduced pass_X@k, a metric that estimates the chance that at least one of k agents succeeds without confusing tool diversity with random run-to-run variation. The result suggests repeated shell-based attempts may be a better default than debugger access alone.

Read the source: arxiv.org ↗In the 9 November issue →