AI agents reproduce only 15% of papers without released code
RECLAIM shows that AI agents are still unreliable at rebuilding machine-learning results, especially when researchers release no code: the best agent reproduced 15% of those papers, versus 41% when code, data, and model weights were available. The benchmark tests 100 NeurIPS 2025 papers against fixed results and GPU budgets. Across 400 runs, the most common mistake was implementing the method without checking it against the paper’s numbers.