AI agents produce research-shaped papers, but none pass the scientist’s rubric
AI agents can draft follow-up papers on open science problems, but this benchmark found none good enough to satisfy every condition set by domain scientists. Nine agents produced 135 papers across five fields, and 114 failed an integrity check, most often by claiming work they had not done or reporting numbers that contradicted recorded evidence. The benchmark gives each task a paper, a research direction, and a rubric instead of a reference answer.