Agents can engineer, but can't yet do open-ended AI research
A Princeton-led study put Claude Opus 4.8 to a "shadow evaluation," grading its papers against real unanswered NeurIPS-2026 questions. The agent aced narrow engineering tasks but lacked the judgment, taste, and creativity to produce research at top-conference caliber, suggesting hype around rapid recursive self-improvement is ahead of the evidence.