OpenAI announced three new discoveries by its models and asked outside experts to check them. The biggest says the Exponential Time Hypothesis, a widely believed limit on how fast Boolean formula satisfiability can be solved is false; the proof was verified in Lean, a machine proof checker. A group led by Russell Impagliazzo, Ramamohan Paturi and Ryan Williams will verify it. A physics group led by David Gross will examine a claimed existence proof for pure Yang, Mills theory.
Δτ-Bench tests agents in tool ecosystems that keep evolving: familiar tools disappear or get replaced while more efficient alternatives appear. It has 1,588 multi-turn tasks across 42 domains and six successive ecosystem states. The strongest model or harness reached only 42.3% task success, and gains from existing skill-learning methods did not hold as tools changed. The authors' Steward manager, which maintains skills and tools during tasks, kept success higher.
TraceTrial-Bench grades agent harnesses, the software around a model that handles context, tools and checks, separately from the model itself. Across 4 harnesses, 9 models and 95 tasks, or 3,420 runs, harness scores ranged from 59.8% to 72.0%. In 31.1% of runs the agent finished the task while failing at least one harness criterion, so a passing result can hide an unreliable setup.
AutoTavern, a team of LLM research agents, rebuilt Hearthstone Battlegrounds as a simulator in 20 days and trained 23 versions of a game-playing agent. On the live ladder its rating rose from 6,000 to about 15,000, and its last 20 records average a placement of 1.60 with 80% first places, better than the server's ten highest-rated players. On play tasks it answers 91%, against at most 63% for frontier LLMs.
Rubric-based rewards let reinforcement learning train on tasks without one right answer, but they mostly reward covering more rubric points, so trained models grow verbose and add wrong content. The FORK reward also scores precision: each part of an answer must be necessary and factually correct. Against the recall-only reward it kept similar coverage with shorter answers, and its win rate over the base model rose from 22.1% to 74.1% on HealthBench.
Continual Learning Exam tests whether agents improve from experience. It has 120 expert-written tasks, each a five-level ladder, across 89 professional roles, and later levels build on earlier work. Across 17 harness-model setups, feedback after a failure plus one revision added a median 5.3 percentage points. The best system cleared 47.7% of levels and finished all five levels in just 23.3% of tasks.