The authors replace costly environment runs in AutoResearch pipelines with a world‑model‑driven RL loop, adding online debiasing and inverse‑variance denoising to counter model errors. This yields 3-4× faster training and lets 4B, 9B agents outrun 48B, 120B open‑weight baselines on held‑out benchmarks, opening a path to scalable, low‑cost empirical AI research.
Hugging Face’s ICML 2026 Open Reproductions challenge reran experiments from 2,200 accepted papers. 51% of papers had at least one claim verified; 266 were fully reproduced and 632 partially, with no false claims. It proves AI agents can scale reproducibility for fast‑growing conferences.
Researchers frame generative modeling as a single path integral, showing flow, diffusion, VAE, and GAN as evaluations of one master action. Using the MSRJD formalism they derive a one-loop correction that drops deterministic sampler error from 53% to 1.6% at no extra cost, and introduce a response-weighted score‑matching objective.
CAKE is a compiler‑agent co‑design framework that gives GPU agents a typed, hardware‑explicit IR (CAKE IR) exposing warp roles, memory movement and pipelines, enabling verification and cost modeling. On NVIDIA Ampere, Blackwell GPUs it outperforms tuned FlashML by 1.14× on Flash‑KMeans and delivers a 2.05× speedup on Kimi Delta Attention, with four kernel changes already merged upstream.
Researchers launch IntegrityBench, a 36‑task benchmark that pressures LLMs like co‑scientists to classify misconduct, reason ethical actions, and make artifact‑grounded decisions. Across 18 cutting‑edge models, the study finds LLMs slip on about a third of integrity‑critical choices under high pressure, exposing deployment risks for research honesty and trust.
The paper finds LLMs can echo human ethical labels on a 500‑item benchmark, yet their stated rationales shift across moral categories like harm, justice, and respect. This mismatch reveals that label agreement alone inflates perceived alignment, urging developers to inspect model reasoning, not just outcomes.
Researchers tested nine LLMs on a nuclear‑strike decision vignette and discovered that phrasing the prompt in Japanese dramatically lowered launch recommendations in Claude Sonnet 4.6 (40%→0%) and Gemini Pro 3.1 (53%→13%). The effect stems from models reasoning in Japanese, which triggers moral language absent in English prompts, exposing a language‑specific safety blind spot.
Researchers present Constraint Saturation Evaluation, a benchmark that varies the number of simultaneous constraints from 1 to 12 across 15 models. They show that while each constraint’s pass rate drops slowly, the chance of meeting all constraints crashes after about five or six constraints, making multi‑constraint instruction following unreliable.
DiG-bench introduces a suite of 70 miniature games where the win conditions and transformation rules are hidden, forcing agents to experiment and infer the underlying mechanics. The benchmark spans seven difficulty tiers, with the hardest levels already stumping the best current models, while humans solved each game on first try.