A simpler distillation setup can transfer teacher capabilities more accurately and cheaply: Semi-OPD beat on-policy distillation in 14 of 17 teacher-student pairs, with up to 13.6% higher accuracy and an 11.4x training speedup. It uses rollouts from the student’s initial model, then distills the teacher’s preferred tokens across those trajectories. Standard on-policy distillation helps mainly when teacher and student outputs already overlap heavily; for misaligned pairs, longer student-generated contexts weaken the teacher’s signal.
FrontierML gives AI agents $10, $50, or $200 per task and tests whether extra spending produces better models, a practical measure of research judgment rather than just reasoning. Agents choose the architecture, data, GPUs, training runs, and experiments, then submit an inference server for held-out tests on an air-gapped H100. The benchmark has 21 long-horizon tasks, and the authors report that stronger agents reliably improve when given more capital.