RealtimeBench shows fast agents can beat smarter ones under pressure
RealtimeBench tests agents in 180 tasks where the world keeps moving, so a correct action that arrives late fails. In paused games, GPT-6.1-sol beats faster Jev, but Jev leads when gameplay continues; a slow teacher then gave Jev reusable instructions that lifted its average score from 13.51 to 24.19, across all six game types. The instructions also improved three other models without retuning.