Small models trail frontier models on terminal tasks most in picking the right answer
A new paper splits the gap between small and frontier models on terminal tasks into three parts. Sampling more attempts narrows the gap in reaching a correct solution but does not close it. Given the same pool of attempts, frontier models are far better at picking the one that worked, and small models are more overconfident about their own chances of success. So extra tries alone cannot close the gap.