Big LMs Amplify Errors Faster: Auto‑Regressive Risk Regime Uncovered
Scaling language models boosts initial answer correctness but triggers a hidden auto‑regressive risk regime that makes mistakes snowball. The authors quantify a “risk residual” that grows 11‑39× with size, exposing a confidence‑driven failure mode that evades self‑monitoring. This threatens reliability of ever larger models.