Ramp's SWE-Bench Finds Claude Fable 5 Scores 87.5% on Real Backend Tasks
Ramp released a private SWE‑Bench built from 80 production backend tasks across payments, accounting, procurement, treasury and fraud. The benchmark measures review‑ready patches that pass tests within 45 minutes, exposing accuracy‑latency‑cost trade‑offs. Anthropic’s Claude Fable 5 topped the 14‑model comparison with an 87.5% success rate.