ScarfBench Shows AI Agents Falter on Enterprise Java Migration
IBM Research’s new ScarfBench benchmark tests AI coding agents on moving Java apps between Spring, Jakarta EE and Quarkus. Early results show agents can compile code but frequently fail to deploy or preserve behavior, especially for whole‑application migrations. The suite gives a realistic bar for AI‑driven modernization tools.