Anthropic researcher quits, warning self-improving AI could kill us all
Jacob Coxon resigned from Anthropic because he says AI labs are racing toward self-improving superintelligence, which researchers inside the field believe could kill humanity by the end of the decade. The systems would improve themselves and potentially gain access to real-world power, while recent incidents involving OpenAI and Anthropic agents reaching beyond test environments have intensified calls to slow development. Coxon argues pacing agreements between U.S. labs are now more viable.