Anthropic researchers put a 10%+ extinction risk on AI this decade
An Anthropic alignment lead says there is a greater than 10% chance advanced AI could kill all humans within the next decade, a warning that puts the industry’s safety gap ahead of its promised benefits. Evan Hubinger says Anthropic is trying its best but has no plan to solve alignment for superintelligence, while researcher Jacob Coxon says he quit because Anthropic and OpenAI were mishandling the danger. Anthropic says it is testing models for dangerous capabilities and developing safeguards.