A British researcher has resigned from U.S. artificial intelligence developer Anthropic over fears that the race to develop “self-improving superintelligence” could lead to humanity’s extinction. Jacob Coxon, who previously worked on pretraining research at OpenAI and Anthropic, posted on X on Tuesday that “neither company is acting responsibly,” and that the people building AI “earnestly believe that it could kill us all by the end of the decade.” Evan Hubinger, alignment science lead at Anthropic, confirmed Coxon’s sentiments in his own X post, saying, “We really do earnestly believe AI could kill all humans! I personally think it is >10% within […]...

Keep on reading: Anthropic researcher quits over fears AI could kill off humanity