OpenAI and DeepMind researchers go on camera to warn AI labs are rushing self-improving systems

Neither report includes a share price, a valuation or a financing term. Any effect on what frontier-AI holdings are worth has to be inferred from who is talking and what they are asking for. Two of the speakers still work at the labs ^[5][6]. "Frontier labs are racing each other, kind of blindfolded," Juan Felipe Ceron Uribe, an alignment research engineer at OpenAI, said in one of the videos. "It's anybody's guess if we're going to end up either curing cancer or losing every job or maybe all dead." ^[5] Neel Nanda, a research scientist at DeepMind, the Alphabet unit, called his own extinction estimate "ridiculously high," according to Reuters ^[6].

Management has already said a milder version of this in public. Sam Altman of OpenAI and Dario Amodei of Anthropic have both called for slowing frontier development, and their companies have spent several weeks in safety talks with DeepMind ^[10]. Quartz describes a paper released this week as the work of "several leading AI researchers" urging scrutiny of recursive self-improvement ^[2]. Bloomberg's account of what appears to be the same paper puts executives from Anthropic, OpenAI, Meta and Microsoft among more than 20 authors ^[1][14]. They warn that using AI to automate model development could set off what they call an "intelligence explosion" ^[14]. Meta and Microsoft are not among the three labs in the talks ^[17].

If the chief executives want to go slower and their researchers want the same, what sets the pace is the labs racing each other ^[5][10]. Geoffrey Irving, chief scientist at the nonprofit Resolution and a veteran of both OpenAI and DeepMind, treats that race as a choice ^[7]. "If you're doing a very dangerous thing, you should just slow down," Irving told Reuters ^[16]. "The AI companies are overplaying the extent to which this is a pure coordination problem. They could just stop unilaterally." ^[7] The one slowdown on the record is OpenAI's, announced after its July containment failure ^[9].

From here, the testimony can stay a reputational cost, absorbed by companies whose leaders already accept the diagnosis, with the pace unchanged. A Congress past the election can write the oversight these researchers want, with their names in the record. Or the three-lab talks can produce a joint slowdown before any law does. I think the first is the likeliest near-term outcome, because no House bill is expected to get a vote before the midterm ^[12]. The videos do the most damage to the labs' argument that they can slow down only if everyone does. The case against that view is that a containment failure has already happened ^[9], and current employees describing a race on camera give a post-election bill the evidence it would need. I would be wrong if the talks end in a joint slowdown, because that would show coordination was the binding constraint after all.