Person
Former OpenAI governance researcher who runs the AI Futures Project and works on forecasting advanced AI.
Daniel Kokotajlo, who quit OpenAI over safety concerns, told MPs on Tuesday that the industry's risk tolerance is 'catastrophically high'. Two more ex-lab researchers gave similar warnings as MPs test whether the firms can regulate themselves.
Reality
None of the four AI labs at New York City Council's Oct. 5 hearing raised a hand when Speaker Julie Menin asked who insured against catastrophic risk. A show of hands says little about what cover the labs actually hold, but Menin took it to mean the public would carry the cost of any AI catastrophe.
Reality
Fifty-six percent of US voters, including 43% of Republicans, back limits on building data centers, a Reuters/Ipsos poll found. That puts local siting fights at the front of the political risk to AI spending before the November 3 midterms.
Reality
Anthropic researcher Jacob Coxon quit the AI industry in public on September 8, as the company seeks a $2 trillion valuation for its IPO. The governance risk investors can price sits with leaders who back slowing the industry.
Perspective Coverage
3 publishersReality
Former OpenAI researcher Daniel Kokotajlo told the New York City Council under subpoena that AI labs may not know when their safety work has failed. All 51 members heard him while weighing Speaker Julie Menin's AI bills, and the council can make the labs answer under oath.
Perspective Coverage
8 publishersReality
OpenAI and DeepMind researchers warned in videos given to Reuters that labs are rushing self-improving AI, one putting the odds of extinction at 10% or higher. Their own chief executives already back a slowdown in public, so the testimony mostly weakens the labs' claim that they can slow down only if everyone does.
Reality
A Vox newsletter cites the number as evidence that extinction talk has reached the mainstream. The question behind it asked Americans to rate an outcome, and that shapes what a leader can answer.
Reality
Evan Hubinger, Dario Amodei, Emmett Shear and Daniel Kokotajlo have each published a personal probability that AI kills everyone. The figures span 75 percentage points, and Gizmodo reports that none of them rests on a formula.
Reality
Neither the compute saved nor the share of reasoning that stopped being words has been published, which leaves customers policing agents with a control whose substrate OpenAI says it will describe later.
Reality
A cross-party group of peers and MPs wants a legal power to force a frontier AI model offline in an emergency. The Cabinet Office told the BBC that blocking UK access would not stop models being developed or misused elsewhere.
Reality