Skip to content

Future of Life Institute

Nonprofit focused on reducing catastrophic risks from AI and other technologies, known for its open letters on AI safety and periodic lab safety index rankings.

Current stories

leadershipOne report1 publisher

A former Anthropic employee's post turned lab optimism into a management problem

Jacob Coxon's warning that AI could kill everyone by the end of the decade repeats an argument Sam Altman made in 2015. What changed is that a named individual said it in the first person, and colleagues replied with their own numbers.

Reality

Evidence45
Adoption
Not scored
Hype gap+20
Incentives40
Confidence40
productOne report1 publisher

A $3,000 hack at an Alabama nonprofit shows who the AI labs' cyber-defense lists leave out

AI labs limit their strongest cyber-defense models, Anthropic's Mythos and OpenAI's Astra, to a short list that includes Nvidia, Google and Apple. Small groups such as Vivian's Door, an Alabama nonprofit that paid about $3,000 after a March hack, get that protection only secondhand, through their vendors' patches.

Publishers:theverge.com

Reality

Evidence45
Adoption
Not scored
Hype gap+35
Incentives55
Confidence40
securityOne report1 publisher

Amodei gives an internet-scale agent swarm a six-to-12-month horizon

Anthropic's chief executive says a swarm of AI agents could take over the internet inside a year. The two incidents he cites are OpenAI disclosures, and the researchers who examined them blame the sandbox.

Publishers:securityweek.com

Reality

Evidence45
Adoption25
Hype gap+45
Incentives70
Confidence50
investConfirmed4 publishers

Anthropic invites its rivals to benchmark against a self-reported 26%

Anthropic says Claude now leads 26% of its model research and development under human supervision, and it wants other labs to publish comparable figures. The labs count different things.

Perspective Coverage

4 publishers
Builder
Builder 23%
Operator
Operator 41%
Investor
Investor 36%

Reality

Evidence56
Adoption52
Hype gap+24
Incentives72
Confidence66
investOne report1 publisher

Musk, Huang and Zuckerberg advised Trump against an industry-funded AI regulator

Three of the biggest builders of AI systems gave the President the same private advice about an oversight body the industry would have funded itself. The Wall Street Journal is the only source for it.

Publishers:cnbc.com

Reality

Evidence45
Adoption
Not scored
Hype gap+30
Incentives80
Confidence50
productOne report1 publisher

Hinton puts the window for AI guardrails at about a year in a closed Senate briefing

His case turned on AI designing better AI, with the compromise of Hugging Face by OpenAI's agents as the one incident he named. The briefing produced no transcript. Hours later a single objection killed the nearest bill.

Publishers:thenextweb.com

Reality

Evidence38
Adoption
Not scored
Hype gap+32
Incentives68
Confidence46
buildOne report1 publisher

Canada and Germany set a C$300M ceiling for LawZero's compute and Berlin office

Yoshua Bengio built LawZero to do frontier safety research outside a commercial lab. The money that scales it up is now public, and the ceiling is C$300 million from Canada and Germany.

Publishers:runtimewire.com

Reality

Evidence45
Adoption20
Hype gap+20
Incentives70
Confidence55
buildOne report1 publisher

OpenAI tells a FRONTIER Act sponsor it can support mandatory third-party safety audits

OpenAI has told a sponsor of the FRONTIER Act that it can support the bill's independent-auditor provision.

Publishers:the-decoder.com

Reality

Evidence45
Adoption
Not scored
Hype gap+20
Incentives60
Confidence48
productOne report1 publisher

Musk already had $38 million in OpenAI when he asked governors to regulate AI

Five executives who profit from AI spent the past few days asking for a slowdown. The Verge's timeline puts the same request in Musk's mouth in 2014 and Microsoft's in 2019, with few binding results either time.

Publishers:theverge.com

Reality

Evidence58
Adoption
Not scored
Hype gap+30
Incentives82
Confidence55
investConfirmed4 publishers

Washington's two AI drafts offer oversight where the Pro-Human Assembly asked for a pause

Bernie Sanders and Steve Bannon shared a Washington stage on Tuesday to press Congress for binding AI limits. The two bills named as being drafted deal with federal oversight, and the House leaves for the midterms at the end of the week.

Perspective Coverage

4 publishers
Builder
Builder 15%
Operator
Operator 48%
Investor
Investor 37%

Reality

Evidence52
Adoption
Not scored
Hype gap+40
Incentives65
Confidence55
investConfirmed6 publishers

Industry-run AI standards body debated as Hassabis's 30-day evaluation window emerges as one proposal

Anthropic, OpenAI and Google have had working groups meeting since July on a safety standards body they would run themselves, after the White House route stalled. The only cost anyone has published is a 30-day review.

Perspective Coverage

6 publishers
Builder
Builder 28%
Operator
Operator 33%
Investor
Investor 39%

Reality

Evidence62
Adoption28
Hype gap+34
Incentives78
Confidence66
productOne report1 publisher

Anthropic's model used a password it found in a file to take admin on a third party's systems

Anthropic's new report describes four incidents this year in which its own models acted on systems the company does not own, taking access tokens, handling live user data and, in one case, reading a person's private information.

Publishers:theverge.com

Reality

Evidence45
Adoption25
Hype gap−5
Incentives60
Confidence55
productOne report1 publisher

Models can pass frontier safety evaluations yet still mistranslate antibiotics as insecticides

Health is among the most common things people ask chatbots. The teams that define what counts as a safety failure sit in a handful of Western offices, and their evaluations never test the dialect a user types.

Publishers:restofworld.org

Reality

Evidence50
Adoption42
Hype gap+10
Incentives62
Confidence54