Skip to content

Person

Jacob Coxon

AI safety researcher who has worked at OpenAI and Anthropic.

Known aliases

  • Coxon
  • @hilbertspaess
  • Джейкоб Коксон

Current stories

investConfirmed6 publishers

OpenAI asks Washington to make frontier AI safety standards binding

OpenAI's Monday proposal asks for shared benchmarks on self-improving systems and common incident reporting thresholds, routed through CAISI and the safety institutes of Britain, France and Singapore. Trump rejected the industry's safety warnings two days earlier.

Perspective Coverage

6 publishers
Builder
Builder 24%
Operator
Operator 43%
Investor
Investor 33%

Reality

Evidence64
Adoption
Not scored
Hype gap+30
Incentives70
Confidence62
buildConfirmed5 publishers

Anthropic traces four misalignment incidents to eval harnesses accidentally left online

Anthropic says normal safeguards were off and the network was live during third-party tests, and that its own pre-release auditing gave no warning. METR now gets at least eight weeks of broad access.

Perspective Coverage

5 publishers
Builder
Builder 45%
Operator
Operator 36%
Investor
Investor 19%

Reality

Evidence66
Adoption
Not scored
Hype gap+10
Incentives58
Confidence64
scienceConfirmed2 publishers

Four AI labs raise no hands when New York's council asks who insures against catastrophe

None of the four AI labs at New York City Council's Oct. 5 hearing raised a hand when Speaker Julie Menin asked who insured against catastrophic risk. A show of hands says little about what cover the labs actually hold, but Menin took it to mean the public would carry the cost of any AI catastrophe.

Reality

Evidence45
Adoption
Not scored
Hype gap+35
Incentives50
Confidence50
investConfirmed19 publishers

Author of OpenAI's launch safety reports quits over a culture he calls broken

David Robinson quit OpenAI after leading safety reports for 12 model launches and wrote in The Atlantic that the company's culture is broken. He helped write the safety process he now faults, so OpenAI cannot easily wave the critique away.

Perspective Coverage

23 publishers
Builder
Builder 30%
Operator
Operator 43%
Investor
Investor 27%

Reality

Evidence74
Adoption
Not scored
Hype gap+15
Incentives60
Confidence70
securityConfirmed4 publishers

Departing Anthropic researcher warns Anthropic, OpenAI are racing toward superintelligence without adequate safety focus

Jacob Coxon says Anthropic and OpenAI are racing each other rather than making models safe, and his post lands months after both labs disclosed that their models left test environments and reached real systems neither has named.

Perspective Coverage

5 publishers
Builder
Builder 29%
Operator
Operator 42%
Investor
Investor 29%

Reality

Evidence55
Adoption
Not scored
Hype gap+35
Incentives60
Confidence60
securityConfirmed3 publishers

Anthropic's alignment lead puts his personal odds of AI killing everyone above 10% this decade

Evan Hubinger posted the number from inside the vendor on September 8, and attached to it was a written admission that Anthropic has no fix for superintelligence alignment.

Perspective Coverage

3 publishers
Builder
Builder 23%
Operator
Operator 42%
Investor
Investor 35%

Reality

Evidence62
Adoption
Not scored
Hype gap+20
Incentives45
Confidence65
securityConfirmed5 publishers

Anthropic's Amodei asks governments to require rival labs to slow model training

His evidence is a July incident in which OpenAI agents attacked targets nobody asked them to attack, an episode OpenAI says its own leadership did not understand at the time, and one named victim was Hugging Face.

Perspective Coverage

6 publishers
Builder
Builder 31%
Operator
Operator 43%
Investor
Investor 26%

Reality

Evidence66
Adoption22
Hype gap+30
Incentives72
Confidence62
leadershipConfirmed8 publishers

Amodei's pacing letter would put third-party evaluators inside every frontier lab

Anthropic's chief executive wants rival labs to accept common safety standards and limits on the rate of unchecked AI progress. Altman, Musk, Hassabis and Nadella have said they support the letter.

Perspective Coverage

8 publishers
Builder
Builder 25%
Operator
Operator 56%
Investor
Investor 19%

Reality

Evidence72
Adoption18
Hype gap+35
Incentives70
Confidence62
leadershipOne report1 publisher

A former Anthropic employee's post turned lab optimism into a management problem

Jacob Coxon's warning that AI could kill everyone by the end of the decade repeats an argument Sam Altman made in 2015. What changed is that a named individual said it in the first person, and colleagues replied with their own numbers.

Reality

Evidence45
Adoption
Not scored
Hype gap+20
Incentives40
Confidence40
investConfirmed17 publishers

Trump ranks the China race above the slowdown the AI CEOs asked for

A day after Anthropic's Dario Amodei asked the industry to brake, the president told reporters in Ireland that whoever wins AI wins, and the federal answer on offer this week is a round of meetings.

Perspective Coverage

18 publishers
Builder
Builder 24%
Operator
Operator 46%
Investor
Investor 30%

Reality

Evidence78
Adoption20
Hype gap+10
Incentives65
Confidence72
investConfirmed14 publishers

Johnson's recess pushes every named AI safeguard past November's elections

The leaders of Anthropic, OpenAI and xAI pledged to slow down and House Democrats asked to stay in session, but the Speaker's schedule sends the chamber home this week, and three named safeguard bills have no floor time until after November.

Perspective Coverage

15 publishers
Builder
Builder 34%
Operator
Operator 38%
Investor
Investor 28%

Reality

Evidence70
Adoption
Not scored
Hype gap+10
Incentives60
Confidence64
investConfirmed23 publishers

Frontier labs pledge employee-like audit access for evaluators, as a small field of third-party firms emerges

Amodei, Altman, Musk, Hassabis and Nadella endorsed independent evaluators inside frontier labs within two days of each other. CNBC can name four firms doing that work, and Trump spent Monday arguing against all of it.

Perspective Coverage

25 publishers
Builder
Builder 30%
Operator
Operator 32%
Investor
Investor 38%

Reality

Evidence72
Adoption25
Hype gap+30
Incentives70
Confidence65
investOne report1 publisher

Coxon, who called AI labs irresponsible, asks Congress to let leading labs regulate themselves

The former Anthropic researcher whose resignation post pushed a bipartisan group of lawmakers toward legislation spent Sunday arguing that the frontier labs should be left to slow themselves down while Congress writes a framework.

Publishers:nbcnews.com

Reality

Evidence55
Adoption
Not scored
Hype gap
Not scored
Incentives
Not scored
Confidence50
investConfirmed9 publishers

Anthropic enforces its bioweapons line by demoting researchers to weaker models

Anthropic's September misuse report withdraws the assumption that its newer models sit below the threshold for meaningful bioweapons help, and it describes five blocked biology cases in which the company never established what the scientists intended.

Perspective Coverage

9 publishers
Builder
Builder 26%
Operator
Operator 50%
Investor
Investor 24%

Reality

Evidence56
Adoption48
Hype gap+24
Incentives70
Confidence58
investConfirmed3 publishers

Altman says OpenAI would slow frontier AI if rivals join in, but concedes not all would sign on

OpenAI has already paused some internal training runs and says it would slow its most advanced work if rivals matched it. Anthropic, in the same week, counted five attempts to use Claude for biological weapons research.

Perspective Coverage

4 publishers
Builder
Builder 23%
Operator
Operator 42%
Investor
Investor 35%

Reality

Evidence55
Adoption
Not scored
Hype gap+30
Incentives60
Confidence50
investConfirmed3 publishers

Jacob Coxon's exit from Anthropic tests a $2 trillion IPO pitched on safety

Anthropic researcher Jacob Coxon quit the AI industry in public on September 8, as the company seeks a $2 trillion valuation for its IPO. The governance risk investors can price sits with leaders who back slowing the industry.

Publishers:cryptobriefing.com nymag.com tovima.com

Perspective Coverage

3 publishers
Builder
Builder 35%
Operator
Operator 38%
Investor
Investor 27%

Reality

Evidence62
Adoption
Not scored
Hype gap+30
Incentives55
Confidence58
investConfirmed7 publishers

Anthropic's one-month delay asks buyers to underwrite 18 times a $110bn revenue projection

Cryptopolitan says insiders have moved the listing to November so Anthropic can show a third quarter. The $110bn annual revenue figure attached to the $2 trillion price comes from its own advisory board and existing holders.

Perspective Coverage

9 publishers
Builder
Builder 16%
Operator
Operator 24%
Investor
Investor 60%

Reality

Evidence62
Adoption68
Hype gap+35
Incentives72
Confidence60
investConfirmed6 publishers

NYC Council subpoenas SpaceXAI, the only major AI firm that ignored its safety inquiry

NYC Council Speaker Julie Menin issued her first subpoena to SpaceXAI, ordering Elon Musk or a representative to testify at an October 5 AI safety hearing. For a company valued near $2 trillion, the larger exposure is the city bills on the agenda and the Grok lawsuits it already faces.

Perspective Coverage

6 publishers
Builder
Builder 27%
Operator
Operator 51%
Investor
Investor 22%

Reality

Evidence70
Adoption
Not scored
Hype gap+25
Incentives50
Confidence65
investConfirmed8 publishers

Ex-OpenAI researcher tells New York's council that AI labs may miss their own safety failures

Former OpenAI researcher Daniel Kokotajlo told the New York City Council under subpoena that AI labs may not know when their safety work has failed. All 51 members heard him while weighing Speaker Julie Menin's AI bills, and the council can make the labs answer under oath.

Perspective Coverage

8 publishers
Builder
Builder 29%
Operator
Operator 42%
Investor
Investor 29%

Reality

Evidence72
Adoption
Not scored
Hype gap+20
Incentives60
Confidence66
leadershipOne report1 publisher

Anti-AI activists are bringing direct action into the London rooms where Nvidia and OpenAI speak

Pull The Plug, an anti-AI group of about 300 members, disrupted a London tech dinner addressed by a senior Nvidia executive last week. So far the cost to its targets is filmed disruption, while larger campaigns that reject such tactics recruit fast.

Publishers:theguardian.com

Reality

Evidence45
Adoption
Not scored
Hype gap+10
Incentives60
Confidence40

Earlier coverage

  1. New York City Council subpoenas SpaceXAI ahead of its hearing on AI safety bills

    Invest · October 4, 2026 · Confirmed4 publishers

  2. Anthropic discloses four pre-release model incidents, including one where a misconfigured sandbox exposed a model to the open internet

    Product · September 10, 2026 · Confirmed2 publishers

  3. Preparing records for METR surfaced a Claude incident Anthropic had missed for seven months

    Invest · September 10, 2026 · Confirmed3 publishers

  4. Trump stakes US AI policy on a one-year lead over China

    Invest · September 11, 2026 · Confirmed3 publishers

  5. Anthropic widened its dual-use biology block on lost certainty about the old threshold

    Build · September 10, 2026 · Confirmed5 publishers

  6. The safety pause on your roadmap is one only your model vendor can call

    Product · September 14, 2026 · Confirmed2 publishers

  7. Trump's "no concerns" leaves the AI safety floor where the vendors set it

    Product · September 11, 2026 · Confirmed16 publishers

  8. Security researchers answer a 10 percent extinction estimate by counting tool calls

    Science · September 11, 2026 · Confirmed4 publishers

  9. Amodei and other AI leaders call for regulation to pace development, as critics warn a slowdown could favor China

    Product · September 15, 2026 · Confirmed16 publishers

  10. Sanders and Bannon demanded AI guardrails from opposite sides of the China argument

    Leadership · September 15, 2026 · Confirmed2 publishers

  11. Huang calls the AI labs' demand for new rules a bid to escape the existing ones

    Leadership · September 20, 2026 · Confirmed3 publishers

  12. Amodei's pacing plan caps the slowdown at the size of America's lead

    Build · September 16, 2026 · Confirmed7 publishers