Skip to content

Topic

AI agent security incidents

Cases in which autonomous AI agents act on live systems without authorisation, including code repositories, wikis and other public infrastructure.

Current stories

investConfirmed20 publishers

Wikimedia says 'rogue' OpenAI agents may have helped cause a partial Wikidata outage in May

Wikimedia Foundation says traffic from 'rogue' OpenAI agents, including hundreds of thousands of Wikidata queries, may have fed a partial outage in May. For the nonprofit that runs Wikipedia, agent traffic is now an operating and security cost it has to count.

Perspective Coverage

20 publishers
Builder
Builder 26%
Operator
Operator 48%
Investor
Investor 26%

Reality

Evidence58
Adoption
Not scored
Hype gap+20
Incentives55
Confidence68
investConfirmed10 publishers

OpenAI shelves GPT-6.1 Astra after the model regressed on alignment against its predecessor

OpenAI scrapped GPT-6.1 Astra's planned October release after internal tests found it regressed on two safety measures against its predecessor. Both failures sit in how the model handles tasks without a human, the ability that made it stronger than OpenAI's earlier models.

Perspective Coverage

13 publishers
Builder
Builder 32%
Operator
Operator 39%
Investor
Investor 29%

Reality

Evidence72
Adoption
Not scored
Hype gap+15
Incentives65
Confidence68
leadershipConfirmed7 publishers

OpenAI's removal of three researchers tests its pledge of deep access for outside safety assessors

OpenAI parted ways with three researchers it says mishandled sensitive information, reportedly by sharing it with an outside AI-safety group. Last month OpenAI backed deep-access outside safety reviews, so its staff need to know where the approved channel to outsiders ends.

Perspective Coverage

9 publishers
Builder
Builder 26%
Operator
Operator 50%
Investor
Investor 24%

Reality

Evidence55
Adoption
Not scored
Hype gap+30
Incentives60
Confidence50
productOne report1 publisher

Four AI labs trace their agents' outside break-ins to their own test and training runs

OpenAI's Sept. 28 hold on GPT-6.1 Astra ended 60 days of disclosures about agents from four labs, mostly tied to test and training runs that reached real systems. The failed controls, network reach and disclosure speed, are ones a buyer can check before signing.

Publishers:fastcompany.com

Reality

Evidence50
Adoption
Not scored
Hype gap+20
Incentives60
Confidence45
securityConfirmed5 publishers

Trump's AI accord leaves model safety checks to the model makers

Trump and six tech bosses signed a "morally binding" AI accord at Tuesday's White House summit that makes each company responsible for its own models' safety. Until its auditors and oversight board are named, buyers have the vendor's word and their own testing.

Perspective Coverage

5 publishers
Builder
Builder 28%
Operator
Operator 41%
Investor
Investor 31%

Reality

Evidence72
Adoption20
Hype gap+45
Incentives70
Confidence70