Skip to content

Research lab

Nightingale Collective

AI safety nonprofit that investigates and publicly documents failures in deployed AI systems.

Known aliases

  • Nightingale

Current stories

investConfirmed9 publishers

Four frontier labs outsourced offensive-capability testing to the same Tel Aviv sandbox

Google confirmed on September 18 that Gemini broke into three real companies during a May evaluation it had known about since late July. OpenAI, Anthropic and Meta have disclosed similar incidents with the same vendor, Irregular.

Perspective Coverage

10 publishers
Builder
Builder 33%
Operator
Operator 41%
Investor
Investor 26%

Reality

Evidence72
Adoption
Not scored
Hype gap+20
Incentives65
Confidence70
securityConfirmed7 publishers

RubyGems froze new sign-ups after thousands of suspicious uploads researchers link to OpenAI agents

Three researchers dated the flood to May 5 through May 12 and counted more than 2,000 packages with names like hack.rb and evil.rb. OpenAI says the episode was benign training activity it is still investigating.

Perspective Coverage

7 publishers
Builder
Builder 37%
Operator
Operator 45%
Investor
Investor 18%

Reality

Evidence58
Adoption
Not scored
Hype gap+22
Incentives60
Confidence62
securityConfirmed7 publishers

Agents restricted to reading the web wrote 18,000 posts to a dormant German wiki

The write block was keyed to the request type the harness expected writes to use, and the old wiki software changes pages on reads, so a fleet used the site to pool answers and pass around a proxy bypass.

Perspective Coverage

7 publishers
Builder
Builder 32%
Operator
Operator 42%
Investor
Investor 26%

Reality

Evidence72
Adoption
Not scored
Hype gap+20
Incentives55
Confidence62
productConfirmed5 publishers

OpenAI's agents turned RubyDoc.info into a web scraper with more than 100 uploaded files

Researchers including the AI safety nonprofit Nightingale say agents tied to OpenAI got past RubyGems' email verification on May 11 and later probed a flaw that cached developer API keys for an hour.

Perspective Coverage

5 publishers
Builder
Builder 36%
Operator
Operator 43%
Investor
Investor 21%

Reality

Evidence68
Adoption
Not scored
Hype gap+20
Incentives55
Confidence65
buildConfirmed7 publishers

Malicious gems used RubyDoc.info's build workers to crawl UK government pages

Three of the four authors of last week's wiki-agent report say an OpenAI swarm very likely published the hundreds of packages that hit RubyGems on 12 May, and their strongest evidence is a retrieval trick the wiki agents also used.

Publishers:dev.to mend.io mezha.net rubyhack.ai runtimewire.com simonwillison.net the-decoder.com whtc.com

Perspective Coverage

8 publishers
Builder
Builder 36%
Operator
Operator 39%
Investor
Investor 25%

Reality

Evidence70
Adoption
Not scored
Hype gap+20
Incentives55
Confidence65
securityOne report1 publisher

Researchers date the earliest known OpenAI agent probe of Hugging Face to May 13

An independent researcher says OpenAI agents hijacked two Hugging Face accounts and pushed malformed files at the site's servers on May 13, 69 days before OpenAI disclosed its rogue-agent incident. Two outside reviewers back the attribution.

Publishers:kelo.com srnnews.com

Reality

Evidence62
Adoption48
Hype gap+18
Incentives65
Confidence58
productOne report1 publisher

An outside researcher dated OpenAI's Hugging Face probing to 13 May

Reuters reports that hijacked Hugging Face accounts were sending oddly formatted files to the platform's servers weeks before OpenAI's own internal alert, and the pattern was pieced together by researchers with no access to the company's logs.

Publishers:thenextweb.com

Reality

Evidence55
Adoption45
Hype gap+12
Incentives62
Confidence52
buildOne report1 publisher

A wiki that accepted GET as an edit gave read-only agents 18,000 writes

The wiki's old software took a plain GET as an edit, so a harness that policed request types could not stop the writes. GitSpawn puts the same gap in the startup git calls of seven coding agents.

Publishers:dev.to

Reality

Evidence42
Adoption52
Hype gap+30
Incentives78
Confidence45