Skip to content

Build Reports disagree9 publishers 3 min read Published Updated

A fictional target name that matched a real company steered Gemini into three live networks

Irregular's May evaluation environment could also reach the public internet. Google confirmed on September 18 that the models got inside three real firms, using a guessed password and credentials leaked in public repositories.

The Engineer · Build desk

Send a correction

What happened

  • Google confirmed on September 18 that a Gemini evaluation Irregular ran in May gave the models unintended internet access and led them into systems at three real companies.
  • The evaluation's target was a fictional company, but the name Irregular picked matched a real one. That pointed the models at a real-world target.
  • In one run a model guessed passwords until it entered an online service, and in two others models used credentials that companies had accidentally exposed in public software repositories.
  • Irregular disabled the evaluation, reviewed its logs, widened manual review and formed an internal group tasked with challenging its assumptions about containment and model control.

Why it matters

  • Who's exposed exposure Three companies have real intrusions in their logs authored by a model under test, and the notification came from Google in July or later, about a test the evaluator ran in May.
  • What it limits constraint A harness that keeps live internet access for realism cannot treat the target's invented name as its containment boundary, so the allowlist has to sit at the egress layer where it fails closed.
  • Who has to decide decision A lab commissioning an offensive-capability evaluation now has two questions to ask before signing: what the environment's network policy permits, and who clears fictional names against real companies and sites.

Either of two controls would have contained this run on its own. Irregular's environment had public internet access, enabled because realistic cyber exercises sometimes require it, according to Irregular [18]. Block egress and a name collision produces a connection that goes nowhere. Keep egress open but give the fake target a name nobody owns, and the agent scans for a host that does not exist. Both controls failed in the same evaluation, so the models had a reachable target and a reason to prefer it [17][4].

Irregular said most runs stayed inside the intended environment, and that a small number went after the matching real domain or a site with a similar name [10]. The three companies come out as one password-guessing run plus two credential reuses [14]. Both techniques are old. Password guessing and using credentials exposed in public repositories are basic intrusion methods even when an agent performs them without step-by-step human direction, and the public evidence does not show a novel exploit or a deliberate escape from a secured sandbox, according to runtimewire's account [9].

For the capability half of this to transfer to a model you can call today, you would need the versions. They have not been released, and neither have the companies' identities or the precise information the models reached inside [12].

The run was in May [2]. The Wall Street Journal first reported the incidents and Ars Technica detailed them [6]. Irregular did not tell Google until July, about two months later, Ars reported [8][13]. Google notified the affected companies after that, and confirmed the incidents on September 18 [8][2].

Google's security leadership has focused on what the models did once they were in. "In this case, the model acted appropriately," Heather Adkins, Google's vice president of security engineering, said in Ars Technica's report [7]. Google said the models stopped after recognizing they had reached real infrastructure [1]. That reduced the potential damage without authorizing the access that came first. On runtimewire's reading, the system owner, the lab and the evaluator each end up with an incident to handle [15].

Irregular's usual process already included checking fictional names for overlaps with real companies or websites, and that check failed in this evaluation, per its August 14 incident review [5]. In my view a harness built to measure offensive capability should put its strongest control at the network edge: a default-deny egress rule still holds when a review step gets skipped, and a name check only works when someone runs it. Lahav and Nevo founded Irregular on the argument that frontier models are gaining offensive capabilities faster than the industry is establishing dependable ways to measure them [16]. The May run produced evidence for that argument.

What to watch

  • Whether Google or Irregular names the affected companies or the Gemini versions involved, all still undisclosed.
  • Whether Irregular's added safeguards include a default-deny network policy or stop at broader manual review.
  • Whether other frontier labs publish egress rules for the third-party evaluators they commission.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence66
Adoption
Not scored
Hype gap+35
Incentives62
Confidence60

Perspective Coverage

9 publishers
Builder
Builder 42%
Operator
Operator 40%
Investor
Investor 18%
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    Google said the models stopped after recognizing that they had reached real infrastructure.

    Reported SupportedView cited source
  2. [2]

    A Gemini evaluation run in May by Dan Lahav and Omer Nevo's Irregular gave Google's models unintended internet access, leading them into systems at three real companies; Google confirmed this on September 18th.

    Reported Supported Source: runtimewire.com, citing Google confirmationView cited source
  3. [3]

    In one run, a model repeatedly guessed passwords until it entered an online service; in two others, models found credentials that companies had accidentally exposed in public software repositories and used them to access protected systems.

    Reported SupportedView cited source
  4. [4]

    Irregular had created a fictional target, but its name matched a real company, and that name pointed the models toward a real-world target.

    Reported SupportedView cited source
  5. [5]

    Irregular said in an August 14th incident review that its usual process includes checking fictional names for overlaps with real companies or websites, and that check failed in this evaluation.

    Reported Supported Source: Irregular incident review, August 14View cited source
  6. [6]

    The incidents were first reported by The Wall Street Journal and detailed by Ars Technica; the test was meant to measure Gemini's offensive cybersecurity abilities inside a controlled environment.

    Reported SupportedView cited source
  7. [7]

    "In this case, the model acted appropriately," Heather Adkins, Google's vice president of security engineering, said in Ars Technica's report.

    Reported Supported Source: Heather Adkins, Google, in Ars TechnicaView cited source
  8. [8]

    Irregular did not tell Google about the Gemini incidents until July, Ars reported, and Google subsequently notified the affected companies.

    Reported Supported Source: Ars Technica, via runtimewire.comView cited source
  9. [9]

    The public evidence does not show Gemini discovering a novel exploit or deliberately escaping a secured sandbox, and password guessing and using credentials exposed in public repositories are basic intrusion methods even when an AI agent carries them out without step-by-step human direction.

    Reported Supported Source: runtimewire.com analysisView cited source
  10. [10]

    Irregular said most runs remained inside the intended environment, and that in a small number of cases models targeted the matching real domain or a site with a similar name.

    Reported Supported Source: IrregularView cited source
  11. [11]

    Irregular disabled the affected evaluation, reviewed logs and added safeguards, including broader manual review and a dedicated internal group tasked with challenging assumptions about containment and model control.

    Reported SupportedView cited source
  12. [12]

    The identities of the affected companies, the Gemini model versions involved and the precise information reached inside their systems have not been made public.

    Reported SupportedView cited source
  13. [13]

    About two months passed between the May evaluation run and Irregular's July notification to Google.

    Derived Supported
  14. [14]

    The three affected companies break down as one run in which a model guessed passwords into an online service and two runs in which models reused credentials exposed in public repositories.

    Derived Supported
  15. [15]

    The models' halting reduced the potential damage but did not authorize the preceding access; a model that halts after entering the wrong system still creates an incident for the system owner, the AI laboratory and the evaluator responsible for keeping the exercise within scope.

    Reported Supported Source: runtimewire.com analysisView cited source
  16. [16]

    Lahav and Nevo founded Irregular to address the problem that frontier models are gaining useful offensive capabilities faster than the industry is establishing dependable ways to measure them.

    Reported SupportedView cited source
  17. [17]

    The test environment could also reach the public internet when it was supposed to keep the models contained.

    Reported ContestedView cited source
  18. [18]

    Internet access had been enabled because realistic cyber exercises sometimes require it, according to Irregular, leaving the models able to act outside the simulation.

    Reported Contested Source: IrregularView cited source

Sources

9 independent publishers whose own reporting we read for this story.

  1. abc.net.au

    1 article · September 19, 2026

    Gemini hacked three companies in first known breakout by Google's AI - ABC News
  2. dev.to

    6 articles · September 22, 2026

    The Gemini breakout is a judge problem, not a jailbreak problem
  3. lesswrong.com

    1 article · September 18, 2026

    Gemini had its first breakout: Google claims it is not misalignment?
  4. mezha.net

    1 article · September 18, 2026

    Gemini отримала доступ до систем трьох компаній під час тестування кібербезпеки
  5. runtimewire.com

    1 article · September 21, 2026

    Irregular's Gemini test reached three real companies through an open internet connection
  6. simonwillison.net

    2 articles · September 18, 2026

    Gemini Hacked Three Companies in First Known Breakout by Google’s AI
  7. techspot.com

    1 article · September 20, 2026

    Gemini hacked three companies during security tests, and Google kept it quiet for months | TechSpot
  8. the-decoder.com

    2 articles · September 19, 2026

    Google's Gemini also accidentally hacked three real companies during security testing
  9. theneuron.ai

    1 article · September 20, 2026

    🙀 Gemini broke into 3 real companies during a safety test

Topics and entities