Skip to content

Benchmark

CWE-Bench

External automated-patching benchmark where 3.8 Flash Cyber scored 47.2% pass@1.

Known aliases

  • CWE-bench v1

Current stories

investConfirmed12 publishers

Google prices its third-ranked Gemini 4 Argon at half the cost of Anthropic's Claude Opus 5.5

Google priced Gemini 4 Argon at half Claude Opus 5.5's per-token rate for a model one composite index ranks third, behind two Anthropic models. On price alone it only matches OpenAI's newly discounted GPT-6.1 Sol, so the price edge Google is selling is against Anthropic.

Perspective Coverage

12 publishers
Builder
Builder 36%
Operator
Operator 35%
Investor
Investor 29%

Reality

Evidence55
Adoption20
Hype gap+30
Incentives65
Confidence55
buildOne report1 publisher

Gemini 4 Argon's per-task bill doubles when Google's launch discount ends

Google is charging $2 and $10 per million input and output tokens for Gemini 4 Argon at launch, half the $4 and $20 it will charge later. For a model that writes long answers and is open only to vetted cyber defenders, cost per task is the figure to check before switching.

Publishers:dev.to

Reality

Evidence45
Adoption15
Hype gap+20
Incentives60
Confidence40
securityConfirmed9 publishers

Google gives vetted defenders a Gemini 4 Argon build without cyber guardrails

Google will give vetted defenders and its own teams a Gemini 4 Argon build with no cyber guardrails, saying the model finds and patches critical flaws unaided. Wiz is the first named outside user, and the bug-finding evidence published so far comes from Google's own internal tests.

Perspective Coverage

9 publishers
Builder
Builder 39%
Operator
Operator 39%
Investor
Investor 22%

Reality

Evidence50
Adoption25
Hype gap+35
Incentives75
Confidence60
productConfirmed14 publishers

Google limits Gemini 4 Argon to select partners in its Fairwind security program

Google is releasing Gemini 4 Argon, which it says can autonomously find and patch software flaws, only to select partners in its Fairwind program. Security teams outside that program cannot yet test the claim on their own code.

Perspective Coverage

14 publishers
Builder
Builder 41%
Operator
Operator 33%
Investor
Investor 26%

Reality

Evidence50
Adoption25
Hype gap+35
Incentives70
Confidence60
buildConfirmed10 publishers

Google publishes Gemini 4 Argon's token prices before most teams can call the model

Google priced Gemini 4 Argon at $2 and $10 per million input and output tokens, then released it first to trusted cyber defenders in its Fairwind Program. Teams can budget against those rates now but cannot yet measure the token counts they multiply.

Perspective Coverage

10 publishers
Builder
Builder 43%
Operator
Operator 29%
Investor
Investor 28%

Reality

Evidence62
Adoption18
Hype gap+30
Incentives68
Confidence66
leadershipConfirmed6 publishers

Gemini 4 Argon ties two rivals on a leading AI index while some Google staff doubt its coding

Google's Gemini 4 Argon tied GPT-6 Astra and Claude Fable 5.1 at 53 on the Artificial Analysis index, though some Google staff say its coding lags. Google disputes them, and until paid API access has a date, buyers cannot check the score on their own code.

Perspective Coverage

6 publishers
Builder
Builder 37%
Operator
Operator 35%
Investor
Investor 28%

Reality

Evidence55
Adoption15
Hype gap+25
Incentives65
Confidence55
securityConfirmed4 publishers

Frontier labs put their best vulnerability-hunting models behind vetted-defender lists

Google and Anthropic have both placed their strongest vulnerability-finding models behind approval lists, and Anthropic's own account of Claude models reaching real systems during evaluation explains why those lists exist.

Perspective Coverage

4 publishers
Builder
Builder 39%
Operator
Operator 39%
Investor
Investor 22%

Reality

Evidence48
Adoption28
Hype gap+30
Incentives60
Confidence55
buildConfirmed8 publishers

Gemini 3.8 Flash's introductory price doubles on December 31, 2026

Google's third Flash release in six weeks keeps the $0.75/$3.75 rate card. But the model also spends more tokens per task. Both numbers in your cost model are moving before the price even changes.

Perspective Coverage

8 publishers
Builder
Builder 53%
Operator
Operator 29%
Investor
Investor 18%

Reality

Evidence58
Adoption35
Hype gap+22
Incentives72
Confidence62
leadershipOne report1 publisher

Gemini 3.8 Flash buys three index points for a 45% rise in cost per task

Google held its token rates flat, but the measured cost of an Intelligence Index task rose from $0.40 to $0.58 while the score still trails Fable and Sol. Picking a model for agent work is now a pricing exercise.

Publishers:implicator.ai

Reality

Evidence64
Adoption24
Hype gap+14
Incentives46
Confidence61