Skip to content

Benchmark

GDPval-AA v2

Artificial Analysis's Elo-scored adaptation of OpenAI's GDPval, ranking AI models on real-world, computer-based knowledge-work tasks across many occupations.

Known aliases

  • GDPVal-AA
  • GDPVal-AA v2

Current stories

scienceOne report1 publisher

Token efficiency absorbs GPT-6 Astra's 2.5x price increase inside the coding harness

Artificial Analysis priced the new model at $10 and $50 per million tokens, and the threefold token cut it measured in the Codex agent harness covers that increase where the roughly 10% cut on its intelligence suite does not.

Reality

Evidence63
Adoption
Not scored
Hype gap+16
Incentives62
Confidence57
productOne report1 publisher

Ox Alpha was GLM-5.3-Flash, and the number that decides displacement is 18 billion

Z.ai says the model runs at a tenth the cost of its last one. The comparison an operator needs is against the API invoice they already pay, and the release does not make it.

Publishers:siliconangle.com

Reality

Evidence32
Adoption24
Hype gap+38
Incentives72
Confidence44
scienceOne report1 publisher

A 91-task benchmark for agent knowledge work runs every task cold, and says so

Artificial Analysis' AA-Briefcase grades deliverables built from four multi-week projects, but each task starts with no memory of the model's own earlier submissions. Continuity stays unmeasured.

Reality

Evidence60
Adoption
Not scored
Hype gap+12
Incentives62
Confidence55
scienceOne report1 publisher

Frontier scores at $2/$6: Grok 4.6 ties GPT-5.6 on one evaluator's index for a fifth the output price

Artificial Analysis puts Grok 4.6 at 61 on its Intelligence Index, level with GPT-5.6 Sol, at $2/$6 per million tokens. The same pages record 48 seconds to first token.

Reality

Evidence56
Adoption24
Hype gap+24
Incentives63
Confidence50
buildOne report1 publisher

Four frontier models in four days, and the cheapest number in your agent plan has an expiry date

Grok 4.6, Gemini 3.7 Flash, DeepSeek V4 Pro and GLM-5.3 all chase agents that stay on task. The pricing underneath them is moving faster than the benchmarks.

Publishers:dev.to

Reality

Evidence58
Adoption55
Hype gap+12
Incentives68
Confidence48
buildConfirmed4 publishers

Three frontier launches in a day, all pitched on price. Open weights set the ceiling.

Grok 4.6, Qwen3.8-Max and DeepSeek V4-Pro shipped inside about 24 hours, and two of the three came with downloadable weights. The benchmarks existed to justify a cheaper invoice.

Perspective Coverage

4 publishers
Builder
Builder 41%
Operator
Operator 31%
Investor
Investor 28%

Reality

Evidence68
Adoption52
Hype gap+22
Incentives74
Confidence63