Skip to content

Benchmark

Agents' Last Exam

Agent evaluation where GLM-5.3 scored 28.5, up from 23.8.

Known aliases

  • ALE

Current stories

buildConfirmed17 publishers

Astra's Critical cyber rating ships a real-time pause switch inside the Bedrock service boundary

Greg Brockman said AGI arrived with GPT-6 Astra on September 3. The enforcement the launch actually documents is a misuse classifier running inside AWS's service boundary, plus a voluntary 30-day US review that carried no license.

Perspective Coverage

17 publishers
Builder
Builder 39%
Operator
Operator 37%
Investor
Investor 24%

Reality

Evidence58
Adoption42
Hype gap+45
Incentives72
Confidence60
productConfirmed8 publishers

OpenAI halves the API price of Sol and Luna against GPT-5.6's promotional rates

OpenAI says better caching and inference let it cut API prices for Sol and Luna by half, and the cost advantage it claims for the cheap tier over the old top tier comes in at one tenth on the benchmark it published and one hundredth in its summary.

Perspective Coverage

8 publishers
Builder
Builder 36%
Operator
Operator 42%
Investor
Investor 22%

Reality

Evidence40
Adoption
Not scored
Hype gap+35
Incentives70
Confidence60
securityOne report1 publisher

OpenAI's 50 percent API price cut doubles the token volume a flat budget buys

OpenAI's own benchmarks put GPT-6 Sol and Luna at half the list price and a fraction of a rival's cost per finished task. For defenders, the thing getting cheaper is autonomous tool calls into business systems.

Reality

Evidence32
Adoption38
Hype gap+34
Incentives80
Confidence52
productOne report1 publisher

OpenAI cuts prices on new GPT-6 Sol and Luna models

Sol now bills $2 and $10 per million tokens and Luna $0.10 and $0.50, while OpenAI quotes its own benchmark results per task, where the cheap model lands 2.2 points behind Sol on the software engineering test.

Publishers:thenextweb.com

Reality

Evidence42
Adoption55
Hype gap+25
Incentives78
Confidence52
productOne report1 publisher

Astra cuts the computer-use task from about 75 minutes to 40

OpenAI has put its paused computer-use model into a few customers' hands, where the speed gain arrives alongside a reasoning trail outside investigators say is harder to follow. The containment work now sits with the customer.

Publishers:zdnet.com

Reality

Evidence34
Adoption22
Hype gap+38
Incentives70
Confidence38
buildOne report1 publisher

SGLang's one-GPU Qwen3.8-27B recipe is the useful half of the release

A published NVFP4 and speculative-decoding config turns a 27B open-weights model into something you can try to serve. The 206.1 tokens per second figure is single-stream and unreplicated.

Publishers:runtimewire.com

Reality

Evidence52
Adoption28
Hype gap+14
Incentives70
Confidence46
buildOne report1 publisher

A harness gain is not a leaderboard win: reading the J-Space DeepSeek report properly

A viral X post said an inference-time text layer put DeepSeek V4 Pro ahead of Fable 5 on every task. The report it points to shows single runs, nine benchmarks, and two losses.

Publishers:runtimewire.com

Reality

Evidence40
Adoption18
Hype gap+55
Incentives62
Confidence45
buildOne report1 publisher

GLM-5.3 is a paper, not an endpoint: Z.ai publishes research before weights

Z.ai's August 14 post claims post-training gains for coding agents, but the company's release notes still stop at GLM-5.1 and there is no API endpoint, model identifier or weight download.

Publishers:runtimewire.com

Reality

Evidence42
Adoption18
Hype gap+38
Incentives68
Confidence46