Skip to content

Benchmark

FrontierMath

FrontierMath is a benchmark of hundreds of original, expert-level math problems used to test advanced AI models' mathematical reasoning skills.

Known aliases

  • FrontierMath
  • FrontierMath Erdős
  • FrontierMath Tier 4
  • FrontierMath Tier 4 (v2)

Current stories

securityConfirmed4 publishers

OpenAI gates a 100% ExploitBench model behind refusals it plans to loosen in weeks

Astra scored a perfect 100% on OpenAI's own exploit-development benchmark, against 78.5% for GPT-5.6 Sol, and the shipped model's refusal to write proof-of-concept code is a policy the company has already said it will relax.

Perspective Coverage

4 publishers
Builder
Builder 30%
Operator
Operator 42%
Investor
Investor 28%

Reality

Evidence35
Adoption20
Hype gap+45
Incentives70
Confidence55
investOne report1 publisher

OpenAI's post-launch edits doubled Astra's math lead over Anthropic's Fable

Vendor benchmark tables are dated snapshots, and the GPT-6 Astra launch shows how much can move inside one afternoon without the headline score changing, which matters for anyone scoring a purchase off one.

Publishers:fortune.com

Reality

Evidence60
Adoption
Not scored
Hype gap+40
Incentives70
Confidence58
buildOne report1 publisher

Slicing FrontierMath by category leaves about 13 problems behind each error bar

A position paper argues that CLT-based intervals dramatically understate uncertainty below a few hundred datapoints. The specialized benchmarks frontier teams build are already smaller than that before anyone slices them by task.

Publishers:arxiv.org

Reality

Evidence62
Adoption
Not scored
Hype gap+10
Incentives30
Confidence58
productOne report1 publisher

Huang tucks 400,000 incoming GPUs into three-word "AGI has arrived" post

The capacity line carries no date and no named owner, so it cannot go into anyone's plan. The number an evaluation team can use is the 37.2 points between Astra's score in OpenAI's harness and its score in ARC Prize's.

Publishers:thenextweb.com

Reality

Evidence58
Adoption44
Hype gap+58
Incentives86
Confidence56
productOne report1 publisher

ARC Prize's own harness scores GPT-6 Astra 37 points below OpenAI's adapter

ARC Prize ran GPT-6 Astra under two scaffolds and published both, 62.7% through its own minimal interface and 99.9% through OpenAI's Provider Adapter, which cost less. An eval that leaves the harness loose is scoring plumbing.

Publishers:thenextweb.com

Reality

Evidence68
Adoption55
Hype gap+64
Incentives72
Confidence62
productOne report1 publisher

OpenAI ships Astra into enterprise workspaces switched off by default

Reaching GPT-6 Astra costs a few days of patience rather than a $200 seat, so the gate worth budgeting against is Astra Pro, which Plus plans do not get, plus the credits sold on top of existing allowances.

Publishers:9to5mac.com

Reality

Evidence40
Adoption25
Hype gap+35
Incentives70
Confidence55
investOne report1 publisher

Astra's 99.9% holds up only on the harness OpenAI ran itself

ARC Prize put GPT-6 Astra at 62.7% against OpenAI's 99.9%, and the third-party composite index has it 0.3 points above the model it replaces, which leaves the 20% safety compute overhead as the clearest number in the launch.

Publishers:techtimes.com

Reality

Evidence57
Adoption42
Hype gap+58
Incentives74
Confidence54