Skip to content

Benchmark

Harvey Legal Agent Benchmark

Benchmark from legal AI company Harvey that scores AI agents on legal tasks; model makers cite it alongside coding and domain evaluations.

Known aliases

  • Harvey LAB
  • legal benchmark

Current stories

buildOne report1 publisher

Gemini 3.8 Flash beats partner-only Argon for anything shipping this quarter

Google prices Gemini 3.8 Flash at $0.75/$3.75 per million input/output tokens through 2026, three-eighths of what partner-only Gemini 4 Argon costs. Building on Flash now works if the later Argon swap moves the thinking settings along with the model name.

Publishers:dev.to

Reality

Evidence55
Adoption
Not scored
Hype gap0
Incentives40
Confidence60
investConfirmed3 publishers

xAI holds Grok's $2 token price for a model 40 Elo points behind Fable 5.1

Grok 4.7 arrived on Monday after five walked-back timelines, with 40% more parameters and Grok 4.6's list price intact. Cursor's own cost chart still puts its price per task above GPT-6 Astra and Claude Sonnet 5.

Perspective Coverage

3 publishers
Builder
Builder 42%
Operator
Operator 27%
Investor
Investor 31%

Reality

Evidence45
Adoption35
Hype gap+15
Incentives70
Confidence55
productOne report1 publisher

SpaceX prices Grok 4.7 at $4.69 a task on a benchmark it owns

SpaceX says Grok 4.7 averages $4.69 per task on CursorBench 4.0, which was built by Cursor, one of its own acquisitions. The rivals it undercut were running quality-first configurations, and GPT-6 Astra beat it on chip design.

Publishers:siliconangle.com

Reality

Evidence28
Adoption16
Hype gap+45
Incentives80
Confidence58
buildOne report1 publisher

Vals put Hy4 Preview first among open-weight models on code migration at $3.41 a test

The number came out of one harness on OpenRouter at temperature 0.9 with a 64,000-token output cap, and it holds for a bounded translation task while the same model sits mid-table on open-ended terminal work.

Publishers:runtimewire.com

Reality

Evidence57
Adoption28
Hype gap+19
Incentives62
Confidence60
buildConfirmed4 publishers

Thomson Reuters priced the middle path at $40M, and still pays Anthropic

The $450,000 training run everyone is quoting is about one percent of the programme behind it. The in-house model took one CoCounsel feature; the agent layer under it stays licensed.

Perspective Coverage

4 publishers
Builder
Builder 35%
Operator
Operator 40%
Investor
Investor 25%

Reality

Evidence54
Adoption27
Hype gap+34
Incentives78
Confidence63