Skip to content

Topic

Inference cost economics

Effective cost driven by caching, turn counts, retries and tool overhead rather than headline token prices.

Current stories

productOne report1 publisher

Databricks finds the harness swings coding-agent cost more than the model does

The company benchmarked coding agents on real tasks against its own multi-million line codebase and found that per-token price predicted almost nothing about what a finished task cost. GLM 5.2 came in at $1.28.

Publishers:databricks.com

Reality

Evidence58
Adoption38
Hype gap+20
Incentives70
Confidence55
buildOne report1 publisher

Databricks reports 60 percent higher coding spend after switching to Astra

Astra is rated cheaper per task on many benchmarks. After putting it in front of roughly 3,500 engineers, Databricks reports about 60 percent more coding spend.

Publishers:latent.space

Reality

Evidence38
Adoption62
Hype gap+30
Incentives60
Confidence45
buildOne report1 publisher

Seven finance experts wrote the 537 SEC-filing tasks that hold o3 to 46.8 percent

The Finance Agent Benchmark scores agents on recent SEC filings using Google Search and EDGAR access, and its best reported result is OpenAI's o3 at 46.8 percent accuracy and $3.79 a query. A full pass runs about $2,035.

Publishers:arxiv.org

Reality

Evidence58
Adoption
Not scored
Hype gap+10
Incentives57
Confidence55
leadershipOne report1 publisher

Arize's cheapest model per finished task reliably solves only a fifth of the benchmark

Arize and Fireworks priced ten models on what a completed command-line task costs, across 2,400 runs. The winner on that metric is an open model with the worst pass rate in the study and the thinnest coverage.

Publishers:arize.com

Reality

Evidence62
Adoption18
Hype gap+14
Incentives75
Confidence55
investOne report1 publisher

Chinese models clear 75% of enterprise engineering tasks at a fifth of the US cost

American agencies say six Chinese labs bought bulk subscriptions to US models and trained on the outputs since 2024. Enterprise buyers are meanwhile paying a fifth as much for models that clear most of their engineering work.

Publishers:fortune.com

Reality

Evidence45
Adoption55
Hype gap+25
Incentives70
Confidence45
buildOne report1 publisher

A million serverless briefings for $48 implies a Lambda rate of $0.000004 per GB-second

A dev.to walkthrough puts a quantized Llama 3.2 3B on up to 10,000 concurrent Lambdas and writes a million daily briefings for $48. The timing math is internally consistent. The per-GB-second price behind the $48 is unstated.

Publishers:dev.to

Reality

Evidence24
Adoption
Not scored
Hype gap+55
Incentives60
Confidence55
scienceOne report1 publisher

Positron raises $875M for an inference chip built around commodity LPDDR5X instead of HBM

The Reno startup says its Asimov ASIC carries 288 GB of on-package LPDDR5X and realizes more than 90% of its memory bandwidth. Both figures come from the company, and no independent benchmark accompanies them.

Publishers:forkast.news

Reality

Evidence26
Adoption5
Hype gap+58
Incentives74
Confidence54
buildOne report1 publisher

Arena's CEO defines the leaderboard score as utility to Arena's own visitors

Anastasios Angelopoulos says the number ranks how useful a model is to the tens of millions of people who visit Arena, so it travels to your stack only if your users and your task mix resemble theirs.

Reality

Evidence34
Adoption36
Hype gap+22
Incentives80
Confidence46
buildOne report1 publisher

A 6% driver reserve decides which models fit on a $2,000 pair of P40s

One operator's surplus build serves thousands of agent requests a day on silicon that taped out in 2016. Every model on it is sized against the 45 GiB the driver actually hands back rather than the 48 GB printed on the cards.

Publishers:dev.to

Reality

Evidence46
Adoption27
Hype gap+9
Incentives31
Confidence52
investOne report1 publisher

Astra's 99.9% holds up only on the harness OpenAI ran itself

ARC Prize put GPT-6 Astra at 62.7% against OpenAI's 99.9%, and the third-party composite index has it 0.3 points above the model it replaces, which leaves the 20% safety compute overhead as the clearest number in the launch.

Publishers:techtimes.com

Reality

Evidence57
Adoption42
Hype gap+58
Incentives74
Confidence54
leadershipOne report1 publisher

Fine-tuning hands the open-weight safety question to the buyer

The 270-company letter and Anthropic's warning are describing the same lever from opposite ends. Fine-tuning is what lifts a small open model past a frontier one, and it is also what can undo the safeguards shipped with it.

Publishers:forbes.com

Reality

Evidence26
Adoption
Not scored
Hype gap+32
Incentives72
Confidence28
leadershipOne report1 publisher

Gemini 3.8 Flash buys three index points for a 45% rise in cost per task

Google held its token rates flat, but the measured cost of an Intelligence Index task rose from $0.40 to $0.58 while the score still trails Fable and Sol. Picking a model for agent work is now a pricing exercise.

Publishers:implicator.ai

Reality

Evidence64
Adoption24
Hype gap+14
Incentives46
Confidence61
productOne report1 publisher

Anthropic launches Fable 5.1 and Mythos 5.1 with big benchmark gains, a day after $35B Lambda infrastructure deal

The new models ship with a 25% cost improvement that only lands on prompts with a stable prefix, while the capacity underwriting them does not reach the grid until early 2027. That second number is the one buyers should price.

Publishers:siliconangle.com

Reality

Evidence34
Adoption21
Hype gap+37
Incentives66
Confidence41
productOne report1 publisher

Lasso moves its AI guardrail off the GPU to make inspecting every request affordable

Lasso says its new LEAP engine clears most prompts and agent actions on ordinary server processors in under five milliseconds, which turns coverage from a budget line back into a policy call. It also raised $30 million.

Publishers:siliconangle.com

Reality

Evidence30
Adoption38
Hype gap+34
Incentives84
Confidence46
leadershipOne report1 publisher

Anthropic's multi-agent writeup puts the engineering weight on coordination and evaluation

Anthropic says multi-agent systems introduce their new problems in coordination, evaluation and reliability, and its own token arithmetic explains why picking a model is the cheaper half of the decision.

Publishers:anthropic.com

Reality

Evidence45
Adoption42
Hype gap+15
Incentives82
Confidence55
buildOne report1 publisher

Matching Opus on tasks solved took Gemini Flash 87 more steps per run

JetBrains put two frontier models through the same coding agent, which scored them as a tie on tasks solved even though the runs differed by 47% in steps and 2.25x in dollars, and that gap is what procurement actually pays.

Reality

Evidence48
Adoption18
Hype gap+12
Incentives68
Confidence42
leadershipOne report1 publisher

Amazon scientist says AI labs recruit for model-smarts roles, not his

Business Insider asked eight tech workers where they would go. The answers in the material we have come down to whether the work fits their skills, whether the funding model worries them, and whether the company's stated values hold up, and each one aims retention risk at a smaller band of roles than headline pay implies.

Reality

Evidence30
Adoption
Not scored
Hype gap+25
Incentives60
Confidence55
investOne report1 publisher

AI video model renders faster than real time, enabling a 24-hour channel at a promotional $2,160 a day

fal's H3 Max clears real-time playback by two thirds at the fast end of its range, which turns continuous video into a metered compute bill. The 12.5-cent promotional clip price is what the arithmetic rests on.

Reality

Evidence32
Adoption21
Hype gap+41
Incentives69
Confidence37
buildOne report1 publisher

Pooling three passes turns DeepSeek Pro's 17 findings into 28 of 32

Aikido spent 11.7 billion tokens rediscovering 32 fresh CVEs with ten models, three attempts each. The number that should move a scanning budget is the marginal cost of the second and third pass.

Publishers:aikido.dev

Reality

Evidence44
Adoption18
Hype gap+32
Incentives76
Confidence52
productOne report1 publisher

Ox Alpha was GLM-5.3-Flash, and the number that decides displacement is 18 billion

Z.ai says the model runs at a tenth the cost of its last one. The comparison an operator needs is against the API invoice they already pay, and the release does not make it.

Publishers:siliconangle.com

Reality

Evidence32
Adoption24
Hype gap+38
Incentives72
Confidence44

Earlier coverage

  1. Fable 5 at $50 per million output tokens turns model routing into a budget line

    Build · August 23, 2026 · Confirmed2 publishers

  2. Callosum raises $100m for mixed-silicon scheduling, and the 2x accuracy claim is still its own

    Product · August 20, 2026 · Confirmed2 publishers

  3. Three frontier launches in a day, all pitched on price. Open weights set the ceiling.

    Build · August 14, 2026 · Confirmed4 publishers