Skip to content

Topic

AI inference economics

Cost of serving model tokens, per-token pricing pressure, and the economics of giving inference away.

Current stories

leadershipOne report1 publisher

Same-price Claude plans buy five times OpenAI's mid-tier API usage in SemiAnalysis meter tests

SemiAnalysis tests found same-price Claude plans buy about five times OpenAI's mid-tier API usage after OpenAI halved its $200 plan. Teams weighing seats as old Pro limits expire after October 29 are comparing allowances neither lab publishes.

Publishers:implicator.ai

Reality

Evidence55
Adoption
Not scored
Hype gap+20
Incentives60
Confidence50
leadershipOne report1 publisher

Microsoft's 1-bit BitNet reopens the question of which inference needs a GPU

Rohan Pinto says BitNet b1.58 runs a 100-billion-parameter model at five to seven tokens a second on a single CPU. That is enough for overnight batches and air-gapped servers, and short of what a cloud tier needs.

Publishers:forbes.com

Reality

Evidence22
Adoption
Not scored
Hype gap+58
Incentives66
Confidence57
productOne report1 publisher

China Telecom's research arm puts inference at 80% of China's compute market by 2029

The forecast, carried by state broadcaster CCTV, describes compute demand that is billed every time somebody uses a model. Europe is building for the same demand with seven gigafactories on a EUR 30bn budget, of which about EUR 1bn is committed.

Publishers:thenextweb.com

Reality

Evidence40
Adoption30
Hype gap+25
Incentives70
Confidence35
productOne report1 publisher

Heatmap finds three-quarters of Americans oppose new data centers where they live

The opposition numbers land on product teams, because an AI feature that fires without being asked bills compute for every user and adds load in towns already organizing against the next build.

Publishers:siliconangle.com

Reality

Evidence45
Adoption50
Hype gap+30
Incentives65
Confidence50
productOne report1 publisher

Cloudera bets nine figures that regulated buyers will host Mistral rather than call an API

The partnership removes the external API hop for enterprises that cannot let sensitive records leave the perimeter, which also moves the inference bill off someone else's per-token pricing and onto hardware the customer has to buy and keep busy.

Publishers:siliconangle.com

Reality

Evidence38
Adoption10
Hype gap+38
Incentives78
Confidence52
investOne report1 publisher

The $200 AI seat is a subsidy: ceiling users pull 40x to 70x what they pay

SemiAnalysis says a $200 plan can yield $8,000 of Anthropic API-equivalent usage and $14,000 of OpenAI's. Even the best published caching fix leaves the gap several times wide.

Reality

Evidence32
Adoption44
Hype gap+34
Incentives58
Confidence38
productOne report1 publisher

A Beijing bar gives away DeepSeek tokens. Your per-token price list is the collateral damage.

Two Nvidia workstations behind a bar in Zhongguancun self-host DeepSeek V4 Flash and hand out inference like bar snacks. Read it as a pricing signal, not a novelty.

Publishers:thenextweb.com

Reality

Evidence28
Adoption12
Hype gap+34
Incentives58
Confidence30