Skip to content

Topic

Model routing and orchestration

Routers that make model selection a runtime decision, and the argument that value accrues to that layer as models commoditise.

Current stories

buildOne report1 publisher

Haiku 5.5's 100K-token cliff cuts its price advantage over Sonnet 5.5 from 20x to 4x

Anthropic's Claude Haiku 5.5 costs $0.10/$0.50 per million tokens up to 100,000 input tokens, then $0.50/$2.50 on the whole request. A dev.to breakdown advises sending Haiku only narrow, verifiable subagent work and keeping Sonnet 5.5 as the default coder.

Publishers:dev.to

Reality

Evidence58
Adoption
Not scored
Hype gap+35
Incentives
Not scored
Confidence60
buildConfirmed8 publishers

Gemini 3.7 Flash's real pitch is fewer dead agent runs, and it is half price until December

Google's new workhorse Flash is a model-string swap for anyone on AI Gateway, discounted through 31 December 2026. The claim worth testing is reduced tool-calling loop failures, not benchmark deltas.

Perspective Coverage

8 publishers
Builder
Builder 54%
Operator
Operator 24%
Investor
Investor 22%

Reality

Evidence55
Adoption45
Hype gap+25
Incentives70
Confidence60
buildConfirmed8 publishers

Musk's Grok Bot plan to route tasks to outside AI models leaves data-handling questions unanswered

Elon Musk said on October 7th that Grok Bot will hand tasks to outside models including Claude Opus 5.5, Midjourney and Suno. For an agent holding credentials and company records, each routing choice also picks which company receives that data.

Perspective Coverage

8 publishers
Builder
Builder 31%
Operator
Operator 34%
Investor
Investor 35%

Reality

Evidence55
Adoption25
Hype gap+35
Incentives60
Confidence55
investOne report1 publisher

Microsoft claims its Decision-1 scoring model answers 35 times faster than GPT-6 Sol

Microsoft released Decision-1, a model that scores fixed answer options and, by its own benchmarks, runs 35 times faster than GPT-6 Sol. Whether routing work moves off general-purpose models now depends on independent tests and on pricing that confirm those self-reported figures.

Reality

Evidence30
Adoption15
Hype gap+35
Incentives65
Confidence35
productOne report1 publisher

Musk wants Grok to hand user requests to Claude, Midjourney and Suno

Elon Musk wants Grok to send parts of user requests to rival AI models, and he named Claude Opus 5.5, Midjourney and Suno. Any company whose staff paste contracts into Grok would then have those three providers as possible recipients of company data.

Publishers:techrepublic.com

Reality

Evidence35
Adoption
Not scored
Hype gap+40
Incentives50
Confidence30
investOne report1 publisher

Ramp's index shows US companies using about 50% more AI tokens on a smaller bill

Ramp's AI Index shows US corporate token use up about 50% since July while AI spending fell, as effective token prices dropped 41%. Usage has not grown enough to cover the price cut, so competition between OpenAI and Anthropic has so far moved revenue from the two sellers to their customers.

Reality

Evidence40
Adoption60
Hype gap+25
Incentives
Not scored
Confidence45
productOne report1 publisher

OpenAI's Dots moves always-on agents from owned hardware into OpenAI's cloud

OpenAI launched Dots at DevDay 2026, personal agents that run on cloud computers OpenAI maintains and keep context across ChatGPT, Slack and Teams. For unattended agent work, teams now choose between OpenAI's machines and hardware they can switch off themselves.

Publishers:turingpost.com

Reality

Evidence35
Adoption
Not scored
Hype gap+25
Incentives55
Confidence40
buildOne report1 publisher

Microsoft's 2026 Translator API puts an NMT-or-LLM choice in every request

Microsoft's 2026 Translator API lets each request choose neural translation or an LLM, with request and response formats that differ from v3.0. Teams migrating should put that choice in one versioned routing policy.

Publishers:dev.to

Reality

Evidence35
Adoption
Not scored
Hype gap+5
Incentives50
Confidence40
buildOne report1 publisher

Warp replays your stored agent runs to decide which model gets the next ticket

The replay only works on runs Warp's infrastructure already recorded, and correctness is graded by a judge model against a rubric you write. Warp's own 30-task bake-off cost $2,130.57. It finished in under four hours.

Publishers:runtimewire.com warp.dev

Reality

Evidence40
Adoption15
Hype gap+35
Incentives80
Confidence55
leadershipOne report1 publisher

Kognitos's founder traces the enterprise token bill to undocumented work

Binny Gill argues in a Forbes council column that firms are paying reasoning-model rates for rule-following tasks. The two studies he cites measure consultants and a research router. Neither one measured an enterprise bill.

Publishers:forbes.com

Reality

Evidence30
Adoption18
Hype gap+35
Incentives78
Confidence38
leadershipOne report1 publisher

Projected 63% rise in AI model spending puts focus on cost per successful outcome

Worldwide end-user spending on AI models and platforms is projected to rise 63% in 2026, and a startup CTO writing for Forbes argues the number a board can audit is what one completed piece of work costs.

Publishers:forbes.com

Reality

Evidence28
Adoption
Not scored
Hype gap+30
Incentives80
Confidence45
investOne report1 publisher

Docusign cut per-document AI cost 50-fold by routing most work to models it trained itself

A Microsoft case study credits Docusign's swap to small task-specific models with 90% lower cost and eight times the throughput. Docusign's own accounting of the whole pipeline claims 50 times cheaper per document.

Publishers:pymnts.com

Reality

Evidence42
Adoption62
Hype gap+24
Incentives80
Confidence55
buildOne report1 publisher

Consent Belongs in the Decision Path, Where Suppress Is One of Several Trust Actions That Can Change a Score

An InfoQ pattern piece puts consent, fatigue, channel sensitivity and cost inside the ranking path, with five trust actions that adjust a candidate's score and a response payload naming the tier and the rules behind it.

Publishers:infoq.com

Reality

Evidence34
Adoption
Not scored
Hype gap+20
Incentives45
Confidence58
productOne report1 publisher

Stripe's planned OpenRouter purchase makes model routing an infrastructure decision

SiliconANGLE reads dynamic model routing as the next SD-WAN, and the comparison tells operators which controls to ask a vendor for. It also shows how little of an answer's quality a router can see at the moment it picks.

Publishers:siliconangle.com

Reality

Evidence34
Adoption
Not scored
Hype gap+30
Incentives80
Confidence48
buildOne report1 publisher

Open-weight models took 78.4% of Vercel gateway tokens on a single September day

Guillermo Rauch's daily snapshot counts tokens inside one managed gateway's self-selected traffic. Vercel's monthly index carries the figure that prices the routing decision, 56% of tokens against 14% of estimated spend.

Publishers:runtimewire.com

Reality

Evidence42
Adoption62
Hype gap+34
Incentives82
Confidence55
investOne report1 publisher

Salesforce runs Agentforce a generation behind the models its keynote guests debated

Nvidia's Jensen Huang told frontier labs to run as fast as they can. On the Dreamforce floor, the Salesforce customers and partners CNBC quoted said last year's models already cover the work they sell, and one of them would welcome a pause.

Publishers:cnbc.com

Reality

Evidence58
Adoption45
Hype gap+18
Incentives72
Confidence55
buildOne report1 publisher

Octomind wired five agent decision points to a classifier that can only veto

Version 0.54.0 sends skill routing, output scoring and verifier double-checks to Jev, a typed model that returns a calibrated probability and no text, at $0.00001 to $0.0001 an answer on Octomind's cloud.

Publishers:dev.to

Reality

Evidence42
Adoption35
Hype gap+18
Incentives74
Confidence40

Earlier coverage

  1. Twenty model calls turn a two-second step into a 45-second wait

    Product · September 17, 2026 · One report1 publisher

  2. Anthropic and GitHub have moved AI costs from the seat to the meter

    Leadership · September 3, 2026 · One report1 publisher

  3. Fable 5 at $50 per million output tokens turns model routing into a budget line

    Build · August 23, 2026 · Confirmed2 publishers

  4. Three frontier launches in a day, all pitched on price. Open weights set the ceiling.

    Build · August 14, 2026 · Confirmed4 publishers