Skip to content

Topic

LLM Model Routing

Assigning tasks across models by cost, speed and quality instead of routing all work to one large model.

Current stories

buildOne report1 publisher

SpaceX's Grok Bot will route work to Claude Opus 5.5 whenever Anthropic's model does it better

Elon Musk said SpaceX's Grok Bot agent will send each task to the best back-end model, Anthropic's Claude Opus 5.5 included. The policy moves the engineering work into routing, and into the tests that decide what 'best' means for each task.

Publishers:thenewstack.io

Reality

Evidence50
Adoption55
Hype gap+25
Incentives70
Confidence50
buildConfirmed6 publishers

Your inference gateway now has an owner: Stripe took OpenRouter, Ramp is buying share at zero fees

Stripe confirmed its OpenRouter deal on the same day Ramp launched a rival router with no fees through 2026. The layer you picked for being boring is now a strategic asset for someone else.

Perspective Coverage

6 publishers
Builder
Builder 39%
Operator
Operator 28%
Investor
Investor 33%

Reality

Evidence68
Adoption40
Hype gap+20
Incentives72
Confidence62
investOne report1 publisher

Bank of America plans to double AI spending that must clear a 16-pillar risk review

Bank of America will double its AI budget next year, CEO Brian Moynihan said; about 140 uses now cost $400 million and yield $800 million in benefit. Its technology chief, Hari Gopalkrishnan, says every AI project goes through a review covering 16 categories of risk.

Publishers:fortune.com

Reality

Evidence40
Adoption70
Hype gap+20
Incentives65
Confidence55
buildOne report1 publisher

Cloudflare's Auto Router moves model selection from the user into AI Gateway

Cloudflare's Auto Router, now in public beta, picks a model per AI Gateway request and cut costs by up to 30% in the company's own OpenCode use. How much of that transfers depends on how much of a team's traffic never needed a frontier model.

Reality

Evidence35
Adoption15
Hype gap+15
Incentives80
Confidence40
productOne report1 publisher

CData's gateway holds AI agents to each user's own row and column permissions

CData's Connect AI Gateway, now in early access, holds AI agents to each user's own permissions down to specific rows and columns. Teams deploying agents can now buy that control, though the accuracy claims behind it come from CData's own tests.

Publishers:siliconangle.com

Reality

Evidence35
Adoption8
Hype gap+35
Incentives70
Confidence40
buildOne report1 publisher

Smart Routing cost 35.6 times as much as a cheap fixed model in LLM Gateway's own benchmark

LLM Gateway's own benchmark found Smart Routing cost 33.2% less than a premium model and 35.6 times as much as a low-cost one that stayed competitive. With the premium saving not statistically established on 80 prompts, a fixed cheap model is the baseline Smart Routing has to beat.

Publishers:dev.to

Reality

Evidence45
Adoption
Not scored
Hype gap+8
Incentives80
Confidence50
productOne report1 publisher

Salesforce dates the rest of its agent harness to a fiscal year starting next February

Salesforce says many of the technologies behind its new Enterprise AI Harness already run in its cloud services, and the rest arrive early in fiscal 2028. It has not said which features sit in which bucket.

Publishers:siliconangle.com

Reality

Evidence40
Adoption12
Hype gap+30
Incentives72
Confidence48
buildOne report1 publisher

Uber's AI cost per session fell 18 points further than its cost per request

The gap implies each session now uses roughly a quarter fewer requests, so the compaction threshold and the prompt cache in Uber's own harness are carrying part of a saving usually credited to cheaper open models.

Reality

Evidence45
Adoption62
Hype gap+26
Incentives58
Confidence48
buildOne report1 publisher

Experiential Labs bets its open-source router's traces will train cheaper replacements for rented models

The router picks a cheaper model for work that resembles work it has already seen, and falls back to the strongest one when nothing matches. The same traces that enable that call are the proposed training set.

Publishers:runtimewire.com

Reality

Evidence34
Adoption17
Hype gap+41
Incentives74
Confidence52
buildOne report1 publisher

Replit makes its router decide which model writes your code

Auto now picks the model for each task in every Replit account, and getting a specific model back means a Core or Pro plan plus a mode that can charge usage credits. Stripe's reported $8 billion for OpenRouter prices the same layer.

Publishers:thenewstack.io

Reality

Evidence34
Adoption46
Hype gap+31
Incentives78
Confidence52
buildOne report1 publisher

Bedrock routing without the router Lambda: one state machine, two model calls per question

A dev.to hands-on replaces the classifier Lambda with a Step Functions Choice state. The trade is a second Bedrock invocation on every question, including the cheap ones.

Publishers:dev.to

Reality

Evidence58
Adoption
Not scored
Hype gap+28
Incentives62
Confidence52
buildOne report1 publisher

Bedrock model IDs behind AppConfig flags: the swap gets cheaper, the approval gets thinner

A dev.to walkthrough moves Claude, Nova and Llama IDs out of Lambda code and into AWS AppConfig feature flags. Rollback stops being a deploy, and model choice stops being a code review.

Publishers:dev.to

Reality

Evidence42
Adoption
Not scored
Hype gap+24
Incentives34
Confidence45
buildOne report1 publisher

Invoked in three runs, executed in none: the cost rule that never got asked

A single deep-research request burned 194% of a rolling quota, most of it inside six minutes. The tiering rule that should have caught it never reached a decision point.

Publishers:dev.to

Reality

Evidence32
Adoption10
Hype gap+12
Incentives55
Confidence35
buildOne report1 publisher

Stripe paid $7B for a router. Glean is selling the choice not to call a model at all

Glean says its customers mostly turn on automatic model selection to control spend, not to improve answers. The routing layer, not the model, is where enterprise AI budgets now get decided.

Publishers:latent.space

Reality

Evidence32
Adoption64
Hype gap+34
Incentives82
Confidence44
buildOne report1 publisher

Alvys is selling freight brokers an agent builder, not a bundle of agents

Foundry, announced August 17th, lets brokers describe a workflow in plain English and deploy it to one lane. The buy decision moves from which agents ship to who owns the process logic.

Publishers:runtimewire.com

Reality

Evidence34
Adoption26
Hype gap+18
Incentives71
Confidence41