Skip to content

Build Independently confirmed2 publishers 3 min read Published Updated

Inception's 1,107 tokens per second needs a batch size before it enters your capacity plan

Mercury 2.5's diffusion decoder refines many token positions at once, which is why its headline throughput moves with batch size, output length and the reasoning setting Inception ships as an adjustable knob.

The Engineer · Build desk

Send a correction

What happened

  • Inception launched Mercury 2.5 on September 8th, saying its diffusion language model generates 1,107 tokens per second on widely available Nvidia GPUs.
  • The API ships a 260,000-token context window, adjustable reasoning, parallel tool calls and schema-aligned JSON output.
  • Inception also reports a 40% intelligence gain over Mercury 2 without attaching the figure to a clearly named independent benchmark in the launch prose.

Why it matters

  • What it limits constraint Without a batch size and an output length, 1,107 tokens per second cannot go into a capacity plan, because it sets no floor for what your own traffic will see.
  • Who has to decide decision Anyone costing an agent loop at $0.15 per million output tokens is choosing to budget against a rate that steps up five-fold whenever the discount lapses.
  • What doesn't add up contradiction Inception's own co-founder has published on the quality-speed trade-off, yet this release quantifies the speed side to four digits and leaves the quality gain without a named benchmark.
  • What's now possible capability If parallel denoising holds up under production traffic, loops that call a model dozens of times per answer get a serving option that does not pay for output length one token at a time.

Diffusion decoding does not commit to token one before producing token two. It starts from a rough output and refines many positions at once over repeated denoising steps [9]. Throughput therefore scales with how many positions get refined per step and how many steps run, which is the information a tokens-per-second headline leaves out.

Inception's own material names the variables: batch size, output length, hardware configuration, reasoning-token accounting and network overhead all move a tokens-per-second result, and the release does not disclose enough of them to compare 1,107 cleanly against rival claims [7]. One of those variables is also a product feature. Mercury 2.5 ships adjustable reasoning [2], so the same endpoint can return different tokens-per-second figures depending on where a caller sets that knob and whether reasoning tokens land in the numerator.

For 1,107 to transfer to your queue, several conditions have to hold together: your batch size matches the measured one, your output lengths match, your GPU is the same widely available Nvidia part [1], your reasoning setting matches, and you measure server-side with network time excluded. Miss on batch size alone and the number describes someone else's demo.

The price is checkable now. List is $0.20 per million input tokens and $0.75 per million output [3], and the 80 percent launch discount puts those at $0.04 and $0.15 [4]. The discount preserves the shape: output costs 3.75 times input at both list and discounted rates [14]. Filling the 260,000-token context once [2] costs $0.052 at list and about $0.010 discounted [16]. Sustained generation at the claimed rate for an hour is roughly 4 million output tokens, which bills about $0.60 discounted and about $2.99 at list [17].

That gap is the budgeting problem. List is five times the discounted rate on both meters [15], and Inception has not said when the discount ends [8]. A loop costed at $0.15 per million output tokens is a loop costed against an unannounced expiry.

The quality side is thinner than the speed side. Inception reports a 40 percent increase in "intelligence" over Mercury 2, and the launch prose does not attach that figure to a clearly named independent benchmark [6]. Kuleshov's published guide to diffusion language models covers the quality-speed trade-off directly [12], which is the trade a serving architecture of this kind has to negotiate. Both halves are load-bearing for the pitch. Only one half arrives with a number, and that number arrives without its denominator.

None of this makes the engineering weak. Commercializing a decoding architecture is harder work than wrapping another provider's model in application software [13], and Ermon left the purely academic route because proving the architecture at commercial scale needed more compute, engineering and capital than a university group could supply [11]. The $50 million seed led by Menlo Ventures in November 2025, with Nvidia's NVentures among the participants [10], buys the GPU access that proof requires.

What decides adoption for a router that calls a model dozens of times before returning one answer [5] is tokens per second at your batch size and your reasoning setting. That figure is not derivable from what Inception has disclosed, so the only number in this launch a buyer can verify independently is the discounted price, whose end date is unannounced [8].

What to watch

  • An announced end date for the 80% launch discount, or a change to the $0.20 and $0.75 list rates.
  • Disclosure of the batch size, output length and GPU model behind 1,107 tokens per second, or an independent measurement of it.
  • A named benchmark behind the claimed 40% intelligence gain over Mercury 2.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence45
Adoption35
Hype gap+40
Incentives65
Confidence55
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    Stefano Ermon, Aditya Grover and Volodymyr Kuleshov launched Mercury 2.5 on September 8th, a diffusion language model in a production-oriented API that Inception says can generate 1,107 tokens per second on widely available Nvidia GPUs.

    Reported SupportedView cited source
  2. [2]

    Mercury 2.5 has a 260,000-token context window, adjustable reasoning, parallel tool calls and schema-aligned JSON output.

    Reported SupportedView cited source
  3. [3]

    List pricing for Mercury 2.5 is $0.20 per million input tokens and $0.75 per million output tokens.

    Reported SupportedView cited source
  4. [4]

    An 80% launch discount lowers Mercury 2.5's rates to $0.04 per million input tokens and $0.15 per million output tokens.

    Reported SupportedView cited source
  5. [5]

    Inception says the diffusion design can lower latency and serving costs when an application makes repeated model calls, and aims Mercury 2.5 at coding subagents, search pipelines, voice systems and routers that may invoke a model dozens of times before returning one answer.

    Reported SupportedView cited source
  6. [6]

    Inception reports a 40% increase in "intelligence" from Mercury 2, and the launch material does not attach that 40% figure to a clearly named independent benchmark in its prose.

    Reported SupportedView cited source
  7. [7]

    The throughput result lacks enough disclosed detail to compare it cleanly with rival claims; batch size, output length, hardware configuration, reasoning-token accounting and network overhead can all change a tokens-per-second result.

    Reported SupportedView cited source
  8. [8]

    Inception has not specified when the 80% launch discount ends.

    Reported SupportedView cited source
  9. [9]

    Diffusion models begin with a rough output and refine many positions in parallel, trading the rigid left-to-right sequence for repeated denoising steps rather than committing to one token before producing the next.

    Reported SupportedView cited source
  10. [10]

    In November 2025 Inception raised a $50 million seed round led by Menlo Ventures, according to TechCrunch, with Mayfield, Innovation Endeavors, Microsoft's M12, Snowflake Ventures, Databricks Ventures and Nvidia's NVentures participating and Andrew Ng and Andrej Karpathy investing as angels; no valuation was reported.

    Reported SupportedView cited source
  11. [11]

    Ermon, Inception's CEO and a Stanford computer science professor, founded Inception in summer 2024 after deciding that proving the architecture at commercial scale required more compute, engineering and capital than an academic group could supply.

    Reported SupportedView cited source
  12. [12]

    Kuleshov, a Cornell and Cornell Tech professor whose group has published on masked diffusion and block diffusion, laid out the technical lineage in a diffusion LLM guide published by RuntimeWire covering masked denoising, variable-length generation and the quality-speed trade-off.

    Reported SupportedView cited source
  13. [13]

    Mercury is an attempt to commercialize an architectural change, rather than wrap another provider's model in application software.

    Reported SupportedView cited source
  14. [14]

    Output tokens are priced at 3.75 times input tokens at both list and discounted rates.

    Derived Supported
  15. [15]

    List pricing is five times the discounted rate on both the input and the output meter.

    Derived Supported
  16. [16]

    Filling Mercury 2.5's 260,000-token context window once costs $0.052 in input billing at list price and about $0.010 at the discounted rate.

    Derived Supported
  17. [17]

    An hour of sustained generation at the claimed 1,107 tokens per second is about 3.99 million output tokens, billing about $0.60 at the discounted output rate and about $2.99 at list.

    Derived Supported

Sources

2 independent publishers whose own reporting we read for this story.

  1. runtimewire.com

    1 article · September 8, 2026

    Inception ships Mercury 2.5 at 1,107 tokens per second, by its count
  2. testingcatalog.com

    1 article · September 9, 2026

    Inception launches Mercury 2.5 at 1,107 tokens per second

Topics and entities

Topics

Entities