Learn  /  What's new

Mercury 3 explained: the diffusion language model that writes 1,000 tokens a second

Most AI models write one word at a time. Mercury 3 drafts the whole answer and sharpens it in a few passes, which makes it four to eight times faster than its rivals. How it works, how good it is, and when that speed is worth having.

What's new7 min readUpdated 21 October 2026
AIAI agentsWhat's new
All guides and cheat sheets

On 19 October 2026, the start-up Inception released Mercury 3, the newest and largest model in its Mercury family. It is a diffusion language model: instead of writing an answer one token at a time, like ChatGPT, Claude or Gemini, it produces a rough draft of the whole answer and refines every part of it at once. The result is speed. Inception reports 1,068 tokens per second, against roughly 130 for GPT-6 Luna and 240 for Claude Haiku 5.5 in its own comparison, and it now matches those small models on quality in most of the tests it published.

1,068Tokens per secondInception-reported, on Nvidia GPUs
1MContext windowup from 260K on Mercury 2.5
$0.70Per million output tokenslist price, 50% off at launch
40xLarger than Mercury 1per Inception; size not disclosed

How a diffusion language model works

Every popular chatbot today is autoregressive: it predicts the next token, appends it, and repeats. Each token has to wait for the one before it, so a 1,000-token answer needs 1,000 steps in a row, however powerful the hardware. Diffusion models borrow the idea behind image generators such as Stable Diffusion: start from noise, then remove it over a few passes until a clean result appears.

Autoregressive model

GPT, Claude, Gemini
Writes
one token at a time, left to right
Steps for 1,000 tokens
about 1,000 in sequence
  • Mature, well understood, best quality today
  • Speed limited by sequential steps

Diffusion model

Mercury 3
Writes
a full rough draft, then refines it
Steps for 1,000 tokens
a handful of parallel passes
  • Much faster on the same hardware
  • Newer approach, weaker on very long tasks so far
How Mercury 3 builds an answer
Promptyour question and context
Rough draftevery position guessed at once
Refinea few parallel passes fix the weak parts
Answerready at over 1,000 tokens a second

Speed: the headline number

Output speed, tokens per second
Mercury 31,068
Claude Haiku 5.5~240
GPT-6 Luna~130

Inception-reported, on Inception-served Nvidia GPUs. Competitor speeds from Inception's own comparison; real speeds vary by provider and load.

In practice, that turns a 500-token answer from a two- to four-second wait into half a second. For a person reading a chat window the difference is nice; for a voice assistant, a smart-glasses display or an agent that chains twenty model calls together, it changes what is possible.

Quality: close to the small frontier models

Inception compared Mercury 3 with the two most popular small models, at medium settings. It leads on 8 of 12 tests. The figures below are Inception's own; no independent leaderboard had published a score at the time of writing.

Instruction following (IFBench)
Mercury 376.8
GPT-6 Luna61.8
Claude Haiku 5.554.7

Higher is better. Inception-reported, medium settings.

Coding (SWE-Bench Atlas)
Mercury 351.1
GPT-6 Luna33.3
Claude Haiku 5.532.3

Higher is better. Inception-reported.

Long-context retrieval (MRCR v2)
Claude Haiku 5.578.4
Mercury 375.5
GPT-6 Luna62.7

Higher is better. Inception-reported. One of the tests where Mercury 3 trails.

The pattern is consistent: Mercury 3 is strong at following instructions, science questions (89.2 on GPQA Diamond) and short coding tasks, and weaker at finding details in very long inputs and at longer, multi-step coding (Haiku 5.5 leads on DeepSWE, 51.6 to 46.3). For the full picture of where the small models sit, see the best AI models in October 2026 and Claude Haiku 5.5 explained.

Price and availability

Mercury 3 prices per million tokens

Input
$0.20 ($0.10 during the launch offer)
Output
$0.70 ($0.35 during the launch offer)
Cached input
90% off
Free allowance
100 million tokens for new accounts
Claude Haiku 5.5, for comparison
$0.10 input, $0.50 output (prompts up to 100K)
GPT-6 Luna, for comparison
$0.10 input, $0.50 output (short context)

Mercury 3 is available on Inception's API, OpenRouter, Baseten and Vercel AI Gateway. The API follows OpenAI's format, so most code only needs a new base URL and the model name mercury-3. There are no downloadable weights, so you cannot run it on your own servers. Mercury 2 and 2.5 are closed to new users, and existing customers keep access until 15 November 2026.

Python
from openai import OpenAI

client = OpenAI(base_url="https://api.inceptionlabs.ai/v1", api_key="...")
reply = client.chat.completions.create(
    model="mercury-3",
    reasoning_effort="low",   # trade quality for even more speed
    messages=[{"role": "user", "content": "Summarise this ticket in one line: ..."}],
)
print(reply.choices[0].message.content)

Where speed actually matters

Voice assistants
A spoken reply that starts in under a second feels natural. Inception also sells Mercury Voice for this.
Search and smart glasses
Early user Octen AI reports 0.9 seconds median generation for answers shown on glasses.
Agent steps
An agent that makes 20 calls saves minutes per task when each call is four times faster.
Tutoring and support
RevisionDojo and Lorikeet use it for instant hints and support replies.
Classification at scale
Mercury Decide, a sibling model, handles high-volume labelling.

For analysis that needs deep reasoning over long documents, a larger autoregressive model is still the safer choice. Mercury 3 is best seen as a very fast worker inside a bigger system, not as the brain of it.

Check your understanding

1/3How does a diffusion language model write an answer?

2/3Where does Mercury 3 trail Claude Haiku 5.5, according to Inception's own tests?

3/3Can you download Mercury 3 and run it yourself?

More on this month's models: the best AI models in October 2026, Claude Haiku 5.5 and Nvidia Nemotron 3.5 and Reflection Beam.

Sources: Inception's Mercury 3 announcement (19 October 2026), as reported by MarkTechPost and Unite.AI; OpenRouter's launch listing. All benchmark and speed figures are Inception's own and have not yet been independently reproduced.

Alessandro Ecclesie AgazziWritten by Alessandro Ecclesie Agazzi, analytics engineer in London. Updated 21 October 2026. About me

Found this useful?

New guides and "what's new" explainers on data and AI land here regularly. Follow along on LinkedIn, or share this one with a colleague.