Skip to main content
株式会社オブライト
AI2026-08-167 min read

OpenAI Ultrafast Mode: GPT-5.6 Sol at 750 tok/s (2026)

August 2026: OpenAI's Ultrafast preview runs GPT-5.6 Sol on Cerebras at up to 750 output tokens/sec, 14x standard. Pricing undisclosed, access limited.


OpenAI's Ultrafast mode is a new API service tier previewed on August 13, 2026, available only for the GPT-5.6 Sol model. It runs inference on Cerebras's Wafer-Scale Engine (WSE) and is officially rated at up to 750 output tokens per second, up to 14x faster than the standard tier. The announcement hit the top of Hacker News on August 14, but access remains a limited preview for select customers, and pricing for the mode has not been disclosed as of this writing.

What Ultrafast Actually Changes

A speed jump of several times to over an order of magnitude matters most for workloads that generate tokens repeatedly and at volume, rather than for a single chat reply. That includes multi-step agent execution where a model calls tools and verifies results across dozens of turns, large-scale batch evaluation or data generation across hundreds or thousands of prompts, and the perceived latency of interactive UIs. In agentic workloads especially, per-request output wait time accumulates directly into total task duration, so faster generation tends to translate almost linearly into shorter end-to-end runs. For GPT-5.6's broader pricing context, see our coverage of the GPT-5.6 API price cut.

Speed Specs at a Glance

Mode / ModelOutput speed (reported)vs. standardNotes
GPT-5.6 Sol (standard)baseline1xRegular API tier
GPT-5.6 Sol (Ultrafast, on Cerebras)up to 750 tok/sup to 14xLimited preview, pricing undisclosed
vs. Fable 5 (OpenAI's stated figure)11xClaimed as faster by OpenAI
vs. Opus 4.8 Fast mode (OpenAI's stated figure)5xClaimed as faster by OpenAI

Every multiplier in this table comes from OpenAI's or Cerebras's own published figures; independent third-party verification has not yet surfaced. Numbers attributed to other vendors reflect those vendors' own measurement conditions, so treat cross-vendor comparisons as directional rather than apples-to-apples.

Why It's Fast: Inside Cerebras's WSE

In typical GPU inference, generating each token requires reading model weights out of HBM (high-bandwidth memory) into the compute cores, and that memory bandwidth effectively caps generation speed. Cerebras's Wafer-Scale Engine takes a different structural approach: it treats an entire silicon wafer as a single chip, carrying 44GB of SRAM per chip. Keeping model weights resident in this on-chip SRAM eliminates the off-chip memory round trip that normally happens on every generated token, sidestepping the memory-bandwidth bottleneck altogether — this is the mechanism OpenAI and Cerebras describe as the source of the speedup. For another example of Cerebras-hosted inference, see our piece on running Gemma 4 on Cerebras Inference.

Reading the Benchmark Claims

OpenAI and Cerebras report completing the 2,500-question Humanity's Last Exam in 11 hours on Ultrafast, versus a stated 78 hours for Claude Fable 5 on the same benchmark — roughly a 7x difference. On GDP-Val, they claim an end-to-end 5.6x speedup with no quality degradation. All of these figures, however, are vendor-run and vendor-published benchmarks, and it is not clear from public information how much detail on evaluation conditions — prompts, sampling settings, scoring methodology — has been disclosed to third parties. The claim that speed gains come without accuracy loss is an important one, but it is reasonable to treat these numbers as preliminary until independent labs or the community can reproduce them.

How to Access It

Ultrafast is positioned as one of the service tiers available when calling GPT-5.6 Sol through the API. As of this writing it is a limited, application-based preview, with OpenAI planning to expand access to more customers over time. Exactly what changes in existing API code — specific endpoints or request parameters — to switch tiers is not confirmed in public information, and we avoid speculating on undocumented API details here. Anyone evaluating Ultrafast should check the primary sources directly: OpenAI's own announcement (Previewing Ultrafast) and Cerebras's official blog post.

Pricing, As It Stands Today

The standard tier for GPT-5.6 Sol is priced at $5 per million input tokens and $30 per million output tokens. Pricing for Ultrafast itself has not been published as of this writing, and it's unclear how large a premium it will carry over the standard tier. Service tiers backed by dedicated hardware for guaranteed speed generally command a premium industry-wide, but that is a general pattern, not a guarantee of what Ultrafast will eventually cost. For background on GPT-5.6's pricing history, see our comparison of GPT-5.6 and Grok 4.5 API pricing.

How It Compares to Other Fast Inference Options

Provider / modeApproachNotes
OpenAI Ultrafast (GPT-5.6 Sol)Cerebras WSE, on-chip SRAM residencyUp to 750 tok/s, limited preview, pricing undisclosed
Cerebras Inference (Cerebras's own service)Cerebras WSEHosts models beyond OpenAI's; Cerebras sells the API directly
GroqDedicated LPU (Language Processing Unit) chipsKnown for fast inference on open-weight models
Standard GPU inference (typical cloud APIs)Sequential reads over HBMBroadly general-purpose, but memory bandwidth tends to cap speed
Claude Fast mode (Anthropic)Accelerated GPU inference pathAvailable on models like Opus 4.8; OpenAI has published a direct comparison figure against it
Claude Fable 5 (Anthropic)Standard GPU inferenceCited by OpenAI as roughly 11x slower than Ultrafast

Cerebras and Groq both use dedicated hardware to sidestep the memory-bandwidth bottleneck, but their implementations differ. If you're exploring faster inference for local deployments rather than hosted APIs, our local LLM inference engine comparison covers that separate landscape.

Who Should Adopt Now, and Who Should Wait

Ultrafast looks best suited today to larger customers who both have generation speed as a genuine bottleneck — in high-volume batch pipelines or multi-step agent workflows — and can secure access to the limited preview. Given that pricing remains undisclosed, that the quality claims haven't yet been independently verified, and that a general-availability timeline hasn't been announced, most small and midsize development teams would be reasonable to wait for a published price, wider availability, and independent benchmark reproductions before adopting it. A practical stance in the meantime is to keep using the standard GPT-5.6 tier for its cost-speed balance while tracking how Ultrafast develops.

Can anyone use Ultrafast mode right now?

No. As of August 2026 it is a limited, application-based preview, with OpenAI expanding access to more customers over time. A general-availability date has not been announced in public information.

How much does Ultrafast cost?

Pricing is undisclosed as of this writing. The standard GPT-5.6 Sol tier costs $5 per million input tokens and $30 per million output tokens, but the premium for Ultrafast has not been published.

Why is Cerebras hardware so much faster?

OpenAI and Cerebras attribute the speedup to keeping model weights resident in 44GB of on-chip SRAM per chip, eliminating the off-chip memory round trip that normally occurs on every generated token in GPU inference. This sidesteps the memory-bandwidth bottleneck rather than just optimizing around it.

How trustworthy are figures like 750 tok/s or the 11-hour HLE run?

They are self-reported by OpenAI and Cerebras, and independent third-party reproductions have not yet surfaced. Treat them as preliminary vendor claims pending outside verification.

Does Ultrafast support models other than GPT-5.6 Sol?

Public information currently limits it to GPT-5.6 Sol only. Plans to expand to other models have not been disclosed officially.

How does this differ from Groq or Cerebras Inference?

Groq uses dedicated LPU (Language Processing Unit) chips, and Cerebras Inference is Cerebras's own directly sold API service. Both, like Ultrafast, use dedicated hardware to avoid the memory-bandwidth bottleneck, but they differ in vendor, supported models, and how the service is offered.

Feel free to contact us

Contact Us