Articles tagged "Fast Inference"

**On 2026-06-29 Cerebras launched [Gemma 4 31B on Cerebras Inference](https://www.cerebras.ai/blog/gemma-4-on-cerebras-the-fastest-inference-is-now-multimodal)** — the platform's **first multimodal model** and the **first Google DeepMind model** available on it, in public preview. **Performance**: **1,851 output tokens/second** (**35× a typical GPU endpoint**), **≤1.5 s to first token including reasoning**, **[Artificial Analysis Intelligence Index of 29](https://artificialanalysis.ai/)** (comparable to Claude Haiku 4.5's 30), and **18× the speed of Haiku on Cerebras**. **Model specs**: **[Gemma 4 31B](../columns/gemma-4-technical-report-2026-07) dense architecture** (not MoE), **Apache 2.0 open weights**, long-context capable, and image understanding (screenshots, charts, documents, UI states, diagrams, scanned pages, forms). **Distinctive value**: unlocks multimodal workloads that used to be impractical on GPUs — **computer use, image-driven agentic loops, UI debugging with code-patch generation, real-time dashboard analysis, long-document summarization** — at wafer-scale speed. **Position**: the [Gemma 4 Technical Report](../columns/gemma-4-technical-report-2026-07) covered Google DeepMind's open-weights strategy; combined with **Cerebras's wafer-scale hardware, it reaches a new "multimodal × fast inference × open weights" infrastructure stack** — the open-weights + fast-inference camp's counter to the closed-model camp underlying [OpenAI GPT-5.6 + ChatGPT Work](../columns/openai-chatgpt-work-launch-2026-07) and [Claude Cowork](../columns/claude-cowork-web-mobile-launch-2026-07). Paired with [Nous Portal's 300+ neutral models](../columns/nous-portal-cloud-hermes-agent-2026-07) or [local LLM deployments](../columns/local-llm-landscape-2026-june-update), it becomes part of the **late-2026 open-weights-practical AI infrastructure stack**. **Cerebras Inference Cloud public preview** (limited time), with details in the [API docs](https://inference-docs.cerebras.ai/models/gemma-4-31b).