Skip to main content
株式会社オブライト
Services
About
Company
Column
Glossary
Contact
日本語
日本語
メニューを開く
Column
Reasoning
Articles tagged "Reasoning"
1 article
AI
2026-07-08
Gemma 4 Technical Report Deep Dive — Google DeepMind's Open-Weight, Natively Multimodal 2.3B–31B LLMs with an Encoder-Free 12B Unified Design and Built-In Reasoning Mode [arXiv:2607.02770](https://arxiv.org/abs/2607.02770), Published 2026-07-02, 300+ Authors, Both Dense and MoE Variants
**Google DeepMind's Gemma Team released the Gemma 4 Technical Report as [arXiv:2607.02770](https://arxiv.org/abs/2607.02770) on 2026-07-02**. The paper introduces **2.3B / 12B / 31B parameter models**, **both Dense and MoE variants**, **natively multimodal (text / image / audio)**, a **12B encoder-free unified design** (raw audio and image patches processed directly without separate encoders), a **built-in reasoning (thinking) mode**, **improved vision / audio encoders**, **architectural refinements for inference speed, memory efficiency, and long context**, and **competitive performance against larger open models on STEM, multimodal, and long-context benchmarks**. Over 300 authors contributed. Open weights allow commercial use, distributed via Hugging Face and Ollama. Sits alongside [Qwen 3.6-35B-A3B](../columns/qwen36-35b-a3b-uncensored-abliterated-2026-07) and the [Local LLM June 2026 update](../columns/local-llm-landscape-2026-june-update) as a new chapter at the open-weights frontier. **A milestone in Google's open-weights strategy**; the encoder-free unified design departs from Qwen / Llama / DeepSeek multimodality (separate vision encoder + projection). The **reasoning mode** mirrors the extended-thinking modes of Anthropic and OpenAI closed models — the open ecosystem catching up. Caveats: commercial-license fine print, potential systemic-risk classification (EU AI Act's 10^25 FLOPs threshold), and heavy Google Cloud Vertex AI integration bias.
Gemma 4
Google DeepMind
Open Weight