SEO2026-05-17
Google-Extended
Also known as: Google-Extended クローラー / Googleの学習クローラー
Google's dedicated AI training crawler. By specifying 'User-agent: Google-Extended' in robots.txt, site owners can opt out of having their content used to train Gemini and Vertex AI models.
Overview
Google-Extended was introduced in 2023 as a separate crawler for collecting Gemini/Vertex AI training data. It is entirely independent of Googlebot for indexing and search visibility, so blocking it carries no SEO consequences according to Google.
Configuration
Add 'User-agent: Google-Extended' and 'Disallow: /' to robots.txt to block all pages from AI training crawls. For combined examples with other AI crawler controls, see our LLMO technical guide.
Related Columns
SEO
llms.txt and Structured Data — Technical Implementation Guide for LLMO | Complete Checklist for AI Search Optimization
Comprehensive technical implementation guide for LLMO. From llms.txt creation and schema.org structured data to JSON-LD patterns, sitemap optimization, and Next.js implementation examples—a complete guide to technical SEO for the AI era.
SEO
Decoding Google's Official AI Optimization Guide — What Actually Works for AI Overviews / AI Mode, and Which GEO/AEO Tactics Google Just Killed (May 2026)
An evidence-based reading of Google's official Generative AI optimization guide, published May 15, 2026 in Search Central. Covers how AI Overviews and AI Mode actually work, what Google explicitly recommends, and — crucially — what Google explicitly denies: llms.txt, AI-only structured data, content chunking, AI-specific rewrites. Plus Search Console measurement reality (consolidated counts, the April 2026 impression-counting bug), and how GEO/AEO/LLMO map onto plain SEO.
SEO
LLMO Guide for SMBs: Customer Acquisition in the AI Search Era
Gartner predicts a 25% decline in traditional search traffic by 2026. With 47% of consumers using AI for purchase research, how should SMBs respond? This comprehensive guide covers practical LLMO strategies for small and medium businesses, from verifying your ChatGPT presence to low-cost optimization tactics, industry-specific case studies, and monthly operational routines for the AI search era.
Feel free to contact us
Contact Us