Everything You Want to Know about Google-Extended
Google-Extended is a standalone robots.txt token that lets site owners control whether content Google crawls may be used to train future Gemini models or for grounding in Gemini Apps and Vertex AI, without affecting Google Search inclusion.
Last verified August 15, 2026 against Google's published crawler docs
Why it's crawling your site
Google-Extended has no separate HTTP crawl of its own; it's a control token applied to crawls made under existing Google user agents, used to opt content in or out of Gemini training and grounding.
How Google-Extended views your website
Google-Extended fetches raw page HTML (n/a - token-only, no dedicated fetcher) — it does not execute JavaScript. Content that only appears after client-side rendering is invisible to it.
Paste a URL for the rendered-vs-crawled diff, blocked resources, and the sections that never reach the bot.
How to block Google-Extended
Add the rule below to your site's robots.txt. Most crawlers, including Google-Extended, check for changes within 24 hours.
User-agent: Google-Extended
Disallow: /Need the full walkthrough?
Partial blocks, per-directory rules, Cloudflare and server-level options, verification.