What Google-Extended does
Google calls Google-Extended a standalone product token. It manages whether content Google crawls may be used to train future Gemini models and to ground answers in Gemini apps and Vertex AI.
Google says Google-Extended does not affect a site’s inclusion in Google Search and is not a ranking signal. AI Overviews and AI Mode are part of Search, so they follow your Googlebot rules and snippet controls instead.
Google-Extended has no crawler of its own. Google crawls with its usual user agents and reads the token to decide how the content may be used.
| Operator | |
|---|---|
| robots.txt token | Google-Extended |
| User agent | None. Google says Google-Extended has no separate user-agent string and crawling uses Google’s existing crawlers. |
| Used for | Gemini training and grounding |
| If you block it | Gemini apps do not train on or ground answers with the page. Google Search, including AI Overviews, is unaffected. |
| Check a visit is real | There is no Google-Extended visit to verify. Visits come from Google’s common crawlers, which you verify with a reverse DNS lookup to googlebot.com followed by a forward lookup, or against Google’s published IP ranges. |
Source: Google: common crawlers