Index My Site

Google-Extended: what blocking it does and does not do

Google-Extended is a robots.txt token that controls whether Google can use your content to train Gemini models and to ground answers in Gemini apps. It has no effect on Google Search, including AI Overviews and AI Mode.

What Google-Extended does

Google calls Google-Extended a standalone product token. It manages whether content Google crawls may be used to train future Gemini models and to ground answers in Gemini apps and Vertex AI.

Google says Google-Extended does not affect a site’s inclusion in Google Search and is not a ranking signal. AI Overviews and AI Mode are part of Search, so they follow your Googlebot rules and snippet controls instead.

Google-Extended has no crawler of its own. Google crawls with its usual user agents and reads the token to decide how the content may be used.

OperatorGoogle
robots.txt tokenGoogle-Extended
User agentNone. Google says Google-Extended has no separate user-agent string and crawling uses Google’s existing crawlers.
Used forGemini training and grounding
If you block itGemini apps do not train on or ground answers with the page. Google Search, including AI Overviews, is unaffected.
Check a visit is realThere is no Google-Extended visit to verify. Visits come from Google’s common crawlers, which you verify with a reverse DNS lookup to googlebot.com followed by a forward lookup, or against Google’s published IP ranges.

Source: Google: common crawlers

Check whether your robots.txt allows Google-Extended

We read the site's robots.txt file and nothing else. Crawl rules say who may visit. They do not show whether a page is indexed or cited.

Results

View robots.txt

How to block or allow Google-Extended in robots.txt

Add a Google-Extended group to opt out of Gemini training and grounding. Google caches robots.txt for up to 24 hours, so changes can take a day to apply.

To block Google-Extended from the whole site:

User-agent: Google-Extended
Disallow: /

To allow it everywhere, even when another group blocks all crawlers:

User-agent: Google-Extended
Allow: /

A crawler named in a group follows only that group, so repeat any shared Disallow lines in its group. See how robots.txt blocks work for the details.

The Google crawler that decides Search

CrawlerUsed forIf you block it
GooglebotGoogle Search, AI Overviews and AI ModeGoogle cannot crawl the page for Search, including AI Overviews and AI Mode.

Blocking Google-Extended keeps you in search

Blocking Google-Extended keeps your content out of Gemini training and grounding, and Google Search keeps crawling and indexing your pages through Googlebot. To limit what AI Overviews and AI Mode show from a page, Google points to nosnippet, data-nosnippet, max-snippet and noindex.

Frequently asked questions

No. Google says Google-Extended does not affect inclusion in Google Search. AI Overviews and AI Mode follow your Googlebot rules, and you limit what they show with nosnippet, max-snippet or noindex.

Source: Google: AI features and your website

No. Google says it is not used as a ranking signal in Google Search.

Google says sites that allow Google-Extended are eligible to appear in responses and receive clicks through grounding in Gemini apps. Blocking it opts you out of that grounding.

No. It is a robots.txt token with no user agent of its own. Google’s usual crawlers fetch the pages.