AI crawlers
Google-Extended
Google-Extended is a robots.txt token that controls whether content Google crawls may be used to train Gemini models and to ground answers in Gemini Apps and Vertex AI.
In plain words
It has no user agent of its own. Google crawls with its normal crawlers; the token only works as a control.
Google says Google-Extended does not affect whether your site is included in Google Search, and it is not a ranking signal.
Example
A news site adds the rule below. Its articles keep appearing in Google Search, but Google may not use them to train future Gemini models or for grounding in Gemini Apps.
User-agent: Google-Extended
Disallow: /Why it matters for AI search
Google says robots.txt rules for Googlebot are the control for AI features in Search, such as AI Overviews and AI Mode.
So Google-Extended does not take you out of AI Overviews. For that, Google points to nosnippet, data-nosnippet, max-snippet or noindex.
What you can do
- Use Google-Extended only if you want to keep content out of Gemini training and grounding.
- Use the snippet controls, such as nosnippet and max-snippet, to limit what Search shows, AI Overviews included.
- Don’t block Googlebot unless you want to leave Google Search completely.
Try it: Free robots.txt generator
Often confused with
- Googlebot
- Googlebot crawls for Google Search. Google-Extended is only a permission setting for Gemini.
- nosnippet
- nosnippet limits AI Overviews and AI Mode. Google-Extended does not.
Quick facts
- Run by
- robots.txt name
- Google-Extended
Sources
Facts and sources last checked on 19 October 2026.
Related terms
How does your page do in AI search?
GEO-Score checks one page on 22 signals, from AI crawler access to structured data, and shows what to fix first.
Analyze a page