Google-Extended user agent: what it is and what it controls
Google-Extended is a robots.txt token, not a crawler with its own user agent string. It lets publishers control whether content Google crawls is used to train future Gemini models and for grounding in Gemini Apps and Vertex AI. Google states it does not affect inclusion in Google Search and is not a ranking signal.
| Operator | Google, for Gemini Apps and Vertex AI |
|---|---|
| Purpose | AI training |
| robots.txt token | Google-Extended |
| User agent | No full string documented. Match on the robots.txt token. |
| Follows robots.txt | Yes. Google-Extended is a standalone robots.txt token with no separate HTTP user agent; crawling uses existing Google user agent strings. |
| Runs JavaScript | Not documented |
| IP ranges | Not published |
| Documentation |
What Google-Extended does
Google-Extended is a robots.txt token that lets publishers manage whether content Google crawls may be used to train future Gemini model generations, and for grounding in Gemini Apps and Grounding with Google Search on Vertex AI. It is a control only and has no crawler of its own.
Should you block Google-Extended?
Treat Google-Extended as a Gemini training and grounding choice; it does not control Google Search or AI Overviews inclusion. Google states that Google-Extended does not impact a site's inclusion in Google Search and is not a ranking signal. Disallowing it affects only the use of your content for Gemini training and grounding.
User-agent: Google-Extended
Disallow: /User-agent: Google-Extended
Allow: /Rules that apply
- Rule 05: Don't use Google-Extended to control Search; it only governs Gemini training and grounding
- Rule 02: Treat training bots and search bots as separate robots.txt decisions
- Rule 31: Check that your site is included in the Search generative AI setting in Search Console
Questions
What is the Google-Extended user agent string?
There is none. Google documents Google-Extended as a standalone robots.txt token with no separate HTTP user agent. Crawling uses Google's existing user agent strings.
Does blocking Google-Extended affect Google Search?
No. Google states that Google-Extended does not impact a site's inclusion in Google Search, and that it is not a ranking signal.
What does Google-Extended control?
It manages whether content Google crawls may be used to train future Gemini model generations, and for grounding in Gemini Apps and Grounding with Google Search on Vertex AI.
How do I block Google-Extended?
Add User-agent: Google-Extended and Disallow: / to your robots.txt. Because it is only a control token, it does not change how Googlebot crawls your site.
Sources
- Google's common crawlers · Google
Checked against the operators' documentation every Monday. Last reviewed Nov 2, 2026.