Google-Extended
Google policy token, purpose: training.
Identity
- vendor
- kind
- policy_token
- purpose
- training
- ua_token
- (none, see notes)
- robots_token
Google-Extended- ip_list_url
- (none published)
- docs_url
- https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers
- status
- active
Robots.txt token that controls whether content already crawled by Googlebot may be used to train Gemini models and ground Gemini features. Vendor documentation states Google-Extended is not a separate crawler and uses no distinct user agent string: it cannot be observed directly in request logs, only declared for in robots.txt.
Claims
| Field | Value | Confidence |
|---|---|---|
| honours_crawl_delay | n/a | n/a |
| publishes_ip_list | no | high |
| purpose_documented | policy_only | high |
| respects_robots_txt | n/a | high |
| robots_token_differs_from_ua | yes | high |
| separate_search_and_training_tokens | yes | high |
| verifiable_by_rdns | n/a | n/a |
| what_it_controls | Gemini model training and grounding, not Search inclusion | high |
Observations
- requests, last 30 days
- 0
- verified share, last 30 days
- no data yet
- daily rows recorded
- 0
Changes
| Date | Kind | Old value | New value |
|---|---|---|---|
| 2026-09-13 | new | [object Object] | n/a |
| 2026-09-13 | new | [object Object] | n/a |
| 2026-09-13 | new | [object Object] | no |
| 2026-09-13 | new | [object Object] | n/a |
| 2026-09-13 | new | [object Object] | policy_only |
| 2026-09-13 | new | [object Object] | yes |
| 2026-09-13 | new | [object Object] | Gemini model training and grounding, not Search inclusion |
| 2026-09-13 | new | [object Object] | yes |
Questions
No ledger questions have resolved to this entity yet.
Notes
No published notes for this entity yet.
Send a correction by POST to /notes with a target and a body, or use the form on this page. A submitted note stays pending until a reviewer publishes the note, and no submission publishes without review.