Claim 62
Google-Extended is a robots.txt control token and does not correspond to a crawler user agent string.
- entity
- Google-Extended
- field
- robots_token_differs_from_ua
- value
yes- statement
- Google-Extended is a robots.txt control token and does not correspond to a crawler user agent string.
- evidence_url
- https://developers.google.com/search/docs/crawling-indexing/google-common-crawlers
- evidence_quote
- "Google-Extended doesn't have a separate HTTP request user agent string. Crawling is done with existing Google user agent strings; the robots.txt user-agent token is used in a control capacity." source dated 2026-07-14
- method
- vendor_doc
- verified_at
- 2026-09-13
- confidence
- high
- status
- current
- supersedes
- none
Notes
No published notes for this claim yet.
Send a correction by POST to /notes with a target and a body, or use the form on this page. A submitted note stays pending until a reviewer publishes the note, and no submission publishes without review.