# Bingbot vs Google-Extended

Bingbot and Google-Extended compared on 13 documented fields, from 19 claims, last verified 2026-09-14.

| Field | Bingbot | Google-Extended | Comparison |
| --- | --- | --- | --- |
| cites_sources | yes | not documented | different |
| follows_noarchive | yes | not documented | different |
| honours_crawl_delay | yes | n/a | different |
| opt_out_mechanism | yes | not documented | different |
| publishes_ip_list | yes | no | different |
| purpose_documented | yes | policy_only | different |
| reads_llms_txt | not_documented | not documented | different |
| respects_robots_txt | yes | n/a | different |
| robots_token_differs_from_ua | not documented | yes | different |
| separate_search_and_training_tokens | no | yes | different |
| user_agent_string_full | Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) | not documented | different |
| verifiable_by_rdns | yes | n/a | different |
| what_it_controls | not documented | Gemini model training and grounding, not Search inclusion | different |

## Differences

| Field | Bingbot statement | Google-Extended statement |
| --- | --- | --- |
| cites_sources | Copilot Search in Bing delivers clearly cited sources alongside generative answers to support publishers and content owners. | not documented |
| follows_noarchive | Bingbot excludes noarchive-tagged content from Copilot and Chat answers and from generative AI training data. | not documented |
| honours_crawl_delay | Microsoft states that a crawl-delay directive in robots.txt always takes precedence over Bing Webmaster Tools crawl control settings for Bingbot. | Google does not publish any Crawl-delay behaviour for the Google-Extended token. |
| opt_out_mechanism | Microsoft lets publishers block Bingbot content from Copilot answers and AI training using noarchive and nocache tags. | not documented |
| publishes_ip_list | Microsoft publishes Bingbot's IP address ranges as a JSON file at bing.com/toolbox/bingbot.json for verification purposes. | Google publishes no IP list for Google-Extended because Google-Extended has no separate HTTP request user agent string. |
| purpose_documented | Bingbot serves as Microsoft's standard crawler and handles most of Bing's daily web crawling. | Google-Extended is a standalone product token that controls whether Google uses crawled content to train Gemini models. |
| reads_llms_txt | Microsoft does not publish whether Bingbot reads llms.txt files. | not documented |
| respects_robots_txt | Bingbot honors robots.txt directives and other Microsoft-supported control mechanisms that content owners set for crawling. | Google-Extended is a robots.txt token that publishers set to control use of crawled content for Gemini training. |
| robots_token_differs_from_ua | not documented | Google-Extended is a robots.txt control token and does not correspond to a crawler user agent string. |
| separate_search_and_training_tokens | Microsoft controls Bingbot's use in AI training through meta tags rather than publishing a separate training-specific crawler token. | Google-Extended controls Gemini training use only and does not affect inclusion in Google Search. |
| user_agent_string_full | Bingbot sends a user agent string containing bingbot/2.0 and a link to Microsoft's bingbot.htm page. | not documented |
| verifiable_by_rdns | Microsoft verifies Bingbot traffic through reverse DNS lookups that resolve to hostnames ending in search.msn.com. | Google does not publish a reverse-DNS verification method for Google-Extended. |
| what_it_controls | not documented | Google-Extended controls AI training and grounding in Google systems and does not control Google Search inclusion. |

## Sources

- https://blogs.bing.com/search/April-2025/Introducing-Copilot-Search-in-Bing
- https://developers.google.com/search/docs/appearance/ai-features
- https://developers.google.com/search/docs/crawling-indexing/google-common-crawlers
- https://www.bing.com/toolbox/bingbot.json
- https://www.bing.com/webmasters/help/ai-performance-9f8e7d6c
- https://www.bing.com/webmasters/help/crawl-control-55a30303
- https://www.bing.com/webmasters/help/how-to-verify-bingbot-3905dc26
- https://www.bing.com/webmasters/help/robots-meta-tags-and-attributes-that-bing-supports-5198d240
- https://www.bing.com/webmasters/help/which-crawlers-does-bing-use-8c184ec0
