Rattlesnakes By Mail

Bingbot vs Google-Extended

Bingbot and Google-Extended compared on 13 documented fields, from 19 claims, last verified 2026-09-14.

Field	Bingbot	Google-Extended	Comparison
cites_sources	yes	not documented	different
follows_noarchive	yes	not documented	different
honours_crawl_delay	yes	n/a	different
opt_out_mechanism	yes	not documented	different
publishes_ip_list	yes	no	different
purpose_documented	yes	policy_only	different
reads_llms_txt	not_documented	not documented	different
respects_robots_txt	yes	n/a	different
robots_token_differs_from_ua	not documented	yes	different
separate_search_and_training_tokens	no	yes	different
user_agent_string_full	Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)	not documented	different
verifiable_by_rdns	yes	n/a	different
what_it_controls	not documented	Gemini model training and grounding, not Search inclusion	different

Differences

Field	Bingbot statement	Google-Extended statement
cites_sources	Copilot Search in Bing delivers clearly cited sources alongside generative answers to support publishers and content owners.	not documented
follows_noarchive	Bingbot excludes noarchive-tagged content from Copilot and Chat answers and from generative AI training data.	not documented
honours_crawl_delay	Microsoft states that a crawl-delay directive in robots.txt always takes precedence over Bing Webmaster Tools crawl control settings for Bingbot.	Google does not publish any Crawl-delay behaviour for the Google-Extended token.
opt_out_mechanism	Microsoft lets publishers block Bingbot content from Copilot answers and AI training using noarchive and nocache tags.	not documented
publishes_ip_list	Microsoft publishes Bingbot's IP address ranges as a JSON file at bing.com/toolbox/bingbot.json for verification purposes.	Google publishes no IP list for Google-Extended because Google-Extended has no separate HTTP request user agent string.
purpose_documented	Bingbot serves as Microsoft's standard crawler and handles most of Bing's daily web crawling.	Google-Extended is a standalone product token that controls whether Google uses crawled content to train Gemini models.
reads_llms_txt	Microsoft does not publish whether Bingbot reads llms.txt files.	not documented
respects_robots_txt	Bingbot honors robots.txt directives and other Microsoft-supported control mechanisms that content owners set for crawling.	Google-Extended is a robots.txt token that publishers set to control use of crawled content for Gemini training.
robots_token_differs_from_ua	not documented	Google-Extended is a robots.txt control token and does not correspond to a crawler user agent string.
separate_search_and_training_tokens	Microsoft controls Bingbot's use in AI training through meta tags rather than publishing a separate training-specific crawler token.	Google-Extended controls Gemini training use only and does not affect inclusion in Google Search.
user_agent_string_full	Bingbot sends a user agent string containing bingbot/2.0 and a link to Microsoft's bingbot.htm page.	not documented
verifiable_by_rdns	Microsoft verifies Bingbot traffic through reverse DNS lookups that resolve to hostnames ending in search.msn.com.	Google does not publish a reverse-DNS verification method for Google-Extended.
what_it_controls	not documented	Google-Extended controls AI training and grounding in Google systems and does not control Google Search inclusion.

Sources