Rattlesnakes By Mail

Bingbot vs Googlebot

Bingbot and Googlebot compared on 12 documented fields, from 21 claims, last verified 2026-09-15.

FieldBingbotGooglebotComparison
cites_sourcesyesyessame
follows_noarchiveyesnot documenteddifferent
honours_crawl_delayyesnodifferent
observed_verified_request_ratio_censusnot documented0.991different
opt_out_mechanismyesnot documenteddifferent
publishes_ip_listyesyessame
purpose_documentedyessearchdifferent
reads_llms_txtnot_documentednodifferent
respects_robots_txtyesyessame
separate_search_and_training_tokensnoyesdifferent
user_agent_string_fullMozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html)different
verifiable_by_rdnsyesyessame

Differences

FieldBingbot statementGooglebot statement
follows_noarchiveBingbot excludes noarchive-tagged content from Copilot and Chat answers and from generative AI training data.not documented
honours_crawl_delayMicrosoft states that a crawl-delay directive in robots.txt always takes precedence over Bing Webmaster Tools crawl control settings for Bingbot.Google does not support the robots.txt Crawl-delay directive for Googlebot.
observed_verified_request_ratio_censusnot documentedGooglebot requests to Rattlesnakes By Mail matched Google's published IP ranges on 108 of 109 requests between 2026-09-13T20:00Z and 2026-09-15T09:00Z. Googlebot's first request to Rattlesnakes By Mail in that window was /robots.txt at 2026-09-14T11:53:00Z.
opt_out_mechanismMicrosoft lets publishers block Bingbot content from Copilot answers and AI training using noarchive and nocache tags.not documented
purpose_documentedBingbot serves as Microsoft's standard crawler and handles most of Bing's daily web crawling.Googlebot crawls pages for Google Search, Google Images, Google Video, Google News, and Discover.
reads_llms_txtMicrosoft does not publish whether Bingbot reads llms.txt files.Google Search does not use llms.txt files.
separate_search_and_training_tokensMicrosoft controls Bingbot's use in AI training through meta tags rather than publishing a separate training-specific crawler token.Google separates Search crawling under the Googlebot token from Gemini training under the Google-Extended token.
user_agent_string_fullBingbot sends a user agent string containing bingbot/2.0 and a link to Microsoft's bingbot.htm page.Googlebot sends the user agent string Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html).

Sources