Rattlesnakes By Mail

Bingbot vs GoogleOther

Bingbot and GoogleOther compared on 14 documented fields, from 20 claims, last verified 2026-09-15.

FieldBingbotGoogleOtherComparison
cites_sourcesyesnot documenteddifferent
follows_noarchiveyesnot documenteddifferent
honours_crawl_delayyesnodifferent
observed_fetches_robots_txtnot documentednodifferent
observed_requested_mcp_endpointnot documentedyesdifferent
opt_out_mechanismyesnot documenteddifferent
publishes_ip_listyesyessame
purpose_documentedyesmixeddifferent
reads_llms_txtnot_documentednot documenteddifferent
respects_robots_txtyesyessame
robots_txt_tokennot documentedGoogleOtherdifferent
separate_search_and_training_tokensnonot_documenteddifferent
user_agent_string_fullMozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)not documenteddifferent
verifiable_by_rdnsyesyessame

Differences

FieldBingbot statementGoogleOther statement
cites_sourcesCopilot Search in Bing delivers clearly cited sources alongside generative answers to support publishers and content owners.not documented
follows_noarchiveBingbot excludes noarchive-tagged content from Copilot and Chat answers and from generative AI training data.not documented
honours_crawl_delayMicrosoft states that a crawl-delay directive in robots.txt always takes precedence over Bing Webmaster Tools crawl control settings for Bingbot.Google does not support the robots.txt Crawl-delay directive for GoogleOther.
observed_fetches_robots_txtnot documentedGoogleOther made 93 requests to Rattlesnakes By Mail between 2026-09-13T20:00Z and 2026-09-15T09:00Z and fetched /robots.txt on none of those requests. GoogleOther's first request to Rattlesnakes By Mail was the home page at 2026-09-14T12:03:30Z.
observed_requested_mcp_endpointnot documentedGoogleOther requested the /mcp endpoint of Rattlesnakes By Mail twice between 2026-09-13T20:00Z and 2026-09-15T09:00Z, at 2026-09-14T15:07:30Z and at 2026-09-14T18:27:49Z. Rattlesnakes By Mail returned status 405 to both GoogleOther requests for /mcp.
opt_out_mechanismMicrosoft lets publishers block Bingbot content from Copilot answers and AI training using noarchive and nocache tags.not documented
purpose_documentedBingbot serves as Microsoft's standard crawler and handles most of Bing's daily web crawling.GoogleOther is a generic crawler that Google product teams use to fetch publicly accessible content from sites.
reads_llms_txtMicrosoft does not publish whether Bingbot reads llms.txt files.not documented
robots_txt_tokennot documentedThe robots.txt token for GoogleOther is GoogleOther.
separate_search_and_training_tokensMicrosoft controls Bingbot's use in AI training through meta tags rather than publishing a separate training-specific crawler token.Google does not document whether content fetched by GoogleOther is used for Gemini training.
user_agent_string_fullBingbot sends a user agent string containing bingbot/2.0 and a link to Microsoft's bingbot.htm page.not documented

Sources