Rattlesnakes By Mail

Bingbot vs Claude-SearchBot

Bingbot and Claude-SearchBot compared on 11 documented fields, from 20 claims, last verified 2026-09-14.

FieldBingbotClaude-SearchBotComparison
cites_sourcesyesnot_documenteddifferent
follows_noarchiveyesnot documenteddifferent
honours_crawl_delayyesyessame
opt_out_mechanismyesnot documenteddifferent
publishes_ip_listyesyessame
purpose_documentedyessearchdifferent
reads_llms_txtnot_documentednot_documentedsame
respects_robots_txtyesyessame
separate_search_and_training_tokensnoyesdifferent
user_agent_string_fullMozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)not_documenteddifferent
verifiable_by_rdnsyesnot_documenteddifferent

Differences

FieldBingbot statementClaude-SearchBot statement
cites_sourcesCopilot Search in Bing delivers clearly cited sources alongside generative answers to support publishers and content owners.Anthropic does not publish whether Claude search responses cite pages crawled by Claude-SearchBot.
follows_noarchiveBingbot excludes noarchive-tagged content from Copilot and Chat answers and from generative AI training data.not documented
opt_out_mechanismMicrosoft lets publishers block Bingbot content from Copilot answers and AI training using noarchive and nocache tags.not documented
purpose_documentedBingbot serves as Microsoft's standard crawler and handles most of Bing's daily web crawling.Claude-SearchBot analyses online content to improve the relevance and accuracy of Claude search responses.
separate_search_and_training_tokensMicrosoft controls Bingbot's use in AI training through meta tags rather than publishing a separate training-specific crawler token.Anthropic separates search and training controls into two robots.txt tokens: Claude-SearchBot for search and ClaudeBot for training.
user_agent_string_fullBingbot sends a user agent string containing bingbot/2.0 and a link to Microsoft's bingbot.htm page.Anthropic does not publish a full user agent string for Claude-SearchBot.
verifiable_by_rdnsMicrosoft verifies Bingbot traffic through reverse DNS lookups that resolve to hostnames ending in search.msn.com.Anthropic does not publish a reverse-DNS verification method for Claude-SearchBot.

Sources