Rattlesnakes By Mail

ChatGPT-User vs Claude-SearchBot

ChatGPT-User and Claude-SearchBot compared on 9 documented fields, from 18 claims, last verified 2026-09-13.

FieldChatGPT-UserClaude-SearchBotComparison
cites_sourcesnot_documentednot_documentedsame
honours_crawl_delaynot_documentedyesdifferent
publishes_ip_listyesyessame
purpose_documenteduser_fetchsearchdifferent
reads_llms_txtnot_documentednot_documentedsame
respects_robots_txtpartialyesdifferent
separate_search_and_training_tokensnot_documentedyesdifferent
user_agent_string_fullMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/botnot_documenteddifferent
verifiable_by_rdnsnot_documentednot_documentedsame

Differences

FieldChatGPT-User statementClaude-SearchBot statement
honours_crawl_delayOpenAI does not publish whether ChatGPT-User honours the robots.txt Crawl-delay directive.Claude-SearchBot respects the Crawl-delay directive in robots.txt when crawling domains.
purpose_documentedChatGPT-User visits web pages for user actions in ChatGPT and in Custom GPTs.Claude-SearchBot analyses online content to improve the relevance and accuracy of Claude search responses.
respects_robots_txtChatGPT-User fetches pages in response to user actions in ChatGPT, and OpenAI states that robots.txt rules may not apply to ChatGPT-User fetches.Claude-SearchBot honours industry standard robots.txt directives that signal do not crawl.
separate_search_and_training_tokensOpenAI does not document ChatGPT-User as a search or training opt-out token.Anthropic separates search and training controls into two robots.txt tokens: Claude-SearchBot for search and ClaudeBot for training.
user_agent_string_fullChatGPT-User sends the user agent string Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot.Anthropic does not publish a full user agent string for Claude-SearchBot.

Sources