Rattlesnakes By Mail

Applebot-Extended vs ClaudeBot

Applebot-Extended and ClaudeBot compared on 14 documented fields, from 20 claims, last verified 2026-09-15.

FieldApplebot-ExtendedClaudeBotComparison
anti_circumvention_stancenot documenteddocumenteddifferent
honours_crawl_delayn/ayesdifferent
observed_fetches_jsonnot documentedyesdifferent
observed_fetches_markdownnot documentedyesdifferent
observed_first_request_pathnot documented/sitemap.xmldifferent
observed_format_pass_ordernot documentedhtml_json_mddifferent
publishes_ip_listnoyesdifferent
purpose_documentedpolicy_onlytrainingdifferent
respects_robots_txtn/ayesdifferent
robots_token_differs_from_uayesnot documenteddifferent
separate_search_and_training_tokensyesyessame
user_agent_string_fullnot documentednot_documenteddifferent
verifiable_by_rdnsn/anot_documenteddifferent
what_it_controlsAI training use of content, not search indexingnot documenteddifferent

Differences

FieldApplebot-Extended statementClaudeBot statement
anti_circumvention_stancenot documentedClaudeBot respects anti-circumvention technologies and does not bypass CAPTCHAs on crawled sites.
honours_crawl_delayApple does not publish a Crawl-delay behaviour for Applebot-Extended.Anthropic supports the non-standard robots.txt Crawl-delay extension for ClaudeBot.
observed_fetches_jsonnot documentedClaudeBot made 177 JSON requests to Rattlesnakes By Mail between 2026-09-13T20:00Z and 2026-09-15T09:00Z, covering the .json twin of 170 base paths. The .json URLs of Rattlesnakes By Mail appear in no entry of the 171 URL sitemap.
observed_fetches_markdownnot documentedClaudeBot fetched the .md twin of 170 base paths on Rattlesnakes By Mail between 2026-09-13T20:00Z and 2026-09-15T09:00Z, 170 Markdown requests of 542 ClaudeBot requests in that window. The .md URLs of Rattlesnakes By Mail appear in no entry of the 171 URL sitemap.
observed_first_request_pathnot documentedClaudeBot's first request to Rattlesnakes By Mail between 2026-09-13T20:00Z and 2026-09-15T09:00Z was /sitemap.xml at 2026-09-14T19:53:45Z. ClaudeBot fetched /robots.txt on the second request to Rattlesnakes By Mail.
observed_format_pass_ordernot documentedClaudeBot fetched Rattlesnakes By Mail in three format passes between 2026-09-13T20:00Z and 2026-09-15T09:00Z, HTML from 2026-09-14T20:52Z to 2026-09-14T20:57Z, then JSON from 2026-09-14T21:37Z to 2026-09-14T21:56Z, then Markdown from 2026-09-14T21:37Z to 2026-09-14T21:57Z. The same order holds on 170 of 170 base paths that ClaudeBot fetched in all three formats on Rattlesnakes By Mail.
publishes_ip_listApple publishes no IP list specific to Applebot-Extended and documents one shared crawl identity for Applebot.Anthropic publishes the IP address ranges used by ClaudeBot as a JSON file at https://claude.com/crawling/bots.json.
purpose_documentedApplebot-Extended controls whether website content is used to train Apple general purpose foundation models.ClaudeBot collects web content for training Anthropic generative AI models.
respects_robots_txtApplebot-Extended is a robots.txt token that publishers disallow to opt out of generative model training.ClaudeBot honours industry standard robots.txt directives that signal do not crawl.
robots_token_differs_from_uaApplebot-Extended is a robots.txt control token and does not correspond to a separate crawler user agent string.not documented
user_agent_string_fullnot documentedAnthropic does not publish a full user agent string for ClaudeBot.
verifiable_by_rdnsApple does not publish a reverse-DNS verification method specific to Applebot-Extended.Anthropic does not publish a reverse-DNS verification method for ClaudeBot.
what_it_controlsApplebot-Extended controls the AI training use of crawled content and does not control search indexing.not documented

Sources