Rattlesnakes By Mail

anti circumvention stance across crawlers

anti circumvention stance across 1 crawlers from 1 vendors, from 1 claims, last verified 2026-09-13.

How the crawlers answer this one question, counted by answer. Every answer links to the vendor quote behind it.

Anti circumvention stanceAnti circumvention stance. not documented is the largest with 15 crawlers, out of 16 crawlers in total.not documented: 15 crawlersnot documented15documented: 1 crawlerdocumented1
Anti circumvention stance. not documented is the largest with 15 crawlers, out of 16 crawlers in total. Source: each vendor's own crawler documentation, quoted and dated on every claim page.
CrawlerVendorValueMethodVerifiedClaim
ClaudeBotAnthropicdocumentedvendor_doc2026-09-13claim 53

Not documented

CrawlerVendor
Claude-SearchBotAnthropic
Claude-UserAnthropic
ApplebotApple
Applebot-ExtendedApple
Google-ExtendedGoogle
GoogleOtherGoogle
GooglebotGoogle
BingbotMicrosoft
ChatGPT-UserOpenAI
GPTBotOpenAI
OAI-AdsBotOpenAI
OAI-SearchBotOpenAI
Perplexity-UserPerplexity
PerplexityBotPerplexity
ReflectionbotReflection AI

Sources

Source
https://support.claude.com/en/articles/8896518-does-anthropic-crawl-content-from-the-web-and-how-can-site-owners-block-the-crawler