Rattlesnakes By Mail

anti circumvention stance across crawlers

anti circumvention stance across 1 crawlers from 1 vendors, from 1 claims, last verified 2026-09-13.

anti circumvention stance across 1 crawlers from 1 vendors, from 1 claims, last verified 2026-09-13.

CrawlerVendorValueMethodVerifiedClaim
ClaudeBotAnthropicdocumentedvendor_doc2026-09-13claim 53

Not documented

CrawlerVendor
Claude-SearchBotAnthropic
Claude-UserAnthropic
ApplebotApple
Applebot-ExtendedApple
Google-ExtendedGoogle
GoogleOtherGoogle
GooglebotGoogle
BingbotMicrosoft
ChatGPT-UserOpenAI
GPTBotOpenAI
OAI-AdsBotOpenAI
OAI-SearchBotOpenAI
Perplexity-UserPerplexity
PerplexityBotPerplexity

Sources

Source
https://support.claude.com/en/articles/8896518-does-anthropic-crawl-content-from-the-web-and-how-can-site-owners-block-the-crawler