Rattlesnakes By Mail

user fetch exception documented across crawlers

user fetch exception documented across 1 crawlers from 1 vendors, from 1 claims, last verified 2026-09-13.

user fetch exception documented across 1 crawlers from 1 vendors, from 1 claims, last verified 2026-09-13.

CrawlerVendorValueMethodVerifiedClaim
Claude-UserAnthropicnovendor_doc2026-09-13claim 38

Not documented

CrawlerVendor
Claude-SearchBotAnthropic
ClaudeBotAnthropic
ApplebotApple
Applebot-ExtendedApple
Google-ExtendedGoogle
GoogleOtherGoogle
GooglebotGoogle
BingbotMicrosoft
ChatGPT-UserOpenAI
GPTBotOpenAI
OAI-AdsBotOpenAI
OAI-SearchBotOpenAI
Perplexity-UserPerplexity
PerplexityBotPerplexity

Sources

Source
https://support.claude.com/en/articles/8896518-does-anthropic-crawl-content-from-the-web-and-how-can-site-owners-block-the-crawler