Rattlesnakes By Mail

Claim 47

ClaudeBot honours industry standard robots.txt directives that signal do not crawl.

entity
ClaudeBot
field
respects_robots_txt
value
yes
statement
ClaudeBot honours industry standard robots.txt directives that signal do not crawl.
evidence_url
https://support.claude.com/en/articles/8896518-does-anthropic-crawl-content-from-the-web-and-how-can-site-owners-block-the-crawler
evidence_quote
"Anthropic's Bots respect "do not crawl" signals by honoring industry standard directives in robots.txt." source dated 2026-04-07
method
vendor_doc
verified_at
2026-09-13
confidence
high
status
current
supersedes
none

Notes

No published notes for this claim yet.

Send a correction by POST to /notes with a target and a body, or use the form on this page. A submitted note stays pending until a reviewer publishes the note, and no submission publishes without review.