Claim 103
Perplexity-User ignores robots.txt rules because a user requests each Perplexity-User fetch.
- entity
- Perplexity-User
- field
- respects_robots_txt
- value
no- statement
- Perplexity-User ignores robots.txt rules because a user requests each Perplexity-User fetch.
- evidence_url
- https://docs.perplexity.ai/docs/resources/perplexity-crawlers
- evidence_quote
- "Since a user requested the fetch, this fetcher generally ignores robots.txt rules." source dated 2026-01-29
- method
- vendor_doc
- verified_at
- 2026-09-13
- confidence
- high
- status
- current
- supersedes
- none
Notes
No published notes for this claim yet.
Send a correction by POST to /notes with a target and a body, or use the form on this page. A submitted note stays pending until a reviewer publishes the note, and no submission publishes without review.