Rattlesnakes By Mail

Claude-SearchBot vs PerplexityBot

Claude-SearchBot and PerplexityBot compared on 9 documented fields, from 18 claims, last verified 2026-09-13.

FieldClaude-SearchBotPerplexityBotComparison
cites_sourcesnot_documentedyesdifferent
honours_crawl_delayyesnot_documenteddifferent
publishes_ip_listyesyessame
purpose_documentedsearchsearchsame
reads_llms_txtnot_documentednot_documentedsame
respects_robots_txtyesyessame
separate_search_and_training_tokensyesnot_documenteddifferent
user_agent_string_fullnot_documentedMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)different
verifiable_by_rdnsnot_documentednot_documentedsame

Differences

FieldClaude-SearchBot statementPerplexityBot statement
cites_sourcesAnthropic does not publish whether Claude search responses cite pages crawled by Claude-SearchBot.Perplexity links to the websites that PerplexityBot surfaces in Perplexity search results.
honours_crawl_delayClaude-SearchBot respects the Crawl-delay directive in robots.txt when crawling domains.Perplexity does not publish whether PerplexityBot honours the robots.txt Crawl-delay directive.
separate_search_and_training_tokensAnthropic separates search and training controls into two robots.txt tokens: Claude-SearchBot for search and ClaudeBot for training.Perplexity does not document a separate training crawler token alongside PerplexityBot.
user_agent_string_fullAnthropic does not publish a full user agent string for Claude-SearchBot.PerplexityBot sends the user agent string Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot).

Sources