PerplexityBot honors robots.txt and crawls more frequently than most LLM crawlers because Perplexity emphasizes recency in citation selection.
Allowing PerplexityBot is a prerequisite for being cited in Perplexity answers.