Everything You Want to Know about PerplexityBot
PerplexityBot crawls and indexes pages to surface and link websites in Perplexity's search results; it is not used to collect training data for foundation models.
Last verified August 15, 2026 against Perplexity AI's published crawler docs
Why it's crawling your site
Perplexity crawls your site with PerplexityBot to build its own search index; blocking it removes your site from Perplexity's search results.
How PerplexityBot views your website
PerplexityBot fetches raw page HTML (full page html) — it does not execute JavaScript. Content that only appears after client-side rendering is invisible to it.
Paste a URL for the rendered-vs-crawled diff, blocked resources, and the sections that never reach the bot.
How to block PerplexityBot
Add the rule below to your site's robots.txt. Most crawlers, including PerplexityBot, check for changes within 24 hours.
User-agent: PerplexityBot
Disallow: /Need the full walkthrough?
Partial blocks, per-directory rules, Cloudflare and server-level options, verification.