Everything You Want to Know about ExaBot
ExaBot (ExaSearchBot) fetches and indexes public pages to power Exa's search engine and semantic-search APIs, including citation-linked results.
Last verified August 15, 2026 against Exa's published crawler docs
Why it's crawling your site
Exa crawls your site to build the index behind Exa Search and its API, which can drive citation and referral traffic back to your site.
How ExaBot views your website
ExaBot fetches raw page HTML (full page html, no js rendering documented) — it does not execute JavaScript. Content that only appears after client-side rendering is invisible to it.
Paste a URL for the rendered-vs-crawled diff, blocked resources, and the sections that never reach the bot.
How to block ExaBot
Add the rule below to your site's robots.txt. Most crawlers, including ExaBot, check for changes within 24 hours.
User-agent: ExaSearchBot
Disallow: /Need the full walkthrough?
Partial blocks, per-directory rules, Cloudflare and server-level options, verification.