Everything You Want to Know about Claude
"Claude" appears in some third-party bot directories as a legacy or generic Anthropic crawler identifier, predating the current three-way split into ClaudeBot (training), Claude-User (user-triggered), and Claude-SearchBot (search). Anthropic's current official documentation describes only those three bots.
Last verified August 15, 2026 against Anthropic's published crawler docs
How Claude views your website
Claude fetches raw page HTML — it does not execute JavaScript. Content that only appears after client-side rendering is invisible to it.
Paste a URL for the rendered-vs-crawled diff, blocked resources, and the sections that never reach the bot.
How to block Claude
Add the rule below to your site's robots.txt. Most crawlers, including Claude, check for changes within 24 hours.
User-agent: Claude
Disallow: /Need the full walkthrough?
Partial blocks, per-directory rules, Cloudflare and server-level options, verification.