ClaudeBot honors robots.txt directives. Anthropic also publishes documented user-agent strings for transparency.
Allowing ClaudeBot ensures your content is eligible for citation by Claude — both in current responses and future model versions.