ClaudeBot
ClaudeBot is the web crawler Anthropic, the company behind Claude, uses to collect web content that could help train its AI. Anthropic's help page says blocking ClaudeBot in your robots.txt file keeps your site's future pages out of its training data. Anthropic runs two other bots, Claude-User and Claude-SearchBot, for answering people's questions and for search.
Source: Anthropic Help Center, Does Anthropic crawl data from the web, and how can site owners block the crawler?, checked October 29, 2026
What ClaudeBot means for your business
The three bots do different jobs, so a robots.txt rule should name the one you mean. Anthropic says Claude-User may visit your site when someone asks Claude a question, and blocking it may make your site harder to find when people search with Claude. Blocking Claude-SearchBot keeps your content out of its search index.
Anthropic also says its bots follow robots.txt, honor a Crawl-delay line for sites that want fewer visits, and won't try to get past CAPTCHAs. So if a CAPTCHA or a bot wall sits in front of your pages, we'd expect Claude's bots to stop there.
Searching the name can turn up ClawdBot too, a separate project with a similar name. The crawler in your server logs is spelled ClaudeBot.
If you've blocked AI bots and aren't sure which ones, or Claude never mentions your business, checking which AI tools can read your site is where we'd begin.
Last reviewed October 29, 2026. All terms
How AI answers it today
On October 29, 2026, Google's AI Overview led with ClawdBot, a separate project, citing YouTube, Medium and glossaries, then said ClaudeBot also powers live answers, a job Anthropic gives to its other bots. ChatGPT matched Anthropic's help page and cited it.
Our run through ChatGPT and Google's AI Overview, October 29, 2026. A sample, not what every buyer sees.
Related terms in crawlers and technical access
Find out where your brand stands.
Tell us what you're trying to figure out. We'll get back to you within one business day with a time to talk.