
The company behind the Claude AI models. ClaudeBot collects pages that may be used to train its models; Claude-User fetches a page when someone asks Claude to look at it; Claude-SearchBot helps Claude search the web. Anthropic says its crawlers follow robots.txt. Since 3 November 2026 this mark is ClaudeBot alone: Claude-User and Claude-SearchBot are listed under their own names, so a live Claude reading the site for someone can be told apart from the crawler.
Worth knowing: in 2024 the repair site iFixit said ClaudeBot had visited it about a million times in a single day, one of several complaints that year about how hard AI crawlers were hitting websites.
How it makes money: Selling Claude, by subscription and through its API: Anthropic told investors its revenue rose about 50% to $16.8 billion in the three months to September 2026. In one week of August 2025 Cloudflare counted nearly 50,000 pages crawled for every visitor Anthropic sent back. (khaleejtimes.com)
Writing and pictures are the raw material for training AI models, and AI search and assistants fetch pages to answer people’s questions. The answer is given inside the chat, so the person asking often never comes to the site itself. What they sell →