// AI companies
The painted mark for Anthropic
Placeholder: mark still to be painted

Anthropic

ClaudeBot, Claude-User, Claude-SearchBot

The company behind the Claude AI models. ClaudeBot collects pages that may be used to train its models; Claude-User fetches a page when someone asks Claude to look at it; Claude-SearchBot helps Claude search the web. Anthropic says its crawlers follow robots.txt.

Worth knowing: in 2024 the repair site iFixit said ClaudeBot had visited it about a million times in a single day, one of several complaints that year about how hard AI crawlers were hitting websites.

Why? Writing and pictures are the raw material for training AI models, and AI search and assistants fetch pages to answer people’s questions. The answer is given inside the chat, so the person asking often never comes to the site itself.