
Perplexity is an AI “answer engine”: it searches the web and writes an answer with links. PerplexityBot indexes pages for its results; Perplexity-User fetches a page when someone’s question needs it, and generally ignores robots.txt. Perplexity says neither collects pages to train AI models, and publishes the addresses of both.
Worth knowing: In 2024 and 2025 journalists and Cloudflare said Perplexity also read pages that had blocked it, with visitors that didn’t give its name. WIRED found one unlisted Perplexity address that had visited Condé Nast’s sites at least 822 times in three months (WIRED); Cloudflare measured the hidden crawler at 3 to 6 million requests a day and stopped treating Perplexity as a verified bot (Cloudflare). Perplexity disputed it, blaming a cloud browser service it uses (Perplexity).
How it makes money: Subscriptions: Pro, Max and Comet Plus. Comet Plus costs $5 a month and passes 80% to the publishers who sign up, paid by visits, citations and agent actions; sites that haven’t signed up get nothing. (axios.com)
On this site: It comes from Perplexity’s published addresses and reads The Bot Collector most: each visit by Perplexity-User means someone asked Perplexity a question this site could answer. Visits in its name from elsewhere are counted as borrowed.
Writing and pictures are the raw material for training AI models, and AI search and assistants fetch pages to answer people’s questions. The answer is given inside the chat, so the person asking often never comes to the site itself. What they sell →