
The crawler of SEOJuice, a paid search-ranking (SEO) tool that also tracks how ChatGPT, Claude, Gemini, Perplexity and Copilot mention a brand. Its page says it maps how pages link to each other and follows robots.txt.
Worth knowing: SEOJuice was started in early 2024 by two people, as a tool that did just one thing, linking a site’s own pages to each other automatically. Its founder has put it at roughly 5,200 active sites, most on the free plan (SEOJuice).
How it makes money: One plan: $59 per website a month, VAT included, which fixes a site’s internal links automatically and tracks rankings, backlinks and mentions in AI answers, with reports agencies can put their own name on. (seojuice.com)
On this site: Mostly llms.txt, ai.txt and robots.txt, the files where a site tells AI what it may do, through a changing mix of proxy networks: checking how ready this site is to be read by AI, to sell the answer to marketers.
They map which sites link to which and how pages rank, and sell that map to marketers and agencies trying to climb the search results. What they sell →