
Several programs use this name. The one that fits this visit is the crawler of BizCensus, which “visits public web pages to find out whether a domain has a live website and what it is about”, for a directory of businesses by sector, country and language. It reads the homepage and the contact page, and collects published email addresses, phone numbers, addresses and social media profiles.
Worth knowing: Its page admits it no longer obeys robots.txt: “What it no longer obeys is Disallow, and we would rather tell you here than leave a promise published that we do not keep” (BizCensus).
How it makes money: It sells CSV files of businesses picked by country, language and sector, with emails, phone numbers and social profiles, paid by card with “No quotes, no calls”; buyers pay only for records with a phone or an email. (atlas.harmoniamix.com)
On this site: The homepage and Contact, just as BizCensus describes: this site is probably in its directory of businesses now, perhaps with its contact details.
They map which sites link to which and how pages rank, and sell that map to marketers and agencies trying to climb the search results. What they sell →