Programs without a company
The painted mark for Top1mBot
Placeholder: mark still to be painted

Top1mBot

Its name points to top1m.org, an independent site ranking the top million websites, with daily archives, rankings of servers and addresses, and lists of domains about to expire. It doesn’t say who runs it or describe its bot.

Worth knowing: It seems to travel through Tor, the network that hides where traffic comes from: one of its visits here came out of a Tor exit run by DFRI, the Swedish digital rights group, and the bot database Udger lists Tor exits for it too (Udger).

How it makes money: It has a pricing page and an API besides its daily downloads, but shows no plans, prices or data licence, so what it charges isn’t known. (top1m.org)

On this site: It only ever looks at the homepage, and each visit seems to come out of a different country through Tor: ranking this site among the world’s websites while hiding where it is.

Why? Tools anyone can run from a laptop or a rented server: curl, Python scripts, small homemade scrapers, research crawlers. They could be a student’s project, someone building a dataset to sell, or the start of a scan; on their own they don’t say which. What they sell →