Programs without a company
The painted mark for domains-crawler
Placeholder: mark still to be painted

domains-crawler

Nothing has been written about it anywhere: no bot directory lists it and no company claims it. It asked only for ads.txt, the file where a website lists who may sell its advertising space, which advertising and domain data tools collect.

On this site: It only wanted ads.txt, the list of who may sell a site’s advertising space, from a Spanish home broadband line: someone checking sites for advertising to sell, and finding this one carries none.

Why? Tools anyone can run from a laptop or a rented server: curl, Python scripts, small homemade scrapers, research crawlers. They could be a student’s project, someone building a dataset to sell, or the start of a scan; on their own they don’t say which. What they sell →