Programs without a company
The painted mark for Unnamed bots
Placeholder: mark still to be painted

Unnamed bots

Programs that give no name The Bot Collector can read: requests with no name at all, or with one that sounds like a program (a fetcher, a monitor, a web library) but doesn’t say whose; and the first few hours of visits, on 29 September, before bots’ names were noted. Behind them are home-made scripts, uptime checkers, data collectors and services that don’t introduce themselves.

Worth knowing: Some are Google Chrome: before Chrome on Android fetches pages ahead of time for its users, its private prefetch proxy asks a site for /.well-known/traffic-advice, calling itself “Chrome Privacy Preserving Prefetch Proxy”, with no bot name in it (Chrome).

On this site: Mostly the homepage, /.well-known/ addresses (many from Google’s network, which fits Chrome’s prefetch proxy) and llms.txt (from Amazon’s cloud): many small programs that don’t say who they are.

Why? Tools anyone can run from a laptop or a rented server: curl, Python scripts, small homemade scrapers, research crawlers. They could be a student’s project, someone building a dataset to sell, or the start of a scan; on their own they don’t say which. What they sell →