
Bots that give a name of their own but aren't from any company listed here. The Bot Collector shows them by the name they give. Many are small crawlers for search or marketing start-ups, research projects or website monitoring services; a few borrow the name of an AI company's crawler while they look for weak spots in website software.
Those that have visited have pages of their own, with their collections under All the bots. Where it's known what a named bot is for (Keenable's search index for AI agents, SE Ranking's marketing tool, the British Library's web archive...), the key under The Bot Collector lists it in that collection. This page stands in for any newcomer that doesn’t have one yet.
Tools anyone can run from a laptop or a rented server: curl, Python scripts, small homemade scrapers, research crawlers. They could be a student’s project, someone building a dataset to sell, or the start of a scan; on their own they don’t say which.