Programs without a company
The painted mark for ThemeSmithResearchBot
Placeholder: mark still to be painted

ThemeSmithResearchBot

The crawler of ThemeSmith, a UK company that builds websites for small businesses. Its page says it reads the public pages of UK business websites to publish research about them, such as how many show their prices or the details their regulator asks for, and to improve its own service. It reads robots.txt first and goes no faster than a page a second.

Worth knowing: ThemeSmith says it keeps copies of the pages it reads for up to 36 months, and publishes its research only as totals, never naming a business (ThemeSmith).

How it makes money: It sells websites to small businesses. It says it keeps the pages it reads for up to 36 months, for market research, and never sells or shares them. (themesmith.ai)

On this site: The rules, the homepage, Contact, About and one work: probably counting this as one more UK small business website, and checking whether it shows its prices.

Why? Tools anyone can run from a laptop or a rented server: curl, Python scripts, small homemade scrapers, research crawlers. They could be a student’s project, someone building a dataset to sell, or the start of a scan; on their own they don’t say which. What they sell →