Programs without a company
The painted mark for SiteDecayBot
Placeholder: mark still to be painted

SiteDecayBot

The research crawler of Site Decay, which measures how websites age: certificates running out, software going out of date, pages breaking, sites going offline or being hacked. Each visit reads robots.txt, the homepage and any news feed, about once a week at most, and it publishes only totals, never naming a site.

Worth knowing: Site Decay says it follows more than 100 million live websites; 15% have no secure (https) version, and 22% of those that show a copyright year show 2022 or earlier (Site Decay).

What happens to it: Besides its totals, free to cite, it offers agencies free watching of their clients’ sites, website builders an API, and security, insurance and hosting firms “Bulk data and custom cuts”, with no prices published. (sitedecay.com)

On this site: One look at the homepage, to see how this site is ageing: its certificate, its software, its copyright year. It will come back now and then to see whether the site decays.

Why? Tools anyone can run from a laptop or a rented server: curl, Python scripts, small homemade scrapers, research crawlers. They could be a student’s project, someone building a dataset to sell, or the start of a scan; on their own they don’t say which. What they sell →