Marketing and search-ranking tools
The painted mark for Screaming Frog
Placeholder: mark still to be painted

Screaming Frog

The Screaming Frog SEO Spider, a program made by Screaming Frog, a search-marketing agency in Henley-on-Thames, England. Someone runs it on their own computer to crawl a site they choose and check every page for problems (broken links, redirects, missing titles); the results stay with them, not in an index of the web.

Worth knowing: The name comes from “a frog that stood up for itself after being cornered by two cats in Dan’s back garden”: Dan Sharp is one of its three founders (Screaming Frog).

Worth knowing: It obeys robots.txt unless told not to, and can be set to call itself Googlebot or an ordinary browser, so it only shows up under its own name when it is left as it comes (Screaming Frog).

How it makes money: It sells the program, not data: a licence for the SEO Spider costs £199 a year (£169 each for 20 or more), and the free version crawls up to 500 addresses. (screamingfrog.co.uk)

On this site: A visit from it under its own name would mean a person somewhere had chosen to look closely at this site, page by page.

Why? They map which sites link to which and how pages rank, and sell that map to marketers and agencies trying to climb the search results. What they sell →