Marketing and search-ranking tools
The painted mark for Barkrowler
Placeholder: mark still to be painted

Barkrowler

Barkrowler, the crawler of Babbar, a French company in Évreux that keeps a map of the web’s links and sells it to search-marketing tools. It keeps the links and details about each page, not the pages themselves, waits five seconds between requests to the same site, and publishes its addresses. Babbar also makes Ibou, a French search engine (see ibou-search).

Worth knowing: Babbar says it fetches about 3.3 billion pages a day, and that its crawler started out on BUbiNG, an open-source crawler made at the University of Milan (YourText.Guru).

How it makes money: Babbar sold its link data by subscription and API, with a sister writing tool, YourText.Guru, but its homepage now says “New subscriptions to Babbar are no longer available”: it is “at capacity”. (babbar.tech)

On this site: It comes back regularly from Babbar’s own network and reads the works: mapping this site’s links for marketers, for the company that is also building a French search engine.

Why? They map which sites link to which and how pages rank, and sell that map to marketers and agencies trying to climb the search results. What they sell →