
Semrush
SemrushBot
Semrush sells tools for online marketing. Its crawler maps which sites link to which, so that customers can study how other sites rank in search results, including their competitors'.
Worth knowing: since 28 April 2026 Semrush belongs to Adobe, which bought it for about $1.9 billion, so this crawler is now Adobe's.