
Microsoft's crawler for Bing Search. Bing's index goes further than Bing itself: it supplies results to other search engines such as Yahoo, and in part DuckDuckGo and Ecosia, and it helps Microsoft's Copilot answer questions about the web.
Worth knowing: Bing and Yandex started the IndexNow system (2021), which lets sites tell search engines straight away when a page changes, instead of waiting for a crawler to notice.
How it makes money: Adverts, about $15 billion a year of them across Bing, Copilot and Edge, and selling its index to AI builders: “Grounding with Bing Search” lets their agents search it for $14 per 1,000 transactions. (microsoft.com)
To keep an up to date copy of the web, so they can show it in their results and sell advertising beside them. More and more, the same copy also feeds their AI answers. What they sell →