
Googlebot reads pages so they can turn up in Google Search. Google has other crawlers too, for Google Images, shopping, ads and product research. Whether pages may be used for Google's AI (Gemini) is controlled by a separate robots.txt name, Google-Extended; it is a rule, not a separate visitor.
Worth knowing: Googlebot nowadays reads the web as a smartphone. Since Google's switch to “mobile-first indexing”, the phone version of a page is the one that counts in its search results.
How it makes money: Mostly adverts on search: “Google Search & other” brought in $63.35 billion in the three months to 30 September 2026. Sites aren’t paid, apart from a pilot, since September 2026, for some publishers Google invites, at rates Google decides. (sec.gov)
To keep an up to date copy of the web, so they can show it in their results and sell advertising beside them. More and more, the same copy also feeds their AI answers. What they sell →