
The name of a real Google crawler, which reads a website when its owner asks Google to build a Vertex AI agent on it: a chatbot that answers questions about the site. This site has no such agent, and these visits didn’t come from Google.
Worth knowing: Google says its crawlers generally come from addresses it publishes, and warns that their names can be copied (Google).
On this site: It read ordinary pages under Google’s name but from a small US hosting company, the same one the xAI-SearchBot visits come from, starting and stopping on the same days: probably one program trying on AI companies’ names to see which get through.
Tools anyone can run from a laptop or a rented server: curl, Python scripts, small homemade scrapers, research crawlers. They could be a student’s project, someone building a dataset to sell, or the start of a scan; on their own they don’t say which. What they sell →