Apple
Applebot
Apple's crawler, used for Siri and Spotlight suggestions and Safari's search suggestions. Whether pages may also be used to train Apple's AI (Apple Intelligence) is set with a separate robots.txt name, Applebot-Extended.
Apple's crawler, used for Siri and Spotlight suggestions and Safari's search suggestions. Whether pages may also be used to train Apple's AI (Apple Intelligence) is set with a separate robots.txt name, Applebot-Extended.
Why? Writing and pictures are the raw material for training AI models, and AI search and assistants fetch pages to answer people’s questions. The answer is given inside the chat, so the person asking often never comes to the site itself.