What Applebot does
Apple says Applebot powers search features across its devices, including Spotlight, Siri and Safari, and that allowing Applebot lets your content appear in search results for Apple users.
If robots.txt does not mention Applebot but does mention Googlebot, Applebot follows the Googlebot rules. A Googlebot block can therefore block Apple’s search too.
Applebot-Extended is a robots.txt token, not a crawler. Disallowing it opts your content out of training Apple’s foundation models, and Apple says those pages can still appear in search. Applebot does not follow Crawl-delay.
| Operator | Apple |
|---|---|
| robots.txt token | Applebot |
| User agent | Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot)Mozilla/5.0 (iPhone; CPU iPhone OS 17_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4.1 Mobile/15E148 Safari/604.1 (Applebot/0.1; +http://www.apple.com/go/applebot) |
| Used for | Siri, Spotlight and Safari |
| If you block it | Apple cannot crawl the page for search across its devices. |
| Check a visit is real | Run a reverse DNS lookup on the IP address and check the name is in the applebot.apple.com domain. Apple also publishes Applebot’s IP ranges at search.developer.apple.com/applebot.json. |
Source: Apple: about Applebot