`Applebot-Extended`

Apple says Applebot-Extended does not crawl pages. It only decides how Apple may use pages that Applebot already crawled: disallowing the token opts the site out of training Apple's general-purpose foundation models that power generative features in Apple Intelligence, Services, and Developer Tools. Apple says those pages can still be included in search results, and that this token is not a Search ranking signal. A nosnippet tag, not this token, is how the same page says to opt out of broad world-knowledge answers.

robots.txt token: Applebot-Extended
Operator: Apple
Kind: control_token
robots.txt: control_token. This is a robots.txt control. It is not a separate HTTP crawler.
HTTP user-agent: The cited page does not publish an HTTP user-agent string for Applebot-Extended. It says this token does not crawl webpages. The HTTP examples on that page are for Applebot, a different token, which is not this card.
IP list: None on the cited page. The cited page does not publish an IP list for Applebot-Extended. It says this token does not crawl webpages. The address file on that page identifies Applebot.
Source: About Applebot. Retrieved 2026-10-17, page published 2026-09-04.

JSON

curl -s https://whosthatbot.com/v1/crawlers/applebot-extended

Check this token

tools/call with name check_robots is the same check at POST /mcp. The pasted file disallows Applebot-Extended on /docs and allows *. The call does not fetch a host.

curl -s https://whosthatbot.com/mcp -H 'content-type: application/json' -H 'accept: application/json, text/event-stream' -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"check_robots","arguments":{"robots_txt":"User-agent: Applebot-Extended\nDisallow: /\n\nUser-agent: *\nAllow: /\n","path":"/docs","ids":["applebot-extended"]}}}'

That call returns fetched_target false. This row is disallow via group Applebot-Extended, rule Disallow: /.