Amzn-SearchBotAmazon says Amzn-SearchBot improves search in Amazon products and services. Permitting it makes a site eligible to appear in search experiences such as Alexa. Amazon says this token does not crawl content for generative AI model training. If robots.txt does not mention Amzn-SearchBot but allows other search bots, Amazon says this crawler follows those bots' directives. This check does not apply that fallback. Automated crawling honors allow and disallow and does not support crawl-delay. Each Amazon user-agent setting is independent. Amazonbot and Amzn-User are different tokens.
searchobeys. The vendor says this crawler obeys robots.txt on automatic crawls.Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amzn-SearchBot/0.1) Chrome/W.X.Y.Z Safari/537.36 Amazon calls this an example. Chrome/W.X.Y.Z is the placeholder printed on the page, not a version Botcard observed.curl -s https://whosthatbot.com/v1/crawlers/amzn-searchbot
tools/call with name check_robots is the same check at POST /mcp. The pasted file disallows Amzn-SearchBot on /docs and allows *. The call does not fetch a host.
curl -s https://whosthatbot.com/mcp -H 'content-type: application/json' -H 'accept: application/json, text/event-stream' -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"check_robots","arguments":{"robots_txt":"User-agent: Amzn-SearchBot\nDisallow: /\n\nUser-agent: *\nAllow: /\n","path":"/docs","ids":["amzn-searchbot"]}}}'
That call returns fetched_target false. This row is disallow via group Amzn-SearchBot, rule Disallow: /.