DuckDuckBotDuckDuckGo says DuckDuckBot improves search results. The page says the user agent will appear as DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html) and that it respects WWW::RobotRules, linking that name to the MetaCPAN module page. DuckAssistBot is a different token: a real-time crawl for AI-assisted answers, not this card.
searchobeys. The vendor says this crawler obeys robots.txt on automatic crawls.DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html) DuckDuckGo says the crawler's user agent will appear as this string, including the semicolon.curl -s https://whosthatbot.com/v1/crawlers/duckduckbot
tools/call with name check_robots is the same check at POST /mcp. The pasted file disallows DuckDuckBot on /docs and allows *. The call does not fetch a host.
curl -s https://whosthatbot.com/mcp -H 'content-type: application/json' -H 'accept: application/json, text/event-stream' -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"check_robots","arguments":{"robots_txt":"User-agent: DuckDuckBot\nDisallow: /\n\nUser-agent: *\nAllow: /\n","path":"/docs","ids":["duckduckbot"]}}}'
That call returns fetched_target false. This row is disallow via group DuckDuckBot, rule Disallow: /.