DuckAssistBotDuckDuckGo says DuckAssistBot crawls pages in real time for AI-assisted answers that cite their sources, and that this data is not used to train AI models. A publisher opts out by disallowing the DuckAssistBot user agent. DuckDuckGo says that change takes effect after 72 hours and does not change organic search rankings or whether the site appears in search results. The page lists crawling@duckduckgo.com for opt-out problems. DuckDuckBot is a different token.
searchdisallow_is_opt_out. The vendor says disallowing this token opts that use out.DuckAssistBot/1.2; (+http://duckduckgo.com/duckassistbot.html) DuckDuckGo says the crawler's user agent will appear as this string, including the semicolon.curl -s https://whosthatbot.com/v1/crawlers/duckassistbot
tools/call with name check_robots is the same check at POST /mcp. The pasted file disallows DuckAssistBot on /docs and allows *. The call does not fetch a host.
curl -s https://whosthatbot.com/mcp -H 'content-type: application/json' -H 'accept: application/json, text/event-stream' -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"check_robots","arguments":{"robots_txt":"User-agent: DuckAssistBot\nDisallow: /\n\nUser-agent: *\nAllow: /\n","path":"/docs","ids":["duckassistbot"]}}}'
That call returns fetched_target false. This row is disallow via group DuckAssistBot, rule Disallow: /.