coccocbot-webCốc Cốc's robots.txt guide says its robots support the robots exclusion protocol. The robot list at https://coccoc.com/search/console/coc-coc-robots calls coccocbot-web the main web robot and publishes two HTTP user-agent strings. Each robot looks for the best-matching name, and a less specific match is ignored. If the file does not mention this token and does mention coccocbot, this robot follows that group. This check reports that fallback and does not apply that fallback. This check matches the whole token. A non-200 response is treated as unrestricted access, and no response skips the site for a while. This check does not fetch. The guide says Crawl-delay is a whole number of seconds and a value above 10 is treated as 10. This check does not apply Crawl-delay.
searchobeys. The vendor says this crawler obeys robots.txt on automatic crawls.coccocbot-web and does mention coccocbot, the cited page says this crawler follows the coccocbot group. The checker reports follows_when_unmentioned and does not apply it to the RFC decision.Mozilla/5.0 (compatible; coccocbot-web/1.0; +http://help.coccoc.com/searchengine) The robot list at https://coccoc.com/search/console/coc-coc-robots publishes this HTTP user-agent. The string still cites http://help.coccoc.com/searchengine. On 2026-10-18 that host redirected to the search console. The version in the string is 1.0 on the list page, updated 2022-07-15. The same row also publishes coccocbot-web/1.0 (+http://help.coccoc.com/searchengine) and says that shorter string is used in some cases instead of the Mozilla string.curl -s https://whosthatbot.com/v1/crawlers/coccocbot-web
tools/call with name check_robots is the same check at POST /mcp. The pasted file disallows coccocbot-web on /docs and allows *. The call does not fetch a host.
curl -s https://whosthatbot.com/mcp -H 'content-type: application/json' -H 'accept: application/json, text/event-stream' -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"check_robots","arguments":{"robots_txt":"User-agent: coccocbot-web\nDisallow: /\n\nUser-agent: *\nAllow: /\n","path":"/docs","ids":["coccocbot-web"]}}}'
That call returns fetched_target false. This row is disallow via group coccocbot-web, rule Disallow: /. follows_when_unmentioned is coccocbot and is not the decision.