coccocbotCốc Cốc's robots.txt guide says its robots support the robots exclusion protocol. The robot list at https://coccoc.com/search/console/coc-coc-robots calls coccocbot the common name for every Cốc Cốc robot and publishes this HTTP user-agent. Each robot looks for the best-matching name, and a less specific match is ignored. This token is that less specific name. It is not a prefix of coccocbot-web. The guide says the most specific Allow or Disallow wins, and equal length uses Allow. An empty Disallow allows every page, and an empty Allow is ignored. This check skips a blank Allow or Disallow, so an empty Disallow does not block the site. This check matches the whole token. A non-200 response is treated as unrestricted access, and no response skips the site for a while. This check does not fetch. The guide says Crawl-delay is a whole number of seconds and a value above 10 is treated as 10. This check does not apply Crawl-delay.
searchobeys. The vendor says this crawler obeys robots.txt on automatic crawls.Mozilla/5.0 (compatible; coccocbot/1.0; +http://help.coccoc.com/searchengine) The robot list at https://coccoc.com/search/console/coc-coc-robots publishes this HTTP user-agent. The string still cites http://help.coccoc.com/searchengine. On 2026-10-18 that host redirected to the search console. The version in the string is 1.0 on the list page, updated 2022-07-15.curl -s https://whosthatbot.com/v1/crawlers/coccocbot
tools/call with name check_robots is the same check at POST /mcp. The pasted file disallows coccocbot on /docs and allows *. The call does not fetch a host.
curl -s https://whosthatbot.com/mcp -H 'content-type: application/json' -H 'accept: application/json, text/event-stream' -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"check_robots","arguments":{"robots_txt":"User-agent: coccocbot\nDisallow: /\n\nUser-agent: *\nAllow: /\n","path":"/docs","ids":["coccocbot"]}}}'
That call returns fetched_target false. This row is disallow via group coccocbot, rule Disallow: /.