`CloudflareBrowserRenderingCrawler`

Cloudflare says Browser Run can crawl third-party websites on behalf of Cloudflare customers. It does not crawl your site as part of a Cloudflare service you have enabled. The Browser Run /crawl endpoint uses CloudflareBrowserRenderingCrawler/1.0. The page points to bot detection IDs and cryptographic verification for blocking that traffic, and does not say whether robots.txt controls this token. This check matches the whole token, so a group named Cloudflare or CloudflareBrowserRendering does not match, and it still reports the RFC 9309 decision.

robots.txt token: CloudflareBrowserRenderingCrawler
Operator: Cloudflare
Kind: user_fetch
robots.txt: not_stated. The cited page does not say whether robots.txt controls this token.
HTTP user-agent: CloudflareBrowserRenderingCrawler/1.0 The page prints CloudflareBrowserRenderingCrawler/1.0 as the user agent. The robots token is the product name without /1.0. It does not print a separate robots.txt User-agent line. A group named Cloudflare does not match this token. A group named CloudflareBrowserRendering does not match this token.
IP list: None on the cited page. The page does not publish an IP list. Botcard does not copy addresses.
Source: Cloudflare crawlers. Retrieved 2026-10-18, page says updated 2026-08-06.

JSON

curl -s https://whosthatbot.com/v1/crawlers/cloudflare-browser-rendering

Check this token

tools/call with name check_robots is the same check at POST /mcp. The pasted file disallows CloudflareBrowserRenderingCrawler on /docs and allows *. The call does not fetch a host.

curl -s https://whosthatbot.com/mcp -H 'content-type: application/json' -H 'accept: application/json, text/event-stream' -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"check_robots","arguments":{"robots_txt":"User-agent: CloudflareBrowserRenderingCrawler\nDisallow: /\n\nUser-agent: *\nAllow: /\n","path":"/docs","ids":["cloudflare-browser-rendering"]}}}'

That call returns fetched_target false. This row is disallow via group CloudflareBrowserRenderingCrawler, rule Disallow: /.