`Googlebot-Video`

Google says preferences for Googlebot-Video affect video-related Google Search features and other products that depend on videos. The page also lists Googlebot as a robots.txt token and says matching one of a crawler's tokens is enough. This check matches the whole token, so a group named Googlebot does not match Googlebot-Video, and still reports the RFC 9309 decision. Common crawlers obey robots.txt on automatic crawls.

robots.txt token: Googlebot-Video
Operator: Google
Kind: search
robots.txt: obeys. The vendor says this crawler obeys robots.txt on automatic crawls.
Also matches: Googlebot. Google says one matching token is enough.
HTTP user-agent: Googlebot-Video/1.0 The page prints this string as the HTTP user agent. It does not print a longer browser string. The robots.txt tokens on this row are Googlebot-Video and Googlebot. A group named Googlebot does not match this token.
IP list: https://developers.google.com/static/crawling/ipranges/common-crawlers.json The common crawlers page says these crawlers generally crawl from this list, and that a user-agent string can be spoofed. Verify with reverse DNS before trusting an IP. The page's hostname mask is crawl-***-***-***-***.googlebot.com or geo-crawl-***-***-***-***.geo.googlebot.com. URL returned HTTP 200 on 2026-10-18. Botcard does not copy the list.
Source: List of Google's common crawlers. Retrieved 2026-10-18, page says updated 2026-10-15. CC BY 4.0 (Google Developers page, except as that page notes).

JSON

curl -s https://whosthatbot.com/v1/crawlers/googlebot-video

Check this token

tools/call with name check_robots is the same check at POST /mcp. The pasted file disallows Googlebot-Video on /docs and allows *. The call does not fetch a host.

curl -s https://whosthatbot.com/mcp -H 'content-type: application/json' -H 'accept: application/json, text/event-stream' -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"check_robots","arguments":{"robots_txt":"User-agent: Googlebot-Video\nDisallow: /\n\nUser-agent: *\nAllow: /\n","path":"/docs","ids":["googlebot-video"]}}}'

That call returns fetched_target false. This row is disallow via group Googlebot-Video, rule Disallow: /. also_matches_tokens lists Googlebot and is not merged into this decision.