Botcard · All tokens

GoogleProducer

Google says Google Publisher Center fetches and processes feeds that publishers explicitly supplied for use in Google News landing pages. The user-triggered fetchers section says these fetchers generally ignore robots.txt rules because a user requested the fetch. The page does not print a separate robots.txt User-agent line. This check matches the whole token and still reports the RFC 9309 decision.

robots.txt token
GoogleProducer
Operator
Google
Kind
owner_requested
robots.txt
generally_ignores. The vendor says this fetcher generally ignores robots.txt, because a person requested the fetch.
HTTP user-agent
GoogleProducer; (+https://developers.google.com/search/docs/crawling-indexing/google-producer) The page prints this HTTP string. The product token is GoogleProducer. It does not print a separate robots.txt User-agent line.
IP list
None on the cited page. The user-triggered fetchers section names https://developers.google.com/static/crawling/ipranges/user-triggered-fetchers.json (creationTime 2026-10-16T14:46:09.000000), https://developers.google.com/static/crawling/ipranges/user-triggered-fetchers-google.json (creationTime 2026-10-16T14:46:08.000000), and https://developers.google.com/static/crawling/ipranges/user-triggered-agents.json (creationTime 2026-10-16T14:46:09.000000), and does not say which file this fetcher uses. Each URL returned HTTP 200 on 2026-10-18. Botcard does not copy the prefixes. The page says the reverse DNS mask matches ***-***-***-***.gae.googleusercontent.com when Google owns the fetcher, or google-proxy-***-***-***-***.google.com when a user owns it. A user-agent string can be spoofed.
Source
List of Google user-triggered fetchers. Retrieved 2026-10-18, page says updated 2026-08-19. CC BY 4.0 (Google Developers page, except as that page notes).

JSON

curl -s https://whosthatbot.com/v1/crawlers/google-producer

Check this token

tools/call with name check_robots is the same check at POST /mcp. The pasted file disallows GoogleProducer on /docs and allows *. The call does not fetch a host.

curl -s https://whosthatbot.com/mcp -H 'content-type: application/json' -H 'accept: application/json, text/event-stream' -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"check_robots","arguments":{"robots_txt":"User-agent: GoogleProducer\nDisallow: /\n\nUser-agent: *\nAllow: /\n","path":"/docs","ids":["google-producer"]}}}'

That call returns fetched_target false. This row is disallow via group GoogleProducer, rule Disallow: /.