# AdsBot-Google

Google's special-case crawlers page names AdsBot-Google as the robots.txt token for AdsBot. The page says AdsBot ignores the global robots.txt user agent (*) with the ad publisher's permission. Crawling preferences for this token affect Google Ads' ability to check web page ad quality. This check does not treat AdsBot-Google as a prefix of AdsBot-Google-Mobile. This check matches the whole token and still reports the RFC 9309 decision.

- Operator: Google
- Kind: ads_check
- robots.txt: ignores_star. The vendor says this robot does not take the general User-agent: * rules in robots.txt into account.
- HTTP user-agent: AdsBot-Google (+http://www.google.com/adsbot.html) The page prints this string as the HTTP user agent. The robots.txt token is AdsBot-Google. AdsBot-Google-Mobile is a different token.
- IP list: https://developers.google.com/static/crawling/ipranges/special-crawlers.json
- Source: https://developers.google.com/crawling/docs/crawlers-fetchers/google-special-case-crawlers (retrieved 2026-10-18)

## JSON

`curl -s https://whosthatbot.com/v1/crawlers/adsbot-google`

## Check this token

tools/call with name check_robots is the same check at https://whosthatbot.com/mcp. Send `Content-Type: application/json` and `Accept: application/json, text/event-stream`. The pasted file disallows AdsBot-Google on `/docs` and allows `*`. The call does not fetch a host.

```
curl -s https://whosthatbot.com/mcp -H 'content-type: application/json' -H 'accept: application/json, text/event-stream' -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"check_robots","arguments":{"robots_txt":"User-agent: AdsBot-Google\nDisallow: /\n\nUser-agent: *\nAllow: /\n","path":"/docs","ids":["adsbot-google"]}}}'
```

That call returns fetched_target false. This row is disallow via group AdsBot-Google, rule Disallow: /.

Each card paraphrases the linked vendor page and was checked on source.retrieved. This is not legal advice. robots.txt is a request from the site owner. Botcard does not fetch third-party sites and does not suggest ways around a disallow rule.