`GPTBot`

OpenAI says GPTBot crawls content that may be used to train generative AI foundation models. Disallowing GPTBot means the site's content should not be used for that training. OpenAI says this setting is independent of OAI-SearchBot.

robots.txt token: GPTBot
Operator: OpenAI
Kind: training
robots.txt: disallow_is_opt_out. The vendor says disallowing this token opts that use out.
HTTP user-agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.4; +https://openai.com/gptbot OpenAI calls this an example. The version number may change. A robots.txt fetch may add a robots.txt marker to the string.
IP list: https://openai.com/gptbot.json URL returned HTTP 200 on 2026-10-17. Botcard does not copy the address list.
Source: Overview of OpenAI Crawlers. Retrieved 2026-10-17.

JSON

curl -s https://whosthatbot.com/v1/crawlers/gptbot

Check this token

tools/call with name check_robots is the same check at POST /mcp. The pasted file disallows GPTBot on /docs and allows *. The call does not fetch a host.

curl -s https://whosthatbot.com/mcp -H 'content-type: application/json' -H 'accept: application/json, text/event-stream' -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"check_robots","arguments":{"robots_txt":"User-agent: GPTBot\nDisallow: /\n\nUser-agent: *\nAllow: /\n","path":"/docs","ids":["gptbot"]}}}'

That call returns fetched_target false. This row is disallow via group GPTBot, rule Disallow: /.