bingbotBing says Bingbot is the standard crawler and handles most crawling each day. The row title is Bingbot. The published strings contain bingbot/2.0. BingPreview's published strings on the same page also contain bingbot, so BingPreview is not a separate token. The help URL HTML is an application shell. The article was read from the help API that page loads, ArticleId 8c184ec0. The page says robots.txt files can be configured to tell Bing crawlers how to interact with the site. It does not say that this crawler obeys every directive. This check matches the whole token and still reports the RFC 9309 decision.
searchtells_how_to_interact. The vendor says a robots.txt file can be configured to tell this crawler how to interact with the site. The cited page does not say that the crawler obeys every directive.Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/W.X.Y.Z Safari/537.36 The row title is Bingbot. The page also prints Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) and then W.X.Y.Z Safari/537.36 on the next line. The mobile string is Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm). W.X.Y.Z is the page's placeholder for the latest Microsoft Edge version, for example 80.0.345.0. The page does not print a separate robots.txt User-agent line. BingPreview's strings on this page contain bingbot, so BingPreview is not this card.curl -s https://whosthatbot.com/v1/crawlers/bingbot
tools/call with name check_robots is the same check at POST /mcp. The pasted file disallows bingbot on /docs and allows *. The call does not fetch a host.
curl -s https://whosthatbot.com/mcp -H 'content-type: application/json' -H 'accept: application/json, text/event-stream' -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"check_robots","arguments":{"robots_txt":"User-agent: bingbot\nDisallow: /\n\nUser-agent: *\nAllow: /\n","path":"/docs","ids":["bingbot"]}}}'
That call returns fetched_target false. This row is disallow via group bingbot, rule Disallow: /.