YandexVerticalsYandex says YandexVerticals is the robot of Yandex Verticals (Classifieds): Auto.ru, Yandex Realty, Yandex Jobs, and Yandex Reviews, and that it takes the general rules in robots.txt into account. YandexVertis is a different token. The robot list says an agreement between Yandex and the site owner can override some robots.txt restrictions. This check does not apply that agreement.
searchobeys. The vendor says this crawler obeys robots.txt on automatic crawls.Mozilla/5.0 (compatible; YandexVerticals/1.0; +http://yandex.com/bots) The table publishes this string. YandexVertis is a different token on the previous row.curl -s https://whosthatbot.com/v1/crawlers/yandexverticals
tools/call with name check_robots is the same check at POST /mcp. The pasted file disallows YandexVerticals on /docs and allows *. The call does not fetch a host.
curl -s https://whosthatbot.com/mcp -H 'content-type: application/json' -H 'accept: application/json, text/event-stream' -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"check_robots","arguments":{"robots_txt":"User-agent: YandexVerticals\nDisallow: /\n\nUser-agent: *\nAllow: /\n","path":"/docs","ids":["yandexverticals"]}}}'
That call returns fetched_target false. This row is disallow via group YandexVerticals, rule Disallow: /.