YandexFeedYandex says YandexFeed downloads structured data via links that website owners submitted to Yandex services and does not make indexing requests. The robot list says it does not take the general rules in robots.txt into account. The robot list says an agreement between Yandex and the site owner can override some robots.txt restrictions. This check does not apply that agreement.
owner_requestedignores_star. The vendor says this robot does not take the general User-agent: * rules in robots.txt into account.Mozilla/5.0 (compatible; YandexFeed/1.0; +http://yandex.com/bots) The table publishes this string.curl -s https://whosthatbot.com/v1/crawlers/yandexfeed
tools/call with name check_robots is the same check at POST /mcp. The pasted file disallows YandexFeed on /docs and allows *. The call does not fetch a host.
curl -s https://whosthatbot.com/mcp -H 'content-type: application/json' -H 'accept: application/json, text/event-stream' -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"check_robots","arguments":{"robots_txt":"User-agent: YandexFeed\nDisallow: /\n\nUser-agent: *\nAllow: /\n","path":"/docs","ids":["yandexfeed"]}}}'
That call returns fetched_target false. This row is disallow via group YandexFeed, rule Disallow: /.