MistralAI-IndexMistral says MistralAI-Index automatically crawls the web for indexing only, so Mistral search can help answer questions in Vibe. Mistral says that content is not used for generative AI training of any kind. The page lists this token as a robots.txt tag and does not say that the crawler obeys the file or that a Disallow stops indexing. MistralAI-User and MistralAI-Training are different tokens.
searchpublished_tag. The vendor publishes this as a robots.txt tag and does not say whether the crawler obeys the file.Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Index/1.0; +https://docs.mistral.ai/robots) Mistral publishes this as the full user-agent string.curl -s https://whosthatbot.com/v1/crawlers/mistralai-index
tools/call with name check_robots is the same check at POST /mcp. The pasted file disallows MistralAI-Index on /docs and allows *. The call does not fetch a host.
curl -s https://whosthatbot.com/mcp -H 'content-type: application/json' -H 'accept: application/json, text/event-stream' -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"check_robots","arguments":{"robots_txt":"User-agent: MistralAI-Index\nDisallow: /\n\nUser-agent: *\nAllow: /\n","path":"/docs","ids":["mistralai-index"]}}}'
That call returns fetched_target false. This row is disallow via group MistralAI-Index, rule Disallow: /.