Mistral · Search indexes
MistralAI-Index
Mistral’s search/index crawler. This is how pages become eligible for Mistral search-style answers, not the live user fetch.
- Operator
- Mistral
- Traffic type
- Search indexes
- Verification
- Not independently verifiable
- robots.txt
- Usually honors robots.txt
Usually means: Crawlers that build the indexes ChatGPT search, Claude search, Perplexity, Google, and Bing draw from. Blocking them is how brands disappear from AI answers without noticing.
User-agent
robots.txt and most WAF rules match the token, not the full Mozilla string. Operators often wrap MistralAI-Index in extra product or version text.
MistralAI-Index
What MistralAI-Index does
MistralAI-Index discovers and refreshes content for Mistral’s answer index. MistralAI-User is the on-demand twin.
How to get discovered
Allow MistralAI-Index, list important URLs in a sitemap, and keep article HTML server-rendered.
Why MistralAI-Index might skip you
Unknown-UA blocks, or robots files that only allow OpenAI/Anthropic/Perplexity and never Mistral.
robots.txt rule
Allow this token on public pages you want retrieved or cited. A CDN “Block AI bots” toggle can still 403 it after robots.txt says Allow.
# Keep MistralAI-Index eligible to fetch this site
User-agent: MistralAI-Index
Allow: /Mistral has not published a machine-readable range file for this token. Do not treat the user-agent alone as proof of identity.
JavaScript: reads raw HTML only.
Other Mistral bots
Training, search, and user-fetch tokens from the same operator are not interchangeable. Allow the discovery path even when you opt out of training.
MistralAI-Index FAQ
What is MistralAI-Index?
MistralAI-Index discovers and refreshes content for Mistral’s answer index. MistralAI-User is the on-demand twin.
Should I allow MistralAI-Index in robots.txt?
Yes if you want Mistral to be able to fetch and cite this site. Blocking MistralAI-Index is how pages stay invisible to that product even when Googlebot still crawls them.
How do I know a request is really MistralAI-Index?
Mistral has not published a range file for this token. Treat the user-agent as a claimed identity, and do not build a hard IP allowlist from blog posts or screenshots.
Letting MistralAI-Index in is the start. Getting cited is the job.
Rankealo checks whether AI crawlers can reach you, then publishes pages built to be retrieved and quoted in ChatGPT, Claude, Perplexity, and Gemini.
