DeepSeek · Training crawlers
DeepSeekBot
DeepSeek’s public-content crawler. DeepSeek’s chat product does not ship a first-party web search bot comparable to OAI-SearchBot.
- Operator
- DeepSeek
- Traffic type
- Training crawlers
- Verification
- Not independently verifiable
- robots.txt
- Compliance not documented
Usually means: Bots that collect public pages for future models. Blocking them opts you out of training. It does not, by itself, remove you from live AI search citations.
User-agent
robots.txt and most WAF rules match the token, not the full Mozilla string. Operators often wrap DeepSeekBot in extra product or version text.
DeepSeekBot
What DeepSeekBot does
DeepSeekBot collects public pages for DeepSeek models. Rankealo still measures DeepSeek as an ungrounded engine — training crawls and live citations are not the same system.
How to get discovered
There is no DeepSeek search-index token to “allow for citations” the way PerplexityBot works. Visibility in DeepSeek answers is mostly model memory plus whatever grounding they add later.
Why DeepSeekBot might skip you
Unknown-UA WAF, intentional Disallow, or the bot simply not prioritizing your site.
robots.txt rule
This snippet opts out of training-style collection. Keep the search and user-fetch tokens from the same operator allowed if you still want citations.
# Optional training opt-out — does not remove you from AI search by itself
User-agent: DeepSeekBot
Disallow: /DeepSeek has not published a machine-readable range file for this token. Do not treat the user-agent alone as proof of identity.
JavaScript: reads raw HTML only.
DeepSeekBot FAQ
What is DeepSeekBot?
DeepSeekBot collects public pages for DeepSeek models. Rankealo still measures DeepSeek as an ungrounded engine — training crawls and live citations are not the same system.
Should I allow DeepSeekBot in robots.txt?
Only if you want to opt out of training-style collection. Blocking DeepSeekBot does not, by itself, remove you from live AI search citations — those use the search and user-fetch tokens from DeepSeek.
How do I know a request is really DeepSeekBot?
DeepSeek has not published a range file for this token. Treat the user-agent as a claimed identity, and do not build a hard IP allowlist from blog posts or screenshots.
Letting DeepSeekBot in is the start. Getting cited is the job.
Rankealo checks whether AI crawlers can reach you, then publishes pages built to be retrieved and quoted in ChatGPT, Claude, Perplexity, and Gemini.
