Amazon · Search indexes
Amzn-SearchBot
Amazon’s crawler for making content eligible in Amazon search experiences. Blocking it hides you from those surfaces even if Amazonbot still trains.
- Operator
- Amazon
- Traffic type
- Search indexes
- Verification
- Not independently verifiable
- robots.txt
- Usually honors robots.txt
Usually means: Crawlers that build the indexes ChatGPT search, Claude search, Perplexity, Google, and Bing draw from. Blocking them is how brands disappear from AI answers without noticing.
User-agent
robots.txt and most WAF rules match the token, not the full Mozilla string. Operators often wrap Amzn-SearchBot in extra product or version text.
Amzn-SearchBot
What Amzn-SearchBot does
Amzn-SearchBot discovers pages for Amazon search products. Amazonbot is the broader improvement crawl; Amzn-User is the live fetch.
How to get discovered
Allow Amzn-SearchBot on public catalog, docs, and editorial URLs. Keep titles, prices, and specs in HTML rather than only in JSON fetched after hydration.
Why Amzn-SearchBot might skip you
Storefronts that 403 unknown bots, or robots Disallow on / collections that Amazon search would otherwise use.
robots.txt rule
Allow this token on public pages you want retrieved or cited. A CDN “Block AI bots” toggle can still 403 it after robots.txt says Allow.
# Keep Amzn-SearchBot eligible to fetch this site
User-agent: Amzn-SearchBot
Allow: /Amazon has not published a machine-readable range file for this token. Do not treat the user-agent alone as proof of identity.
JavaScript: render behavior is not documented.
Other Amazon bots
Training, search, and user-fetch tokens from the same operator are not interchangeable. Allow the discovery path even when you opt out of training.
Amzn-SearchBot FAQ
What is Amzn-SearchBot?
Amzn-SearchBot discovers pages for Amazon search products. Amazonbot is the broader improvement crawl; Amzn-User is the live fetch.
Should I allow Amzn-SearchBot in robots.txt?
Yes if you want Amazon to be able to fetch and cite this site. Blocking Amzn-SearchBot is how pages stay invisible to that product even when Googlebot still crawls them.
How do I know a request is really Amzn-SearchBot?
Amazon has not published a range file for this token. Treat the user-agent as a claimed identity, and do not build a hard IP allowlist from blog posts or screenshots.
Letting Amzn-SearchBot in is the start. Getting cited is the job.
Rankealo checks whether AI crawlers can reach you, then publishes pages built to be retrieved and quoted in ChatGPT, Claude, Perplexity, and Gemini.
