Amazonbot: what it is and how to control it
Amazonbot is Amazon's web crawler, used to improve Amazon products and services, and Amazon says its content may be used to train Amazon AI models. Its robots.txt token is Amazonbot. Blocking it opts your site out of that crawl. Amazon runs separate agents, Amzn-SearchBot for search and Amzn-User for live user requests, with their own tokens.
| Operator | Amazon, for Alexa and other Amazon services |
|---|---|
| Purpose | AI training |
| robots.txt token | Amazonbot |
| User agent | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1) Chrome/W.X.Y.Z Safari/537.36 |
| Follows robots.txt | Yes. Amazon states Amazonbot respects the Robots Exclusion Protocol, checks robots.txt per host, may use a copy up to 30 days old and does not support crawl-delay. |
| Runs JavaScript | Not documented |
| IP ranges | Published list |
| Documentation | Amazon |
What Amazonbot does
Amazonbot is Amazon's general web crawler. Amazon says it is used to improve Amazon products and services and that the content it collects may be used to train Amazon AI models. Amazon documents two separate agents on the same page: Amzn-SearchBot, which supports search experiences such as Alexa and does not crawl for generative AI training, and Amzn-User, which fetches live pages for user requests.
Should you block Amazonbot?
Treat Amazonbot as a training crawler and decide on policy, while allowing Amzn-SearchBot if you want to appear in Alexa answers. Amazon documents that the content may be used to train its AI models, so a Disallow for Amazonbot opts out of that crawl. Amazon does not describe any other effect; Amzn-SearchBot is controlled by its own token, and allowing it makes content eligible to appear in Amazon search experiences.
User-agent: Amazonbot
Disallow: /User-agent: Amazonbot
Allow: /Rules that apply
- Rule 02: Treat training bots and search bots as separate robots.txt decisions
- Rule 01: Allow OAI-SearchBot, PerplexityBot and Claude-SearchBot in robots.txt if you want AI citations
- Rule 11: Don't rely on robots.txt to stop ChatGPT-User or Perplexity-User; they fetch on a user's behalf
- Rule 03: Audit your CDN and WAF bot settings; they can block AI crawlers that robots.txt allows
Questions
What is Amazonbot?
Amazonbot is Amazon's general web crawler. Amazon says it improves Amazon products and services and that collected content may be used to train Amazon AI models.
Does Amazonbot respect robots.txt?
Yes. Amazon states that Amazonbot respects the Robots Exclusion Protocol. It checks robots.txt at the host level, may use a cached copy up to 30 days old, and does not support crawl-delay.
What is the Amazonbot user agent?
Amazon documents it as Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1) Chrome/W.X.Y.Z Safari/537.36, where W.X.Y.Z is a Chrome version placeholder. Amazon publishes an IP address list to verify it.
Should I block Amazonbot?
That is a policy choice. Blocking Amazonbot opts out of Amazon's general crawl and AI model training use. Amzn-SearchBot is separate and makes content eligible for Amazon search experiences such as Alexa.
Sources
- Amazon Web Search Crawlers (Amazonbot) · Amazon, Oct 26, 2026
- Amazonbot IP addresses · Amazon
Checked against the operators' documentation every Monday. Last reviewed Nov 2, 2026.