Look up

amazon.com

Any site on the 100,000 we watch. No account.

amazon.com

Shop · United States · English

amazon.com blocks OpenAI's training crawler, Anthropic's training crawler, and 3 other AI crawlers. It still allows Google Search.

GPTBot OpenAI's training crawler
Blocked
ClaudeBot Anthropic's training crawler
Blocked
Google-Extended Google's Gemini opt-out
Blocked
PerplexityBot Perplexity's crawler
Blocked
ChatGPT-User ChatGPT when a person asks
Blocked
Googlebot Google Search
Open

Other bots this site named

AI2Bot Allen Institute for AI
Blocked
CCBot Common Crawl
Blocked
Claude-SearchBot Anthropic
Blocked
Claude-User Anthropic
Blocked
Google-CloudVertexBot Google
Blocked
meta-externalagent Meta
Blocked
meta-externalfetcher Meta
Blocked
MistralAI-User Mistral
Blocked
OAI-SearchBot OpenAI
Blocked
Perplexity-User Perplexity
Blocked
PetalBot Huawei
Blocked
Webzio-Extended Webz.io
Blocked

Want every site on the list, filters, and a file of today's table?

Subscribe · $49 / month