Look up

1flex.org

Any site on the 100,000 we watch. No account.

1flex.org

English

1flex.org blocks OpenAI's training crawler, Anthropic's training crawler, and Google's Gemini opt-out. It still allows Perplexity's crawler, ChatGPT when a person asks, and Google Search.

GPTBot OpenAI's training crawler
Blocked
ClaudeBot Anthropic's training crawler
Blocked
Google-Extended Google's Gemini opt-out
Blocked
PerplexityBot Perplexity's crawler
Open
ChatGPT-User ChatGPT when a person asks
Open
Googlebot Google Search
Open

Other bots this site named

Applebot-Extended Apple
Blocked
CCBot Common Crawl
Blocked
Google-CloudVertexBot Google
Blocked
meta-externalagent Meta
Blocked
PetalBot Huawei
Blocked

Want every site on the list, filters, and a file of today's table?

Subscribe · $49 / month