reddit.com
reddit.com told every crawler to stay out.
This site also has a blanket rule: stay out, all bots.
- GPTBot OpenAI's training crawlerBlocked
- ClaudeBot Anthropic's training crawlerBlocked
- Google-Extended Google's Gemini opt-outBlocked
- PerplexityBot Perplexity's crawlerBlocked
- ChatGPT-User ChatGPT when a person asksBlocked
- Googlebot Google SearchBlocked