github.com
github.com is open to the main AI crawlers.
- GPTBot OpenAI's training crawlerOpen
- ClaudeBot Anthropic's training crawlerOpen
- Google-Extended Google's Gemini opt-outOpen
- PerplexityBot Perplexity's crawlerOpen
- ChatGPT-User ChatGPT when a person asksOpen
- Googlebot Google SearchOpen
Other bots this site named
- bingbot MicrosoftOpen
- OAI-SearchBot OpenAIOpen