Crawl Policy Index

Look up

instagram.com

Any site on the 100,000 we watch. No account.

instagram.com

Social · United States · English

instagram.com blocks ChatGPT when a person asks. It still allows OpenAI's training crawler, Anthropic's training crawler, and 3 other AI crawlers.

This site also has a blanket rule: stay out, all bots.

  • GPTBot OpenAI's training crawler
    Open
  • ClaudeBot Anthropic's training crawler
    Open
  • Google-Extended Google's Gemini opt-out
    Open
  • PerplexityBot Perplexity's crawler
    Open
  • ChatGPT-User ChatGPT when a person asks
    Blocked
  • Googlebot Google Search
    Open
Other bots this site named
  • Applebot Apple
    Open
  • Applebot-Extended Apple
    Open
  • bingbot Microsoft
    Open
  • PetalBot Huawei
    Blocked

Want every site on the list, filters, and a file of today's table?

Subscribe · $49 / month