How to block AI scraper bots to crawl your website?

To block AI scraper bots from crawling your website simplest way is to add the below crawler bots in your robots.txt file.

Robots.txt file code

User-agent: *
Disallow: Amazonbot
Disallow: Bytespider
Disallow: ChatGPT-User
Disallow: OAI-SearchBot
Disallow: GPTBot
Disallow: ClaudeBot
Disallow: PerplexityBot
Disallow: CCBot

Leave a Comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.