How to BLOCK Generative AI

Thanks! Share it with your friends!

You disliked this video. Thanks for the feedback!

Added 4 months ago by admin

15 Views

Here's how to block generative AI from learning from your stuff.

Add…

User-agent: GPTBot
Disallow: /

to the robots.txt file of your website.

The robots.txt file tells crawlers how to interact with your content.

User-agent specifies the crawler.

Disallow specifies what you don't want the crawler to crawl.

It could be a certain subfolder on your site, it could be a specific page, it could be anything.

Gemini uses Google-extended as its user-agent.

Claude is Claudebot and Claude-web.

There's lots of reasons why you wouldn't want AI crawlers going through your stuff.

Claudebot has been known to clog servers.

One guy said, “Claudebot is the worst thing ever. Block, block, block.”

You may also have private things, or paid studies, or your art, or just anything you don't want LLMs to learn from.

#openai #digitalmarketing #marketingstrategy

Category: Artificial Intelligence & Business

Post your comment

Comments

Be the first to comment

Sign in

Create your account

How to BLOCK Generative AI

Post your comment

Comments

Up Next