2 Replies. 1 pages. Viewing page 1.
Newer [  1  ] Older
2.
 
Re: AI Scraping
Jul 8, 2024, 10:32
2.
Re: AI Scraping Jul 8, 2024, 10:32
Jul 8, 2024, 10:32
 
We don't use CloudFlare, but it was an interesting read - thanks.
-- Frans
Avatar 1258
1.
 
AI Scraping
Jul 4, 2024, 14:46
1.
AI Scraping Jul 4, 2024, 14:46
Jul 4, 2024, 14:46
 
ZenAbra wrote on Jul 4, 2024, 14:32:
Hey Blue: I know you've expressed frustration with the AI scrapers ignoring your robots.txt.

Did you see this new, free tool from CloudFlare? It's designed to block all the AI scrapers.

Declaring Your AIndependence

I haven't implemented it myself yet (but I'll give it a go today). But I use CloudFlare extensively, and the tools and services they provide for free are pretty useful and dependable.

I'm responding here because of your "too busy stealing learning" bit.
from here
“We’ve arranged a society on science and technology in which nobody understands anything about science and technology, and this combustible mixture of ignorance and power sooner or later is going to blow up in our faces." Carl Sagan
Avatar 58135
2 Replies. 1 pages. Viewing page 1.
Newer [  1  ] Older