Story perspectives

Cloudflare Launches AI Scraper Block, 1M Sites Join

7/2/2025

50 3

Summary

Story summary

Cloudflare has upgraded its tools to automatically block AI scrapers for customers and launched a Pay Per Crawl program.
AI web crawlers risk overwhelming servers, raising concerns among publishers about unauthorized content scraping.
Over 1 million websites have activated Cloudflare's AI-bot-blocking tools, with many more expected to join.
This development may enable publishers to negotiate improved agreements with AI companies regarding content usage.
Users can choose to allow scrapers, as Cloudflare's blocking feature remains optional.

1 of 1

Story summary

Cloudflare has upgraded its tools to automatically block AI scrapers for customers and launched a Pay Per Crawl program.
AI web crawlers risk overwhelming servers, raising concerns among publishers about unauthorized content scraping.
Over 1 million websites have activated Cloudflare's AI-bot-blocking tools, with many more expected to join.
This development may enable publishers to negotiate improved agreements with AI companies regarding content usage.
Users can choose to allow scrapers, as Cloudflare's blocking feature remains optional.