Cloudflare launches tool to block AI training but keep search
Cloudflare introduced a tool that blocks data collection for AI training without affecting search crawlers. According to the company, mixed crawlers make up 36.6% of verified crawler traffic on its network.
- Tool blocks AI training while preserving search engine access
- Mixed crawlers are 36.6% of verified traffic in Cloudflare's network
- Solution separates crawler purposes: AI training and search indexing
Read next
Software