Cloudflare Lets Sites Ask Google to Skip AI Training Without Blocking Search

Cloudflare launched a Disallow AI Training setting on September 15 that lets site owners tell Google and Apple not to use their pages for AI training while keeping search crawlers visiting. Bing does not yet receive a no-training instruction; Cloudflare targets early 2027 for that support.

• The setting publishes a no-training rule in the site's robots.txt file
• Google and Apple search crawlers keep fetching pages
• Bing no-training support is targeted for early 2027
• Cloudflare's Pay Per Crawl remains in private beta