Cloudflare and OpenAI pilot indexes hundreds of millions of new pages
Cloudflare and OpenAI shared early results from a July 2026 research pilot: signals from Cloudflare's network helped OpenAI discover and index hundreds of millions of new web pages for ChatGPT. The test used a cohort of about 1% of Cloudflare's network, with change signals and filtering aimed at cutting unnecessary crawler load.
- Pilot covered about 1% of Cloudflare's network
- OpenAI indexed hundreds of millions of new pages
- Change signals reduce unnecessary crawler fetches
- Metadata is used for search, not model training
Read next
AI