Cloudflare and OpenAI pilot signals to improve AI discovery of web pages

Cloudflare and OpenAI launched a research pilot in July 2026 using signals from about 1% of Cloudflare's network to help ChatGPT's search crawler find new pages. The pilot has enabled OpenAI to discover and index hundreds of millions of new web pages.

Cloudflare says its filtering and change signals keep crawlers away from nonexistent or redirected pages and reduce unnecessary load on site owners.