Cloudflare now blocks AI training bots on ad pages for new sites
Starting September 15, 2026, domains newly added to Cloudflare block AI training bots and AI agent bots by default on pages that show ads. Search bots are still allowed by default, but crawlers that combine search with training, such as Googlebot, Applebot and Bingbot, are handled by their most restrictive purpose, so the training block applies to them. Cloudflare announced the change in a July 1 blog post.