TechCrunch
Cloudflare’s new policy pushes AI companies to pay for publishers’ content
Wednesday, July 1, 2026
Cloudflare announced a policy requiring AI companies to separate their web crawlers used for search indexing from those used for AI training by September 15. Companies that do not comply will be blocked by default on publisher sites using Cloudflare's platform. The policy applies to crawlers accessing content through Cloudflare's network. Cloudflare did not announce a payment requirement as part of the policy.
