Cloudflare sets a September 15 deadline for AI companies to differentiate their web crawlers into search, AI training, and AI agents or face being blocked (Samantha Elkins/NBC News)
Cloudflare is forcing AI crawlers to declare use cases, raising access friction for training data and agent traffic across the web.
Excerpt
<a href="https://www.nbcnews.com/tech/tech-news/cloudflare-sets-ai-crawler-deadline-separate-search-blocked-rcna352446"><img align="RIGHT" border="0" hspace="4" src="http://www.techmeme.com/260702/i13.jpg" vspace="4" /></a>
<p><a href="https://www.techmeme.com/260702/p13#a260702p13" title="Techmeme permalink"><img height="12" src="http://www.techmeme.com/img/pml.png" style="border: none; padding: 0; margin: 0;" width="11" /></a> Samantha Elkins / <a href="http://www.nbcnews.com/">NBC News</a>:<br />
<span style="font-size: 1.3em;"><b><a href="https://www.nbcnews.com/tech/tech-news/cloudflare-sets-ai-crawler-deadline-separate-search-blocked-rcna352446">Cloudflare sets a September 15 deadline for AI companies to differentiate their web crawlers into search, AI training, and AI agents or face being blocked</a></b></span> — Cloudflare gave AI crawlers a September deadline to separate the bots that gather content for search from those that harvest … </p>
Read at source: https://www.techmeme.com/260702/p13#a260702p13