ICYMI: Cloudflare drops AI opt-outs from 118 sites' robots.txt, HasData finds: Of 592 sites declaring a GPTBot ban, 234 still served it a live page, while publishers turn away AI bots at 56.4%. Has enforcement moved from files to CDNs? https://ppc.land/cloudflare-drops-ai-opt-outs-from-118-sites-robots-txt-hasdata-finds/ #Cloudflare #AI #digitalmarketing #robots_txt #GPTBot
#robots_txt — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #robots_txt, aggregated by home.social.