#crawlerblockers — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #crawlerblockers, aggregated by home.social.
-
#AIbrowsers like #OpenAI’s #Atlas and #Perplexity’s #Comet present challenges for media companies trying to limit AI access. These browsers, with their “agentic capabilities,” can bypass #paywalls and #crawlerblockers, making it difficult for #publishers to control how their content is used. Even when blocked, these #AIagents can reconstruct articles using information from other sources, raising concerns about #copyright infringement. https://www.cjr.org/analysis/how-ai-browsers-sneak-past-blockers-and-paywalls.php?AIagents.at #AIagent #AI #ML #NLP #LLM #GenAI