#crawlersia — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #crawlersia, aggregated by home.social.
-
Comment bloquer les crawlers IA qui pillent votre site sans vous demander la permission ?
https://fed.brid.gy/r/https://korben.info/bloquer-crawlers-ia-robots-txt-htaccess-nginx.html