Decide what AI crawlers can read on your site. Set robots.txt rules per crawler type: training, search or live fetchers. Verify crawlers by published IP ranges. Charge for access with HTTP 402 or sell agent keys. Private Access Tokens offer another option. https://attestos-edge.attestos.workers.dev/go/pricing?src=u-promo-plans-publisher
ContentAccessControl
CrawlerVerification
PaidCrawlingModels
#aicrawlers — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #aicrawlers, aggregated by home.social.