home.social

#scrapers — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #scrapers, aggregated by home.social.

  1. RSS Amplifier Re-Publishes 19 Full NLJ Articles Without Permission

    A PSA about a new scraping service for AI crawlers that syndicated (charitably) or re-published (less charitably) 19 New Leaf Journal articles without permission, before I identified the issue.

    thenewleafjournal.com/rss-ampl

    #Scrapers #Bots #RSSAmplifier #FullTextFeeds #LLM

  2. I specialize in software performance and scalability.

    To date I'm aware of about 150 techniques and patterns for achieving that. They are all in my own toolbox. (I hope?)

    One of them... is request throttling.

    #Twitter
    #performance
    #scalability
    #scaling
    #scale
    #scraping
    #scrapers
    #spiders
    #bots
    #programming
    #software
    #DDoS
    #SRE
    #Internet
    #DistributedSystems
    #HPC
    #web
    #throttling
    #RateLimits