#webscale — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #webscale, aggregated by home.social.
-
What are your favorite / the best #WebCrawlers for broad / #WebScale #crawling?
I've built a list but am looking for anything I missed: https://github.com/davidshq/awesome-search-engines/blob/main/WebCrawlers.md
Main options I've found include #Apache #Nutch, #StormCrawler, #Scrapy, #Norconex, #PulsarR, #Heritrix, and #sparkler
-
Which is why I'd now like to introduce you to my newest and most unholy of projects...
BlortMail™!!!It's the Rusian roulette of mail servers! Did it send? Was it to your ex-girlfriend or your boss? You'll never know, and that's half the fun! (The other half is configuring this ungodly abomination!) Coming soon to an enterprise #webscale #blockchain #cloudfirst deployment near YOU!
With love... from BlortCo™!