home.social

#botblocker — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #botblocker, aggregated by home.social.

fetched live
  1. I guess, I had that coming: yesterday, my monitoring showed, that the RSS feed for one of my #Mastodon bots didn't work. Upon closer inspection, I saw, that they had installed a #JavaScript based #botblocker that prevented me from scraping the page. I called them, explained the situation and asked, if they might put my server on the whitelist. I basically got my ass kicked, being told that they can't and won't (!) add my to a whitelist, that they don't plan to use Mastodon in the future and that their cybersecurity is more important than some third-party service. They further said, that people who don't want to use Meta products can visit the website to stay informed. I felt pretty hurt ... until I managed to reverse engineer what the thing actually does and incorporate it in my feed script.

    I guess, I shouldn't be bragging about this, but I lack people to tell about it, who understand and care, maybe a few of you do at least one of the two?

  2. Semrush ist eines der bekanntesten SEO-Analyse-Tools auf dem Markt. Es durchsucht Websites regelmäßig mit seinem Bot (SemrushBot), um Daten wie Keywords, Backlinks, Rankings und vieles mehr von deiner Website zu erfassen und zu analysieren. Hier sind 5 effektive, schnell umzusetzende Methoden, wie du Semrush von deiner Website aussperren kannst. 👇

    teufelswerk.net/semrushbot-blo

    #SEO #semrush #botblocker #bots #website #websecurity #cybersecurity #wordpress #joomla #typo3 #nginx #robotstxt #htaccess