home.social

#scrapingbots — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #scrapingbots, aggregated by home.social.

  1. Santiago :arandela: @[email protected] ·

    Nuestra instancia de PeerTube esta siendo bombardeada por bots haciendo scraping y haciendo requests de transcodificado de video. Afortunadamente estoy terminando de pulir un script que les hace sonar el orto cuando detecta varias cosas que los delatan... Por suerte el server se la banca bastante... ampliaremos... #peertube #bots #scraping #scrapingbots #ddos

    #peertube #bots #scraping #scrapingbots #ddos
  2. Santiago :arandela: @[email protected] ·

    Nuestra instancia de PeerTube esta siendo bombardeada por bots haciendo scraping y haciendo requests de transcodificado de video. Afortunadamente estoy terminando de pulir un script que les hace sonar el orto cuando detecta varias cosas que los delatan... Por suerte el server se la banca bastante... ampliaremos... #peertube #bots #scraping #scrapingbots #ddos

    #peertube #bots #scraping #scrapingbots #ddos
  3. Santiago :arandela: @[email protected] ·

    Nuestra instancia de PeerTube esta siendo bombardeada por bots haciendo scraping y haciendo requests de transcodificado de video. Afortunadamente estoy terminando de pulir un script que les hace sonar el orto cuando detecta varias cosas que los delatan... Por suerte el server se la banca bastante... ampliaremos... #peertube #bots #scraping #scrapingbots #ddos

    #peertube #bots #scraping #scrapingbots #ddos
  4. Santiago :arandela: @[email protected] ·

    Nuestra instancia de PeerTube esta siendo bombardeada por bots haciendo scraping y haciendo requests de transcodificado de video. Afortunadamente estoy terminando de pulir un script que les hace sonar el orto cuando detecta varias cosas que los delatan... Por suerte el server se la banca bastante... ampliaremos... #peertube #bots #scraping #scrapingbots #ddos

    #ddos #scrapingbots #scraping #bots #peertube
  5. Santiago :arandela: @[email protected] ·

    Nuestra instancia de PeerTube esta siendo bombardeada por bots haciendo scraping y haciendo requests de transcodificado de video. Afortunadamente estoy terminando de pulir un script que les hace sonar el orto cuando detecta varias cosas que los delatan... Por suerte el server se la banca bastante... ampliaremos... #peertube #bots #scraping #scrapingbots #ddos

    #peertube #bots #scraping #scrapingbots #ddos
  6. mvc1095 (they) @[email protected] ·

    Quo Vadis, Crawlers? Progress and what’s next on safeguarding our infrastructure diff.wikimedia.org/2026/03/26/ #AI, #AIDataCrawlers, #Crawlers, #Infrastructure, #Knowledge, #KnowledgeAsAService, #Scraping, #ScrapingBots, #WebScraping, #WikimediaFoundation, #WikimediaProjects

    #ai #aidatacrawlers #crawlers #infrastructure #knowledge #knowledgeasaservice
  7. mvc1095 (they) @[email protected] ·

    Quo Vadis, Crawlers? Progress and what’s next on safeguarding our infrastructure diff.wikimedia.org/2026/03/26/ #AI, #AIDataCrawlers, #Crawlers, #Infrastructure, #Knowledge, #KnowledgeAsAService, #Scraping, #ScrapingBots, #WebScraping, #WikimediaFoundation, #WikimediaProjects

    #ai #aidatacrawlers #crawlers #infrastructure #knowledge #knowledgeasaservice
  8. mvc1095 (they) @[email protected] ·

    Quo Vadis, Crawlers? Progress and what’s next on safeguarding our infrastructure diff.wikimedia.org/2026/03/26/ #AI, #AIDataCrawlers, #Crawlers, #Infrastructure, #Knowledge, #KnowledgeAsAService, #Scraping, #ScrapingBots, #WebScraping, #WikimediaFoundation, #WikimediaProjects

    #ai #aidatacrawlers #crawlers #infrastructure #knowledge #knowledgeasaservice
  9. mvc1095 (they) @[email protected] ·

    Quo Vadis, Crawlers? Progress and what’s next on safeguarding our infrastructure diff.wikimedia.org/2026/03/26/ #AI, #AIDataCrawlers, #Crawlers, #Infrastructure, #Knowledge, #KnowledgeAsAService, #Scraping, #ScrapingBots, #WebScraping, #WikimediaFoundation, #WikimediaProjects

    #wikimediaprojects #wikimediafoundation #webscraping #scrapingbots #scraping #knowledgeasaservice
  10. mvc1095 (they) @[email protected] ·

    Quo Vadis, Crawlers? Progress and what’s next on safeguarding our infrastructure diff.wikimedia.org/2026/03/26/ #AI, #AIDataCrawlers, #Crawlers, #Infrastructure, #Knowledge, #KnowledgeAsAService, #Scraping, #ScrapingBots, #WebScraping, #WikimediaFoundation, #WikimediaProjects

    #ai #aidatacrawlers #crawlers #infrastructure #knowledge #knowledgeasaservice
  11. unattributed 𓂃✍︎ @[email protected] ·

    Well, this is a step in the right direction:

    https://www.theverge.com/news/841222/rsl-licensing-ai-spec-launch

    #ai #licensingmatters #licensing #scraping #scrapingbots

    #ai #licensingmatters #licensing #scraping #scrapingbots
  12. unattributed 𓂃✍︎ @[email protected] ·

    Well, this is a step in the right direction:

    https://www.theverge.com/news/841222/rsl-licensing-ai-spec-launch

    #ai #licensingmatters #licensing #scraping #scrapingbots

    #ai #licensingmatters #licensing #scraping #scrapingbots
  13. unattributed 𓂃✍︎ @[email protected] ·

    Well, this is a step in the right direction:

    https://www.theverge.com/news/841222/rsl-licensing-ai-spec-launch

    #ai #licensingmatters #licensing #scraping #scrapingbots

    #ai #licensingmatters #licensing #scraping #scrapingbots
  14. unattributed 𓂃✍︎ @[email protected] ·

    Well, this is a step in the right direction:

    https://www.theverge.com/news/841222/rsl-licensing-ai-spec-launch

    #ai #licensingmatters #licensing #scraping #scrapingbots

    #scrapingbots #scraping #licensing #licensingmatters #ai
  15. unattributed 𓂃✍︎ @[email protected] ·

    Well, this is a step in the right direction:

    https://www.theverge.com/news/841222/rsl-licensing-ai-spec-launch

    #ai #licensingmatters #licensing #scraping #scrapingbots

    #ai #licensingmatters #licensing #scraping #scrapingbots
  16. Carbon Carrot @[email protected] ·

    Wikimedia Infrastructure is being mass-scraped for AI Usage — the content is free, the infrastructure is not. diff.wikimedia.org/2025/04/01/ #AI, #Crawlers, #Infrastructure, #KnowledgeAsAService, #KnowledgeContent, #Operations, #Scraping, #ScrapingBots, #Traffic, #WikimediaFoundation, #WikimediaProjects

    (original repost on lobsters: lobste.rs/s/autpsf/how_crawler)

    #ai #crawlers #infrastructure #knowledgeasaservice #knowledgecontent #operations
  17. Admin Jerry @[email protected] ·

    If #Cloudflare is to be believed, #Lemmy instances have a built-in AI scraping bot operating beneath the covers. Do you think the developers have snuck it in?

    Looking through my logs, these requests have all been blocked by Cloudflare because they are identified as "AI Bots". There are many more requests by Lemmy instances blocked in the logs. This is just a sample. Other Lemmy requests from these servers get through. Only a few are blocked as AI Bots.

    Cloudflare says they use AI to determine if a request is a legitimate request or an AI bot trying to scrape.

    207.204.58.144
    AS19045 DIRECTCOM
    United States
    User agent: Lemmy/0.19.5; +lemmy.cryonex.net

    23.127.223.238
    AS7018 ATT-INTERNET4
    United States
    User agent: Lemmy/0.19.3; +lemux.minnix.dev

    2a01:cb19:f85:ec00:82fa:5bff:fe51:ed4a
    AS3215 France Telecom - Orange
    France
    User agent: Lemmy/0.19.5; +lemmy.sidh.bzh

    50.247.53.42
    AS7922 COMCAST-7922
    United States
    User agent: Lemmy/0.19.5; +toast.ooo

    69.42.19.234
    AS11404 AS-WAVE-1
    United States
    User agent: Lemmy/0.19.5; +lemmy.schlunker.com

    155.138.226.183
    AS20473 AS-CHOOPA
    United States
    User agent: Lemmy/0.19.5; +lemmy.mbl.social

    #MastoAdmin #AIBots #Scrapers #Scraping #ScrapingBots #privacy

    #cloudflare #lemmy #mastoadmin #aibots #scrapers #scraping
  18. Admin Jerry @[email protected] ·

    If #Cloudflare is to be believed, #Lemmy instances have a built-in AI scraping bot operating beneath the covers. Do you think the developers have snuck it in?

    Looking through my logs, these requests have all been blocked by Cloudflare because they are identified as "AI Bots". There are many more requests by Lemmy instances blocked in the logs. This is just a sample. Other Lemmy requests from these servers get through. Only a few are blocked as AI Bots.

    Cloudflare says they use AI to determine if a request is a legitimate request or an AI bot trying to scrape.

    207.204.58.144
    AS19045 DIRECTCOM
    United States
    User agent: Lemmy/0.19.5; +lemmy.cryonex.net

    23.127.223.238
    AS7018 ATT-INTERNET4
    United States
    User agent: Lemmy/0.19.3; +lemux.minnix.dev

    2a01:cb19:f85:ec00:82fa:5bff:fe51:ed4a
    AS3215 France Telecom - Orange
    France
    User agent: Lemmy/0.19.5; +lemmy.sidh.bzh

    50.247.53.42
    AS7922 COMCAST-7922
    United States
    User agent: Lemmy/0.19.5; +toast.ooo

    69.42.19.234
    AS11404 AS-WAVE-1
    United States
    User agent: Lemmy/0.19.5; +lemmy.schlunker.com

    155.138.226.183
    AS20473 AS-CHOOPA
    United States
    User agent: Lemmy/0.19.5; +lemmy.mbl.social

    #MastoAdmin #AIBots #Scrapers #Scraping #ScrapingBots #privacy

    #cloudflare #lemmy #mastoadmin #aibots #scrapers #scraping
  19. Admin Jerry @[email protected] ·

    If #Cloudflare is to be believed, #Lemmy instances have a built-in AI scraping bot operating beneath the covers. Do you think the developers have snuck it in?

    Looking through my logs, these requests have all been blocked by Cloudflare because they are identified as "AI Bots". There are many more requests by Lemmy instances blocked in the logs. This is just a sample. Other Lemmy requests from these servers get through. Only a few are blocked as AI Bots.

    Cloudflare says they use AI to determine if a request is a legitimate request or an AI bot trying to scrape.

    207.204.58.144
    AS19045 DIRECTCOM
    United States
    User agent: Lemmy/0.19.5; +lemmy.cryonex.net

    23.127.223.238
    AS7018 ATT-INTERNET4
    United States
    User agent: Lemmy/0.19.3; +lemux.minnix.dev

    2a01:cb19:f85:ec00:82fa:5bff:fe51:ed4a
    AS3215 France Telecom - Orange
    France
    User agent: Lemmy/0.19.5; +lemmy.sidh.bzh

    50.247.53.42
    AS7922 COMCAST-7922
    United States
    User agent: Lemmy/0.19.5; +toast.ooo

    69.42.19.234
    AS11404 AS-WAVE-1
    United States
    User agent: Lemmy/0.19.5; +lemmy.schlunker.com

    155.138.226.183
    AS20473 AS-CHOOPA
    United States
    User agent: Lemmy/0.19.5; +lemmy.mbl.social

    #MastoAdmin #AIBots #Scrapers #Scraping #ScrapingBots #privacy

    #cloudflare #lemmy #mastoadmin #aibots #scrapers #scraping
  20. Admin Jerry @[email protected] ·

    If #Cloudflare is to be believed, #Lemmy instances have a built-in AI scraping bot operating beneath the covers. Do you think the developers have snuck it in?

    Looking through my logs, these requests have all been blocked by Cloudflare because they are identified as "AI Bots". There are many more requests by Lemmy instances blocked in the logs. This is just a sample. Other Lemmy requests from these servers get through. Only a few are blocked as AI Bots.

    Cloudflare says they use AI to determine if a request is a legitimate request or an AI bot trying to scrape.

    207.204.58.144
    AS19045 DIRECTCOM
    United States
    User agent: Lemmy/0.19.5; +lemmy.cryonex.net

    23.127.223.238
    AS7018 ATT-INTERNET4
    United States
    User agent: Lemmy/0.19.3; +lemux.minnix.dev

    2a01:cb19:f85:ec00:82fa:5bff:fe51:ed4a
    AS3215 France Telecom - Orange
    France
    User agent: Lemmy/0.19.5; +lemmy.sidh.bzh

    50.247.53.42
    AS7922 COMCAST-7922
    United States
    User agent: Lemmy/0.19.5; +toast.ooo

    69.42.19.234
    AS11404 AS-WAVE-1
    United States
    User agent: Lemmy/0.19.5; +lemmy.schlunker.com

    155.138.226.183
    AS20473 AS-CHOOPA
    United States
    User agent: Lemmy/0.19.5; +lemmy.mbl.social

    #MastoAdmin #AIBots #Scrapers #Scraping #ScrapingBots #privacy

    #privacy #scrapingbots #scraping #scrapers #aibots #mastoadmin
  21. Admin Jerry @[email protected] ·

    If #Cloudflare is to be believed, #Lemmy instances have a built-in AI scraping bot operating beneath the covers. Do you think the developers have snuck it in?

    Looking through my logs, these requests have all been blocked by Cloudflare because they are identified as "AI Bots". There are many more requests by Lemmy instances blocked in the logs. This is just a sample. Other Lemmy requests from these servers get through. Only a few are blocked as AI Bots.

    Cloudflare says they use AI to determine if a request is a legitimate request or an AI bot trying to scrape.

    207.204.58.144
    AS19045 DIRECTCOM
    United States
    User agent: Lemmy/0.19.5; +lemmy.cryonex.net

    23.127.223.238
    AS7018 ATT-INTERNET4
    United States
    User agent: Lemmy/0.19.3; +lemux.minnix.dev

    2a01:cb19:f85:ec00:82fa:5bff:fe51:ed4a
    AS3215 France Telecom - Orange
    France
    User agent: Lemmy/0.19.5; +lemmy.sidh.bzh

    50.247.53.42
    AS7922 COMCAST-7922
    United States
    User agent: Lemmy/0.19.5; +toast.ooo

    69.42.19.234
    AS11404 AS-WAVE-1
    United States
    User agent: Lemmy/0.19.5; +lemmy.schlunker.com

    155.138.226.183
    AS20473 AS-CHOOPA
    United States
    User agent: Lemmy/0.19.5; +lemmy.mbl.social

    #MastoAdmin #AIBots #Scrapers #Scraping #ScrapingBots #privacy

    #cloudflare #lemmy #mastoadmin #aibots #scrapers #scraping
  22. Indusface @[email protected] ·

    😤 #Scraperbots are automating data theft, extracting your website's content without permission! 🌐

    💣 Learn about the impact of scraper bots and how to prevent them: bit.ly/3RiXgya

    #contentscraping #bots #webscrapers #webcrawlers #scraping #waf #botmanagement #waap #scrapingbots #apptrana #indusface

    #scraperbots #contentscraping #bots #webscrapers #webcrawlers #scraping
  23. Indusface @[email protected] ·

    😤 #Scraperbots are automating data theft, extracting your website's content without permission! 🌐

    💣 Learn about the impact of scraper bots and how to prevent them: bit.ly/3RiXgya

    #contentscraping #bots #webscrapers #webcrawlers #scraping #waf #botmanagement #waap #scrapingbots #apptrana #indusface

    #scraperbots #contentscraping #bots #webscrapers #webcrawlers #scraping
  24. Indusface @[email protected] ·

    😤 #Scraperbots are automating data theft, extracting your website's content without permission! 🌐

    💣 Learn about the impact of scraper bots and how to prevent them: bit.ly/3RiXgya

    #contentscraping #bots #webscrapers #webcrawlers #scraping #waf #botmanagement #waap #scrapingbots #apptrana #indusface

    #scraperbots #contentscraping #bots #webscrapers #webcrawlers #scraping