#useragents — Public Fediverse posts

🎬🤖 So, the #bot #police at #Wikipedia have gone full #Skynet, demanding user agents like it's the secret handshake to the nerd club. Meanwhile, #phabricator.page has become the ultimate rabbit hole for people who think "404" means "try again later." 🙄🔍
https://en.wikipedia.org/wiki/Colossus:_The_Forbin_Project #UserAgents #RabbitHole #HackerNews #ngated

Oh, look, another riveting tale of the digital age 🕵️‍♂️: a captivating saga of user-agents and robot policies. Because nothing screams excitement like the thrills of... Wikipedia's privacy settings? 🤖📜 Talk about cutting-edge content! 🙄
https://en.wikipedia.org/wiki/Zugzwang #digitalage #useragents #robotpolicies #Wikipediaprivacy #cuttingedgecontent #thrillingtales #HackerNews #ngated

🐌✨ Look out, world! We've got #slugs playing dress-up as solar panels, apparently having mastered the art of #photosynthesis just by being near plants. 🌿🌞 Meanwhile, the article's more concerned with user agents and robot policies than the actual science. 🤖📜
https://en.wikipedia.org/wiki/Costasiella_kuroshimae #solarpanels #useragents #robotics #HackerNews #ngated

🐌✨ Look out, world! We've got #slugs playing dress-up as solar panels, apparently having mastered the art of #photosynthesis just by being near plants. 🌿🌞 Meanwhile, the article's more concerned with user agents and robot policies than the actual science. 🤖📜
https://en.wikipedia.org/wiki/Costasiella_kuroshimae #solarpanels #useragents #robotics #HackerNews #ngated

🐌✨ Look out, world! We've got #slugs playing dress-up as solar panels, apparently having mastered the art of #photosynthesis just by being near plants. 🌿🌞 Meanwhile, the article's more concerned with user agents and robot policies than the actual science. 🤖📜
https://en.wikipedia.org/wiki/Costasiella_kuroshimae #solarpanels #useragents #robotics #HackerNews #ngated

🐌✨ Look out, world! We've got #slugs playing dress-up as solar panels, apparently having mastered the art of #photosynthesis just by being near plants. 🌿🌞 Meanwhile, the article's more concerned with user agents and robot policies than the actual science. 🤖📜
https://en.wikipedia.org/wiki/Costasiella_kuroshimae #solarpanels #useragents #robotics #HackerNews #ngated

🐌✨ Look out, world! We've got #slugs playing dress-up as solar panels, apparently having mastered the art of #photosynthesis just by being near plants. 🌿🌞 Meanwhile, the article's more concerned with user agents and robot policies than the actual science. 🤖📜
https://en.wikipedia.org/wiki/Costasiella_kuroshimae #solarpanels #useragents #robotics #HackerNews #ngated

#Business #Reports
Anthropic details how Claude crawls sites · How to block the three separate user agents https://ilo.im/16ax7y

_____
#AI #Claude #Crawlers #UserAgents #RobotsTxt #Content #Website #WebDev #Frontend #Backend

#Business #Reports
Anthropic details how Claude crawls sites · How to block the three separate user agents https://ilo.im/16ax7y

_____
#AI #Claude #Crawlers #UserAgents #RobotsTxt #Content #Website #WebDev #Frontend #Backend

#Business #Reports
Anthropic details how Claude crawls sites · How to block the three separate user agents https://ilo.im/16ax7y

_____
#AI #Claude #Crawlers #UserAgents #RobotsTxt #Content #Website #WebDev #Frontend #Backend

#Business #Reports
Anthropic details how Claude crawls sites · How to block the three separate user agents https://ilo.im/16ax7y

_____
#AI #Claude #Crawlers #UserAgents #RobotsTxt #Content #Website #WebDev #Frontend #Backend

🎉🎂 Wikipedia turns 25! 🎂🎉 And to celebrate, they're kindly reminding us to set user-agents and follow robot policies! 🤖 Because nothing says "Happy Birthday" like a slap on the wrist from your friendly neighborhood encyclopedia! 📜🥳
https://wikipedia25.org #Wikipedia25 #UserAgents #RobotPolicies #HappyBirthday #TechNews #Celebration #HackerNews #ngated

Of the bigger browsers, I think Safari is probably the closest to that right now, for all its flaws. It may be that Waterfox or some other Firefox fork with the AI garbage ripped out of it is better, I haven't delved into that.

https://www.waterfox.com

#Browsers #userAgents

It would be nice if somebody made a user agent for the web.

You know, software that actually works on behalf, and in the interests, of the user, rather than the maker.

Chrome has been adware for years now. Edge was actually pretty good while it was a fairly vanilla Chromium fork, but it seems MS is intent on stuffing Copilot into it too.

https://www.w3.org/WAI/UA/work/wiki/Definition_of_User_Agent

#browsers #userAgents

🐧 Ah, the elite club of “please-be-our-friend-agents” has a new bouncer: Finnix! 🤖 Apparently, the secret handshake involves setting a useragent and worshipping at the altar of the robot policy. 🎩 Because, let's face it, who doesn't want to endlessly browse #httpsw.wiki4wJS and decipher phabricator hieroglyphics for fun? 🙄
https://en.wikipedia.org/wiki/Finnix #eliteclub #useragents #Finnix #robotpolicy #HackerNews #ngated

🐧 Ah, the elite club of “please-be-our-friend-agents” has a new bouncer: Finnix! 🤖 Apparently, the secret handshake involves setting a useragent and worshipping at the altar of the robot policy. 🎩 Because, let's face it, who doesn't want to endlessly browse #httpsw.wiki4wJS and decipher phabricator hieroglyphics for fun? 🙄
https://en.wikipedia.org/wiki/Finnix #eliteclub #useragents #Finnix #robotpolicy #HackerNews #ngated

🐧 Ah, the elite club of “please-be-our-friend-agents” has a new bouncer: Finnix! 🤖 Apparently, the secret handshake involves setting a useragent and worshipping at the altar of the robot policy. 🎩 Because, let's face it, who doesn't want to endlessly browse #httpsw.wiki4wJS and decipher phabricator hieroglyphics for fun? 🙄
https://en.wikipedia.org/wiki/Finnix #eliteclub #useragents #Finnix #robotpolicy #HackerNews #ngated

🐧 Ah, the elite club of “please-be-our-friend-agents” has a new bouncer: Finnix! 🤖 Apparently, the secret handshake involves setting a useragent and worshipping at the altar of the robot policy. 🎩 Because, let's face it, who doesn't want to endlessly browse #httpsw.wiki4wJS and decipher phabricator hieroglyphics for fun? 🙄
https://en.wikipedia.org/wiki/Finnix #eliteclub #useragents #Finnix #robotpolicy #HackerNews #ngated

🐱🚀 In an epic saga of internet's least thrilling adventure, we journey through the mystical realm of user agents and robot policies, because why address the 'cat gap' when there's a thrilling T400119 quest awaiting? 🤖✨ Spoiler: it's less about cats and more about tech folks pretending to have a sense of humor. 🙄
https://en.wikipedia.org/wiki/Cat_gap #internetadventures #useragents #techhumor #robotpolicies #catgap #HackerNews #ngated

🤡 Ah yes, because what the internet really needed was another thrilling tale about respecting robot policies and setting user agents. 🎩🤖 Clearly, the pinnacle of human achievement: writing a riveting wiki page that nobody asked for! 🥱📄
https://en.wikipedia.org/wiki/Leatherman_(vagabond) #robotpolicies #useragents #internetdrama #wikiwriting #techhumor #HackerNews #ngated

🤡 Ah yes, because what the internet really needed was another thrilling tale about respecting robot policies and setting user agents. 🎩🤖 Clearly, the pinnacle of human achievement: writing a riveting wiki page that nobody asked for! 🥱📄
https://en.wikipedia.org/wiki/Leatherman_(vagabond) #robotpolicies #useragents #internetdrama #wikiwriting #techhumor #HackerNews #ngated

🤡 Ah yes, because what the internet really needed was another thrilling tale about respecting robot policies and setting user agents. 🎩🤖 Clearly, the pinnacle of human achievement: writing a riveting wiki page that nobody asked for! 🥱📄
https://en.wikipedia.org/wiki/Leatherman_(vagabond) #robotpolicies #useragents #internetdrama #wikiwriting #techhumor #HackerNews #ngated

🤡 Ah yes, because what the internet really needed was another thrilling tale about respecting robot policies and setting user agents. 🎩🤖 Clearly, the pinnacle of human achievement: writing a riveting wiki page that nobody asked for! 🥱📄
https://en.wikipedia.org/wiki/Leatherman_(vagabond) #robotpolicies #useragents #internetdrama #wikiwriting #techhumor #HackerNews #ngated

#Development #Findings
AI bots and robots.txt · How websites use robots.txt to set AI crawling rules https://ilo.im/166la4

_____
#AI #Bots #Content #Website #UserAgents #RobotsTxt #Business #SEO #WebDev #Backend

😂 Oh, look! Another riveting tale of tech etiquette—because everyone was just DYING to know about robot policies and user agents. 🙄 Spoiler: The staff devoured it later, proving once again that even the dullest topics can become a snack! 🍴
https://en.wikipedia.org/wiki/The_staff_ate_it_later #techetiquette #robotpolicies #useragents #humor #snacktime #HackerNews #ngated

Lazy sysadmin request: does anyone have a link to a well-updated user agent list containing bots, scrapers, AI agents, crawlers etc?

There are a bazillion on Github and Codeberg and a lot of them aren't maintained.

Ta!

#LazyWeb #Sysadmin #UserAgents

#Development #Trends
Who’s crawling your site in 2025 · The most active and blocked bots and crawlers https://ilo.im/1652mx

_____
#Bots #Crawlers #Website #Business #SEO #UserAgents #RobotsTxt #WebDev #Frontend #Backend

Why do all browsers' user agents start with "Mozilla/"?

https://stackoverflow.com/questions/1114254/why-do-all-browsers-user-agents-start-with-mozilla

#HackerNews #browsers #useragents #Mozilla #history #technews #webdevelopment

Quick terminology and preference question:

On @frontenddogma, I tag anything related to browsers (and other user agents) with “user-agents.”

I’m not sure it’s as clear and am wondering about moving to “browsers” instead (and cleaning up in other cases).

Do you think…

#browsers #useragents

#Business #Guides
The modern guide to robots.txt · How to use it avoiding the pitfalls https://ilo.im/1613va

_____
#SEO #AI #Robots.txt #UserAgents #Bots #Sitemap #Development #WebDev #Frontend #Backend

"When the web – and its #browsers – were a big, contented, diverse, competitive space, it was harder for tech companies to collude to capture standards bodies like the #W3C to secure even more dominance. As the web turned into Tom Eastman's "five giant websites filled with screenshots of text from the other four," that kind of collusion became much easier."
#UserAgents
https://pluralistic.net/2024/05/07/treacherous-computing/

#UserAgents #IoT #SmartObjects: "User agents can be well-designed or they can be poorly made. The fact that a user agent is designed to act in accord with your desires doesn't mean that it always will. A software agent, like a human agent, is not infallible.

However – and this is the key – if a user agent thwarts your desire due to a fault, that is fundamentally different from a user agent that thwarts your desires because it is designed to serve the interests of someone else, even when that is detrimental to your own interests.

A "faithless" user agent is utterly different from a "clumsy" user agent, and faithless user agents have become the norm. Indeed, as crude early internet clients progressed in sophistication, they grew increasingly treacherous. Most non-browser tools are designed for treachery.

A smart speaker or voice assistant routes all your requests through its manufacturer's servers and uses this to build a nonconsensual surveillance dossier on you. Smart speakers and voice assistants even secretly record your speech and route it to the manufacturer's subcontractors, whether or not you're explicitly interacting with them:"

https://pluralistic.net/2024/05/07/treacherous-computing/#rewilding-the-internet

So I made myself a #nginx config page containing lots of denied requests and sending them to a gzip forkbomb, and some little stuff to discourage script kiddies :
https://gist.github.com/garfieldairlines/faa254b665ea6fa02c3e8b2bea27c8dd

Suggestions welcome !

For bad #useragents and IP addresses I suggest
https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker

At least part of the reaction to #Google #WebIntegrity is that it disregards the polite fiction of #UserAgents completely. #Firefox #Brave and #Safari are being told point-blank to serve the interests of #advertisers or be kicked off Google services.

As others have pointed out #Apple has already quietly implemented similar behavior, but because it was advertised as a way to make #CAPTCHAs less annoying, nobody cared.

A while ago on the #OrangeSite I read a comment by someone claiming that #GDPR #fines for using #GoogleFonts were unconscionable because browsers are #UserAgents and companies shouldn't be fined for what they do.

This is of course incredulous victim blaming, but it does bump up against an uncomfortable fact: the term "user agent" as applied to browsers is at best useful fiction.

A real user agent would not have a mechanism to load arbitrary untrusted code into itself or contact third parties.

Je teste en ce moment Chameleon, un module firefox qui permets de ''Spoofer'' les informations de son navigateur. Très utile pour tromper les sites et fausser le traçage en ligne.
-On peut fausser la taille de son écran, le type d'appareil utilisé, la langue du navigateur, l'adresse ip, l'heure...

Il fonctionne aussi sur Firefox , et Fennec version mobile:
https://addons.mozilla.org/en-US/firefox/addon/chameleon-ext/

#tracking #vieprivee #UserAgents #android #pc #firefox