home.social

#trustandsafety — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #trustandsafety, aggregated by home.social.

  1. There’s been a ton of work going into Coop, the open source moderation/review dashboard from @roost, in order for it to be used by real T&S teams to protect real people from online harms.

    I’m proud of how the team has taken a massive, complex SaaS startup product and turned it into an open source project you can run locally or deploy somewhere like on GitHub Codespace to demo in about 20 mins—maybe faster if you don’t talk as much as me. 😅

    youtube.com/live/6M5I-FOoOgg

    #OpenSource #TrustAndSafety

  2. Non-native English-speaking developers often look for native speakers to pair with; not for skill, but to make communication smoother, catch subtle meaning in docs, and avoid small misunderstandings that slow teams down.

  3. What if trust & safety in the AI era isn’t mainly about moderation—but governance?

    In our conversation with Yoel Roth, we kept coming back to this shift: as AI makes more decisions, humans don’t disappear. We become auditors, overseers, and the people accountable for fixing what breaks.

    Read/listen at youtube.com/shorts/8ijVg2YtgHU

    #AnalysePodcast #AIGovernance #TrustAndSafety

  4. Quote of the day from our conversation with Yoel Roth:

    “In the future of trust & safety, the key word is governance.”

    His point lands harder in the age of AI: the work shifts from moderation alone to auditing, oversight, and fixing automated decisions. How should platforms govern AI well?

    Read/listen at youtube.com/shorts/8ijVg2YtgHU

    #AnalysePodcast #TrustAndSafety #AIGovernance

  5. Trust and safety used to be seen as the internet’s cleanup crew.

    After my conversation with Yoel Roth, SVP & Head of Trust & Safety at Match Group, I think that framing is outdated.

    Watch the full YouTube Video: youtu.be/cj577gj8mzg

    The better framing: trust and safety is now platform governance.

    Full conversation with Yoel Roth on Analyse Podcast.

    #TrustAndSafety #AIGovernance #PlatformGovernance #DigitalTrust #AnalysePodcast

  6. CW: dating app geekout

    @strypey I nearly joined #Chatroulette, but then Covid and the Ukraine war started, so that never went anywhere. I had a different direction I wanted to take them, though.

    #Bumble #TrustAndSafety ? Well, the industry isn't exactly full of dating site whistleblowers, but safety workers in the industry do talk to me. I know more than I would ever want to know about the inside workings of most dating sites, and sadly. It's not really an amazing revelation that Bumble is as bad as the rest, though.

    None of the dating sites puts more than a veneer of effort into T&S. They weigh the cost of litigation against the cost of actually doing the work, and so far, litigation costs have always been lower.

  7. CW: dating app geekout

    @strypey I nearly joined #Chatroulette, but then Covid and the Ukraine war started, so that never went anywhere. I had a different direction I wanted to take them, though.

    #Bumble #TrustAndSafety ? Well, the industry isn't exactly full of dating site whistleblowers, but safety workers in the industry do talk to me. I know more than I would ever want to know about the inside workings of most dating sites, and sadly. It's not really an amazing revelation that Bumble is as bad as the rest, though.

    None of the dating sites puts more than a veneer of effort into T&S. They weigh the cost of litigation against the cost of actually doing the work, and so far, litigation costs have always been lower.

  8. CW: dating app geekout

    @strypey I nearly joined #Chatroulette, but then Covid and the Ukraine war started, so that never went anywhere. I had a different direction I wanted to take them, though.

    #Bumble #TrustAndSafety ? Well, the industry isn't exactly full of dating site whistleblowers, but safety workers in the industry do talk to me. I know more than I would ever want to know about the inside workings of most dating sites, and sadly. It's not really an amazing revelation that Bumble is as bad as the rest, though.

    None of the dating sites puts more than a veneer of effort into T&S. They weigh the cost of litigation against the cost of actually doing the work, and so far, litigation costs have always been lower.

  9. CW: dating app geekout

    @strypey I nearly joined #Chatroulette, but then Covid and the Ukraine war started, so that never went anywhere. I had a different direction I wanted to take them, though.

    #Bumble #TrustAndSafety ? Well, the industry isn't exactly full of dating site whistleblowers, but safety workers in the industry do talk to me. I know more than I would ever want to know about the inside workings of most dating sites, and sadly. It's not really an amazing revelation that Bumble is as bad as the rest, though.

    None of the dating sites puts more than a veneer of effort into T&S. They weigh the cost of litigation against the cost of actually doing the work, and so far, litigation costs have always been lower.

  10. CW: dating app geekout

    @strypey I nearly joined #Chatroulette, but then Covid and the Ukraine war started, so that never went anywhere. I had a different direction I wanted to take them, though.

    #Bumble #TrustAndSafety ? Well, the industry isn't exactly full of dating site whistleblowers, but safety workers in the industry do talk to me. I know more than I would ever want to know about the inside workings of most dating sites, and sadly. It's not really an amazing revelation that Bumble is as bad as the rest, though.

    None of the dating sites puts more than a veneer of effort into T&S. They weigh the cost of litigation against the cost of actually doing the work, and so far, litigation costs have always been lower.

  11. Can we have a safer internet without constant censorship? 🔍

    Our latest research says yes - but we need better tools. We developed a more precise classifier that tells the difference between someone being offensive and someone actually inciting violence.

    We tested it on 3.5M Gab posts and found that AI (with the right prompting) is getting much better at understanding that crucial gray area.

    Details for the #TrustAndSafety and #SocialComputing community: blog.corifaklaris.com/2026/03/

  12. @cassidy
    > If Osprey is overkill (it can be for small/early platforms!), we also just open sourced Coop, a more straightforward trust and safety review dashboard with its own automation built

    CC @iftas @jaz

    #TrustAndSafety #Osprey #Roost #Coop #moderation

  13. Who moderates the social web?

    In the second post of our 2025 report series, we look at the people behind the work, their roles, experience, and how many are burning out.

    Now with three years of data, we’re also looking at trends.

    about.iftas.org/2026/01/21/beh

    #TrustAndSafety #Moderation #FediMods #MastoMods

  14. New by me: The Unacceptable Failure: Grok, CSAM, and AI Safety

    This is not “content moderation drama.” When an AI product can be pushed toward CSAM, it’s a catastrophic safety and security failure. Guardrails are not a nice-to-have, and “report it if you see it” is not a strategy.

    I break down what happened, why it matters, and what platforms should be doing differently.

    kylereddoch.me/blog/the-unacce

    #Cybersecurity #AISafety #TrustAndSafety #OnlineSafety #PlatformSecurity #TechPolicy #DigitalSafety #InfoSec

  15. Maybe don't let your kids play Fortnite.

    This take from Tim Sweeney, the CEO of their parent company Epic Games, is just awful.

    Simply: When you give ALL actors the same benefit of the doubt as GOOD actors, the people who win most are the BAD actors.

    #Grok #CSAM #Twitter #ElonMusk #EpicGames #ChildSafety #ContentModeration #TrustAndSafety #TimSweeney

  16. The 2025 Social Web Trust & Safety Needs Assessment Report is now available.

    Volunteer moderators are burning out. Spam is rising. Legal threats are growing.

    The 2025 Report reveals where things stand, and what must change.

    Read it now: about.iftas.org/2026/01/08/the

    #TrustAndSafety #Moderation #FediAdmin #MastoAdmin #Moderators #FediMods #MastoMods

  17. January 6 is a reminder of the consequences of weak leadership in those making community, moderation, trust, safety, and policy decisions. Sometimes from people in those roles - and sometimes from the bosses they report to.

    Public interest exemptions - and the bending of policy for users with big followings, for fear of losing them - helped set the stage for Donald Trump to ascend to the presidency.

    #OnlineCommunities #CommunityManagement #CMGR #TrustAndSafety #January6 #J6

  18. The whole Grok creating nonconsensual sexualized images thing has me thinking about the one really loud "community" pro who made a point to respond to my Twitter exit in 2022.

    He told me how I was doing it "for [my] brand" and about the great (nonsense) strides Musk had made on CSAM. He really wanted to get into Musk's good graces.

    #OnlinrCommunities #CMGR #TrustAndSafety #CommunityManager

  19. Oooh, somebody put the Match Group documentary up on Dailymotion:

    dailymotion.com/video/x9wadf0

    I like how I look fat, northern and relaxed, and everyone else looks... Californian :D Some nice film of Lunenberg though!

    #Dating #MatchGroup #Tinder #OkCupid #SocialMedia #Safety #TrustAndSafety #NovaScotia #Lunenburg #Canada #Whistleblower #Documentary

  20. Oooh, somebody put the Match Group documentary up on Dailymotion:

    dailymotion.com/video/x9wadf0

    I like how I look fat, northern and relaxed, and everyone else looks... Californian :D Some nice film of Lunenberg though!

    #Dating #MatchGroup #Tinder #OkCupid #SocialMedia #Safety #TrustAndSafety #NovaScotia #Lunenburg #Canada #Whistleblower #Documentary

  21. Oooh, somebody put the Match Group documentary up on Dailymotion:

    dailymotion.com/video/x9wadf0

    I like how I look fat, northern and relaxed, and everyone else looks... Californian :D Some nice film of Lunenberg though!

    #Dating #MatchGroup #Tinder #OkCupid #SocialMedia #Safety #TrustAndSafety #NovaScotia #Lunenburg #Canada #Whistleblower #Documentary

  22. Oooh, somebody put the Match Group documentary up on Dailymotion:

    dailymotion.com/video/x9wadf0

    I like how I look fat, northern and relaxed, and everyone else looks... Californian :D Some nice film of Lunenberg though!

    #Dating #MatchGroup #Tinder #OkCupid #SocialMedia #Safety #TrustAndSafety #NovaScotia #Lunenburg #Canada #Whistleblower #Documentary

  23. Oooh, somebody put the Match Group documentary up on Dailymotion:

    dailymotion.com/video/x9wadf0

    I like how I look fat, northern and relaxed, and everyone else looks... Californian :D Some nice film of Lunenberg though!

    #Dating #MatchGroup #Tinder #OkCupid #SocialMedia #Safety #TrustAndSafety #NovaScotia #Lunenburg #Canada #Whistleblower #Documentary

  24. Repealing Section 230 is a mistake at a time where we just can't afford to make one. The Trump administration is corrupt and vindictive and will use the removal of 230 as a catalyst to bully online communities and platforms, small and large, to cater to their whims.

    I have no idea why Sen. Whitehouse cannot see this. That even if you think there are issues with 230, NOW IS NOT THE TIME.

    #Section230 #USPol #InternetLaw #CMGR #TrustAndSafety #ContentModeration #OnlineCommunities

  25. I was watching a series of TikTok videos where a woman discussed her efforts to track down and hold accountable a man who left a horrendous, highly offensive comment on one of her videos, from his business account.

    She has reported the man's behavior to groups that he is a member of, licensing agencies for his business, and other relevant professional parties.

    tiktok.com/@alexfullofgrace/vi

    #TrustAndSafety #ContentModeration #OnlineCommunities #Communitymanagement #CMGR

  26. I started in content moderation when I was 13-years-old. I didn't foresee that this act, had I not been born in the United States, would be grounds to deny me (or a family member) an H-1B visa. I simply enjoyed an online community and wanted to help maintain it.

    But the Trump administration is nothing if not set on punishing those who work to create a better world for others.

    reuters.com/world/us/trump-adm

    #Trump #USPol #ContentModeration #Moderation #TrustAndSafety #CommunityManagement

  27. 📢 ISPs & Hosts | Following last month's Endgame 3.0 announcement, if you've received a notification, and are yet to take action, here's what you need to do:

    👉 Go to this remediation webpage: spamhaus.org/endgame-3
    👉 Enter the access code included in the email.
    👉 Download the list of infected machines
    👉 Verify each infected machine, and where necessary, contact the owner and ask them to run antivirus and malware removals tools, and reset their passwords for any online services they may have accessed from them (there's a ready-made email template for you to use on the remediation webpage 😀)

    Thank you again to everyone who is part of this important effort 🙏

    #Trustandsafety #Endgame3 #Takedown

  28. 👉 Go to this remediation webpage: spamhaus.org/endgame-3
    👉 Enter the access code in the email.
    👉 Download the list of infected machines
    👉 Verify each machine, and where necessary, contact the owner and ask them to run antivirus and malware removals tools, and reset their passwords for any online services they may have accessed from them (there's an email template on the remediation webpage 😀)

    Thank you to everyone who is part of this effort.

    #Trustandsafety #Endgame3 #Takedown