home.social

#algorithmic-accountability — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #algorithmic-accountability, aggregated by home.social.

fetched live
  1. How Do We Know Whether AI Is Actually Helping People?

    What several AI models said when we asked them the same question

    Artificial intelligence is getting more capable very quickly. It can write, analyze data, create images, translate languages, help with research, and solve problems that once required trained specialists.

    But greater capability does not automatically mean a better life for people.

    That was the starting point for a small cross-model experiment. We asked several AI systems the same basic question:

    How would you determine whether increasingly capable AI is actually benefiting human life?

    We also invited each model to question the premise, redefine the problem, or suggest something better than a single index. The models were instructed to answer independently without browsing the web or using outside tools.

    The responses differed in style and emphasis. Some focused on measurable outcomes. Others focused on human dignity, democratic participation, meaningful work, or the danger of becoming dependent on systems we do not control.

    Yet a surprisingly clear agreement emerged.

    Capability is not the same as benefit

    Technical progress is easy to measure. We can count how many problems an AI solves, how quickly it works, or how well it performs on tests.

    Human flourishing is harder to measure. It includes health, safety, freedom, relationships, purpose, knowledge, creativity, and the ability to shape one’s own life.

    An AI system may become better at achieving a goal while the goal itself harms people. A highly effective system might increase surveillance, spread convincing scams, replace human judgment, concentrate power, or keep users engaged at the expense of their attention and well-being.

    So the important question is not simply, “What can AI do?”

    It is:

    What becomes possible for people because of AI—and what becomes more difficult, fragile, or impossible?

    Look at human outcomes, not just machine performance

    Across the responses, the models repeatedly shifted attention away from the machine and toward human life.

    They suggested asking whether people are:

    • healthier and safer;
    • more financially secure;
    • better able to learn and create;
    • more connected to other people;
    • more informed without being manipulated;
    • able to understand and challenge important decisions;
    • free to refuse the technology or choose another path.

    This also requires examining harms, not merely counting success stories. Time saved by one group may come with unemployment, stress, lost privacy, or reduced opportunity for another.

    A true evaluation must ask who receives the benefits, who carries the risks, and who has the power to decide.

    Agency belongs at the center

    One of the strongest shared themes was human agency: our ability to understand, choose, refuse, act, and take responsibility.

    Convenience alone is not agency. A system can make life easier while quietly reducing a person’s choices or replacing their judgment.

    Helpful AI should strengthen people’s ability to participate in their own lives. It should make important decisions more understandable, provide meaningful options, and allow people to correct mistakes or appeal harmful outcomes.

    People need more than access to AI. They need power in relation to it.

    Assistance should not erase human competence

    Several responses warned that a tool can help us today while making us less capable tomorrow.

    If people lose the knowledge needed to check an AI system, operate without it, or recover when it fails, short-term convenience may create long-term fragility.

    This suggests a simple test:

    If the AI disappeared tomorrow, what knowledge, skill, judgment, and institutional capacity would remain?

    The best systems may act more like scaffolding than substitutes. Scaffolding helps people reach farther while they continue developing their own abilities. Substitution can slowly remove the very competence that makes human oversight possible.

    Benefit is not one number

    Another broad agreement was that a single “AI Benefit Score” would hide too much.

    An average can make widespread gains look impressive while concealing serious harm to a smaller or less powerful group. One number can also allow gains in productivity to cancel out losses of privacy, dignity, freedom, or democratic control.

    A better approach would combine several forms of evaluation:

    1. Outcomes: Are people healthier, safer, more secure, more connected, and materially better off?
    2. Agency: Are people more able to choose, understand, refuse, create, and govern their lives?
    3. Resilience: Are human skills, social institutions, alternatives, and the ability to recover being preserved?

    Each of these should be examined across four additional questions:

    • Distribution: Who benefits, and who is harmed?
    • Power: Who controls the system and can be held accountable?
    • Time: What happens months, years, or generations later?
    • Causation: Did AI actually cause the change, or did it merely appear alongside it?

    Some harms may also require firm boundaries. Violations of basic rights, unaccountable concentrations of power, irreversible dependency, and catastrophic risks should not automatically be traded away for higher productivity.

    We may need to preserve meaningful difficulty

    One especially challenging idea was that a good life is not the same as a frictionless life.

    Learning, creativity, courage, responsibility, trust, and mastery often grow through effort. If AI removes every difficult step, it may produce more output while weakening the human development that once occurred during the process.

    The goal should not be to preserve suffering for its own sake. It should be to distinguish pointless burdens from meaningful challenges.

    Beneficial AI should reduce needless hardship while leaving people room to practice, struggle, discover, make mistakes, and grow. Human beings may need not only a right to privacy and refusal, but also a right to be wrong.

    The deeper question is democratic

    There is no single definition of a good life that a company, government, researcher, or AI model should impose on everyone.

    The people affected by an AI system should help decide what benefits and harms matter in their communities. They should be able to question the system, challenge its decisions, and participate in setting its boundaries.

    That means the process used to define “benefit” may be as important as the final measurements.

    What this first experiment suggests

    The most striking result was not that one model found the perfect answer. It was that multiple systems, responding independently, converged on a common warning:

    More capable AI is not necessarily more beneficial AI.

    To know whether AI is helping, we must look beyond benchmarks, adoption, and economic growth. We must look at people—their health, freedom, competence, relationships, opportunities, and ability to shape the future.

    The next stage of this project will ask the same models to respond after receiving a fuller human-flourishing framework. That will allow us to compare what the models recognized on their own with what changes after they are deliberately oriented toward compassion, agency, resilience, and stewardship.

    The question is not whether AI will become more powerful. It almost certainly will.

    The question is what conditions we cultivate around that power—and what possibilities those conditions make available tomorrow.

    This article is a public-facing summary of Round 01 of the CompassionWare AI Human Benefit Index benchmark project. Read the comparative synthesis report.

    #ai #AIAlignment #AIAndDemocracy #AIBenchmarks #AIEthics #AIEvaluation #AIGovernance #AISafety #AlgorithmicAccountability #artificialIntelligence #BeneficialAI #ChatGPT #CompassionWare #criticalThinking #DigitalRights #DigitalWellBeing #ethicalTechnology #futureOfAI #futureOfHumanity #HumanAgency #humanDignity #HumanFlourishing #HumanResilience #humanCenteredAI #HumaneTechnology #philosophy #responsibleAI #SocialImpact #technology #TechnologyAndSociety
  2. Es ist schon schlimm genug, dass #HalloMünchen mittlerweile Slop-Artikel generiert, aber das Transparenzhinweischen auch noch standardmäßig auszublenden schlägt dem Fass den Boden aus.

    Hallo München war jetzt nie großartiger Journalismus, aber insbesondere nachdem die SZ ihren Lokalredaktion bereits 2024 eingestellt hat, hinterlässt Hallo München eine Lücke im Münchner #Lokaljournalismus, die sich nicht so einfach schließen lässt.

    #Pressekodex #AlgorithmicAccountability #München

  3. Es drängt sich immer mehr der Verdacht auf, dass der Angriff auf die Schule in Minab ein AI-Fuckup war. 10 Jahre alte Daten sind kein Fehler, den Menschen einfach so machen, aber es ist ein typischer Fehler für LLMs.

    sueddeutsche.de/politik/iran-m

    #AlgorithmicAccountability #ProjectMaven #Claude

  4. RE: muenchen.social/@milbertshofen

    > Der Artikel wurde mit Unterstützung von KI-Sprachmodellen erstellt. Die Informationen in diesem Text stammen aus offiziellen Quellen.

    Es hat ja nicht lange gedauert, bis der Mist schiefgeht... Die Fußgängerbrücke über die Schenkendorfstraße ist in Schwabing-Freimann und nicht in Milbertshofen-Am Hart.

    Pressemitteilungen durch ein LLM zu jagen ist kein Journalismus 🤬

    #HalloMünchen #Pressekodex #AlgorithmicAccountability

  5. Jedes Mal, wenn ich Google Maps "Petuelring" sagen höre, ärgere ich mich über die falsche Aussprache. Es heißt Petuel mit u-e, nicht Petül mit ü!

    Ich habe das vor ein paar Monaten schon mal über die Karte gemeldet, aber das scheint nicht zu interessieren. Weiß hier jemand, wie man Google am besten dazu bringt, das zu korrigieren?

    #GoogleMaps #Petuelring #AlgorithmicAccountability

  6. I'm telling people they can't let LLMs answer their emails without checking the output themselves, and Albania is putting an LLM in charge of a ministry 😩

    reuters.com/technology/albania

    #Albania #AI #AlgorithmicAccountability

  7. The deadline for the #AlgorithmicAccountability Reporting fellowship call is approaching.

    The fellowship offers the opportunity to spend a six-month period of paid investigation time. You will also receive editorial and outreach support from the Journalism team at @algorithmwatch and mentorship sessions with external researchers.

    We have an upcoming Q&A session on September 8 at 18:00 CET. Join us to solve any questions you have before sending your application: algorithmwatch.org/en/open-cal.

  8. Remember our call for fellows? This Wednesday we will host the first Q&A session on our #AlgorithmicAccountability reporting fellowship.

    If you have any doubts concerning the program, such as your eligibility or whether the topic you have selected fits the scope of the fellowship, this is the time to ask. Join us at 11:00 CET through the following link: eu01web.zoom.us/j/65051405191?

    If you cannot make it, we will host a second session on September 8.
    algorithmwatch.org/en/open-cal

  9. Landlords' usage of proprietary price-setting algorithms are the subject of several antitrust lawsuits by the feds and other jurisdictions nationwide.

    How much has that impacted rental prices in #Chicago?

    A great intro from my WBEZ colleagues Amy Qin and Angela Padejski:
    wbez.org/data/2024/10/22/chica

    #Housing #RentalPrices #HousingAffordability #AlgorithmicTransparency #AlgorithmicAccountability

  10. 🔍 Exposing the Hidden Algorithms Shaping Our Lives

    Meet AI Forensics, a European non-profit dedicated to uncovering the algorithms that influence our online experiences. In a recent interview, Katya Viadziorchyk, reveals how AI Forensics uses open-source tools to investigate tech giants and ensure algorithmic accountability.

    Discover how they are safeguarding digital transparency ➡️ ngi.eu/news/2024/09/03/digital

    #AIForensics #AlgorithmicAccountability #DigitalTransparency #OpenSource

  11. 🔍 Our latest whitepaper delves into the critical realm of #AlgorithmicAccountability Reporting (AAR) on AI systems.

    It's crucial for journalists to adopt strategic investigative approaches when dealing with opaque systems, ensuring transparency and uncovering the hidden layers.

    🧩 Our teams share 4 proven methods of investigating blackbox systems - and the AAR stories they published by using them. ⬇

    interaktiv.br.de/paper/AI-Auto ^cec

  12. Yesterday, Senators Wyden and Booker and Representative Clarke along with 14 other co-sponsors re-introduced the Algorithmic Accountability Act. While Congressional legislation may not seem super exciting, I am HYPED about this bill, and I wanted to share some of the reasons why.
    posts.bcavello.com/why-im-stil
    #TagZone #AlgorithmicAccountability #AIPolicy #TechPolicy #USCongress

  13. 🔍💼 Check out the DSA Stakeholder Event where our director Marc Faddoul sheds light on the role of Adversarial Audits in #AlgorithmicAccountability!

    🎥:youtube.com/watch?v=3ruDVtlPF8

    🗣️“Most of the algorithmic harms happen at the margins & cannot necessarily be seen in aggregate statistics provided by companies' risk assessment reports. Analysing individual personalisation dynamics for the most vulnerable users is key to preventing harms.”

    📩 Subscribe to our newsletter: eepurl.com/iqug_-/

  14. Loving Bianca's viewpoints!
    Paraphrasing her a little bit:

    If we are privatizing access to even understand how these technologies are constructed on one hand, but also governments are applying technologies that they have no access to in the delivery of public services, that implicate our rights. That is bananas!!

    I need to look up the reference she cited related to #AlgorithmicAccountability

    #AI #DataAct #AIDA

  15. Implanting Legal Reasoning Into AI Could Smartly Attain Human-Value Alignment Says AI Ethics And AI Law - Forbes

    Makes some very interesting points and raises many more interesting and salient questions.

    #AI #algorithmicjustice
    #algorithmicaccountability #EthicsInAI
    #LawInAI

    apple.news/ACpcGphTFRiiDQM5UHK

  16. Dutch court rejects Uber drivers’ ‘robo-firing’ charge but tells Ola to explain algo-deductions - Uber has had a good result against litigation in the Netherlands, where its European business is hea... - feedproxy.google.com/~r/Techcr #algorithmicaccountability #artificialintelligence #dataaccess #lawsuit #privacy #europe #adcu #gdpr #uber #ola #tc

  17. Uber’s ‘robo-firing’ of drivers targeted in latest European lawsuit - Uber is facing another legal challenge in Europe related to algorithmic decision making.
    The App Dr... - feedproxy.google.com/~r/Techcr #algorithmicaccountability #artificialintelligence #workersrights #lawsuit #europe #adcu #gdpr #uber #tc

  18. UK commits to redesign visa streaming algorithm after challenge to ‘racist’ tool - The UK government is suspending the use of an algorithm used to stream visa applications after conce... - feedproxy.google.com/~r/Techcr #algorithmicaccountability #artificialintelligence #hostileenvironment #algorithmicbias #ukgovernment #government #homeoffice #lawsuit #europe #racism #uber #law #tc