home.social

#stochasticparrots — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #stochasticparrots, aggregated by home.social.

fetched live
  1. @iandunt.bsky.social You're not thinking, and, therefore, mistaken. We all experience that our brain sharpens when we exercise it, dulls when we don't use it. Just like, in fact, our muscles, and for the same reason: the body directs resource -- blood flow and nutrition -- to those organs that are using it.

    If you offload your thinking to a machine, of course you will get stupider.

    #GenAI
    #StochasticParrots

  2. @iandunt.bsky.social You're not thinking, and, therefore, mistaken. We all experience that our brain sharpens when we exercise it, dulls when we don't use it. Just like, in fact, our muscles, and for the same reason: the body directs resource -- blood flow and nutrition -- to those organs that are using it.

    If you offload your thinking to a machine, of course you will get stupider.

    #GenAI
    #StochasticParrots

  3. By design, it only takes a little prompting to hijack the biggest chatBots:

    • Researcher Dave Kuszmar discovered multiple systemic vulnerabilities that let him bypass LLM safety and obtain dangerous instructions.
    • These exploits worked across nearly all major LLMs revealing an industry-wide security problem.
    • Kuszmar calls for slowing deployment, increasing transparency, and large-scale research into LLM safety before further integrating these systems into society.

    spectrum.ieee.org/jailbreaking

    #publicSafety #safety #LLM #privacy #hacking #stochasticParrots #chatBots

  4. By design, it only takes a little prompting to hijack the biggest chatBots:

    • Researcher Dave Kuszmar discovered multiple systemic vulnerabilities that let him bypass LLM safety and obtain dangerous instructions.
    • These exploits worked across nearly all major LLMs revealing an industry-wide security problem.
    • Kuszmar calls for slowing deployment, increasing transparency, and large-scale research into LLM safety before further integrating these systems into society.

    spectrum.ieee.org/jailbreaking

    #publicSafety #safety #LLM #privacy #hacking #stochasticParrots #chatBots

  5. Yay! My essay on the impacts of Large Language Model (#LLM) #AI in #archaeology was just published:

    doi.org/10.11141/ia.71.15

    It looks at #bots and mass scraping on the infrastructure supporting #opendata and #openaccess. It also looks at the incentives that encourage the mass-production of #bullshit that may lead to #modelcollapse but more likely less dramatic and more dreary outcomes.

    Enjoy!
    #stochasticparrots #digitalhumanities #openscience

  6. @isomoth @kimcrawley #LLMs never hallucinate. They never lie. They never tell the truth. To do any of these things, you need to understand the meaning of language, and they do not. They produce statistically probable sequences of tokens. That is literally all they can ever do.

    Attributing meaning to their output is a category error.

    #GenAI
    #StochasticParrots

    journeyman.cc/blog/posts-outpu

  7. @isomoth @kimcrawley #LLMs never hallucinate. They never lie. They never tell the truth. To do any of these things, you need to understand the meaning of language, and they do not. They produce statistically probable sequences of tokens. That is literally all they can ever do.

    Attributing meaning to their output is a category error.

    #GenAI
    #StochasticParrots

    journeyman.cc/blog/posts-outpu

  8. What a great article on the real dangers of AI and how these were already predicted back in 2020. The woman was subsequently dismissed by Google, and after a short while, her former ethics team was disbanded too.

    tumblr.com/dreaminginthedeepso

    #TimnitGebru #ai #stochasticparrots #stochasticparrot #bias #hallucinations #llm #llms

  9. What a great article on the real dangers of AI and how these were already predicted back in 2020. The woman was subsequently dismissed by Google, and after a short while, her former ethics team was disbanded too.

    tumblr.com/dreaminginthedeepso

    #TimnitGebru #ai #stochasticparrots #stochasticparrot #bias #hallucinations #llm #llms

  10. "Let me first jump to the claim that’s most painful for me, speaking as a technologist and as an author on the Stochastic Parrots 🦜 paper: No, “Artificial Intelligence” is not a stochastic parrot. Large language models (LLMs) are. And large language models can be extremely useful."

    medium.com/@margarmitchell/no-

    #StochasticParrots #AI #LLM

  11. "Let me first jump to the claim that’s most painful for me, speaking as a technologist and as an author on the Stochastic Parrots 🦜 paper: No, “Artificial Intelligence” is not a stochastic parrot. Large language models (LLMs) are. And large language models can be extremely useful."

    medium.com/@margarmitchell/no-

    #StochasticParrots #AI #LLM

  12. I've referred to the prophetic @emilymbender et al. (2021) #StochasticParrots paper several times over the years, but I've never actually read it before. dl.acm.org/doi/epdf/10.1145/34

    I was surprised to learn:
    1. It's quite approachable from a non-technical stance
    2. There is an emoji in the title
    3. One of the authors is listed as Shmargaret Shmitchell

    #StochasticParrot #LLMs #noAI

  13. I've referred to the prophetic @emilymbender et al. (2021) #StochasticParrots paper several times over the years, but I've never actually read it before. dl.acm.org/doi/epdf/10.1145/34

    I was surprised to learn:
    1. It's quite approachable from a non-technical stance
    2. There is an emoji in the title
    3. One of the authors is listed as Shmargaret Shmitchell

    #StochasticParrot #LLMs #noAI

  14. #Google fired her for refusing to retract it in 2020. The firing itself proved the point she was making. The people who pay for the system can't afford to hear what's wrong with it. Every warning from Timnit Gebru's "On the Dangers of Stochastic Parrots" has now come true. At scale. Hallucinations, bias amplification, environmental cost, un-auditable training data, model collapse.

    tumblr.com/dreaminginthedeepso

    #TimnitGebru #stochasticparrots #aiethics #responsibleai #aicon #aihype

  15. #Google fired her for refusing to retract it in 2020. The firing itself proved the point she was making. The people who pay for the system can't afford to hear what's wrong with it. Every warning from Timnit Gebru's "On the Dangers of Stochastic Parrots" has now come true. At scale. Hallucinations, bias amplification, environmental cost, un-auditable training data, model collapse.

    tumblr.com/dreaminginthedeepso

    #TimnitGebru #stochasticparrots #aiethics #responsibleai #aicon #aihype

  16. This Emily Bender post has my new favorite acronym:

    Frequently Unasked Questions = FUQ!

    OK, probably not new, but it was new to me! 😁

    medium.com/@emilymenonbender/s

    "What I am trying to do, in a world absolutely saturated with marketing selling the idea that the synthetic text extruding machines are 'AI', or maybe even 'AGI', is to help people understand what these systems actually are: systems designed to mimic the language … that people use."

    #AI #AIHype #LLMs #Chatbots #StochasticParrots

  17. This Emily Bender post has my new favorite acronym:

    Frequently Unasked Questions = FUQ!

    OK, probably not new, but it was new to me! 😁

    medium.com/@emilymenonbender/s

    "What I am trying to do, in a world absolutely saturated with marketing selling the idea that the synthetic text extruding machines are 'AI', or maybe even 'AGI', is to help people understand what these systems actually are: systems designed to mimic the language … that people use."

    #AI #AIHype #LLMs #Chatbots #StochasticParrots

  18. @emilymbender Do you have a comment on @UlrikeHahn 's 2026 preprint [1] (I do know about your Frequently unasked questions [2])? Ulrike is giving us an online seminar on Monday (11:00 CEST coffee for locals, 11:15 actual seminar = 02:15 PDT) [3], in which you (and others) would be welcome to participate, of course.

    [1] zenodo.org/records/18231172

    [2] medium.com/@emilymenonbender/s

    [3] * codeberg.org/boud/ia-umk-semin
    * astro.umk.pl/en/institute/gene
    * bbb2.astro.uni.torun.pl/rooms/

    #LLMs #LLMReasoning #StochasticParrots

  19. @emilymbender Do you have a comment on @UlrikeHahn 's 2026 preprint [1] (I do know about your Frequently unasked questions [2])? Ulrike is giving us an online seminar on Monday (11:00 CEST coffee for locals, 11:15 actual seminar = 02:15 PDT) [3], in which you (and others) would be welcome to participate, of course.

    [1] zenodo.org/records/18231172

    [2] medium.com/@emilymenonbender/s

    [3] * codeberg.org/boud/ia-umk-semin
    * astro.umk.pl/en/institute/gene
    * bbb2.astro.uni.torun.pl/rooms/

    #LLMs #LLMReasoning #StochasticParrots

  20. "The Electoral Commission has called for new legal controls over misinformation from AI chatbots, after a thinktank found they had made serious mistakes during the recent Scottish election.

    The thinktank Demos said its investigation had found that AI services gave voters misinformation to 34% of the questions it posed"

    #ScotPol
    #Holyrood2026
    #GenAI
    #LLMs
    #StochasticParrots

    theguardian.com/technology/202

  21. "The Electoral Commission has called for new legal controls over misinformation from AI chatbots, after a thinktank found they had made serious mistakes during the recent Scottish election.

    The thinktank Demos said its investigation had found that AI services gave voters misinformation to 34% of the questions it posed"

    #ScotPol
    #Holyrood2026
    #GenAI
    #LLMs
    #StochasticParrots

    theguardian.com/technology/202

  22. AIは、質問されない質問について考えるのが得意🤖。パラドックス?倫理?🤔 まだまだ議論の余地あり! #AI #倫理 #StochasticParrots 🦜

  23. AIは、質問されない質問について考えるのが得意🤖。パラドックス?倫理?🤔 まだまだ議論の余地あり! #AI #倫理 #StochasticParrots 🦜

  24. @emilymbender revisits and clarifies (unasked) questions about stochastic parrots - the paper and the phrase.

    It's a worthwhile reminder that the purveyors of LLM software are hijacking our human language processing capabilities to fool us into believing that we're talking to an entity that does not exist. The output provided by an LLM seems designed to trigger our criteria for extending the assumption of humanity to our conversational partners.

    medium.com/@emilymenonbender/s

    #LLM #StochasticParrots

  25. @emilymbender revisits and clarifies (unasked) questions about stochastic parrots - the paper and the phrase.

    It's a worthwhile reminder that the purveyors of LLM software are hijacking our human language processing capabilities to fool us into believing that we're talking to an entity that does not exist. The output provided by an LLM seems designed to trigger our criteria for extending the assumption of humanity to our conversational partners.

    medium.com/@emilymenonbender/s

    #LLM #StochasticParrots

  26. RE: infosec.exchange/@patrickcmill

    Treat AI agents like the shadiest offshore engineer you ever hired, and you’ll be fine.

    Oh, before today, you’d never hired anyone, trained anyone, managed performance, or fired anyone?

    Ever?

    I think I found the problem with AI agents.

    It rhymes with #StochasticParrots.

  27. RE: infosec.exchange/@patrickcmill

    Treat AI agents like the shadiest offshore engineer you ever hired, and you’ll be fine.

    Oh, before today, you’d never hired anyone, trained anyone, managed performance, or fired anyone?

    Ever?

    I think I found the problem with AI agents.

    It rhymes with #StochasticParrots.

  28. “To waste what little bandwidth we have left – when 750 million people worldwide lack access to electricity – assisting some of the richest men ever to hone their plagiarism bots would be a historic idiocy that future generations are unlikely to forgive today’s leaders for.”

    #StochasticParrots
    #LLMs
    #GenAI

    theguardian.com/technology/202

  29. “To waste what little bandwidth we have left – when 750 million people worldwide lack access to electricity – assisting some of the richest men ever to hone their plagiarism bots would be a historic idiocy that future generations are unlikely to forgive today’s leaders for.”

    #StochasticParrots
    #LLMs
    #GenAI

    theguardian.com/technology/202

  30. @bluetea @Urban_Hermit @Numerfolt @Andres4NY @paninid Is this tacit acceptance of the use of plagiarism-by-chatbot common across academia now? It seems to me toxic to the whole project of education.

    #Plagiarism
    #StochasticParrots
    #AI
    #LLMs

  31. @bluetea @Urban_Hermit @Numerfolt @Andres4NY @paninid Is this tacit acceptance of the use of plagiarism-by-chatbot common across academia now? It seems to me toxic to the whole project of education.

    #Plagiarism
    #StochasticParrots
    #AI
    #LLMs

  32. @bluetea @Urban_Hermit @Numerfolt @Andres4NY @paninid

    If you're confident it's #AI slop, does it merit any marks at all? That's not the student's work, it's plagiarism.

    When I was at university, if you copied someone else's work without attribution, you got expelled, end of. And if you *just* copied someone else's work without adding anything, null points.

    #LLMs
    #StochasticParrots

  33. @bluetea @Urban_Hermit @Numerfolt @Andres4NY @paninid

    If you're confident it's #AI slop, does it merit any marks at all? That's not the student's work, it's plagiarism.

    When I was at university, if you copied someone else's work without attribution, you got expelled, end of. And if you *just* copied someone else's work without adding anything, null points.

    #LLMs
    #StochasticParrots

  34. And again, from this excellent essay:
    "The results, in a strict practical sense, don't matter. What matters is the process of getting them: the development and application of methods, the training of minds, the creation of people who know how to think about hard problems. If you hand that process to a machine, you haven't accelerated science. You've removed the only part of it that anyone actually needed." — Minas Karamanis

    #Science
    #HigherEd
    #StochasticParrots
    #AI

    ergosphere.blog/posts/the-mach

  35. And again, from this excellent essay:
    "The results, in a strict practical sense, don't matter. What matters is the process of getting them: the development and application of methods, the training of minds, the creation of people who know how to think about hard problems. If you hand that process to a machine, you haven't accelerated science. You've removed the only part of it that anyone actually needed." — Minas Karamanis

    #Science
    #HigherEd
    #StochasticParrots
    #AI

    ergosphere.blog/posts/the-mach

  36. "Using #AI to check the output of AI for errors is a method that is historically prone to errors"

    No shit, Sherlock.

    #LLMs
    #StochasticParrots

    AI Translations Are Adding ‘Hallucinations’ to Wikipedia Articles
    404media.co/ai-translations-ar

  37. "Using #AI to check the output of AI for errors is a method that is historically prone to errors"

    No shit, Sherlock.

    #LLMs
    #StochasticParrots

    AI Translations Are Adding ‘Hallucinations’ to Wikipedia Articles
    404media.co/ai-translations-ar

  38. "Even if #OpenAI was run by decent, ethical, friendly, trustworthy people (which would then of course make them not work on the products OpenAI has, but it’s just a thought experiment) their products would need to be criticized for what they are and what they do." — @blog

    #StochasticParrots
    #LLMs

    Acting ethically in an imperfect world
    tante.cc/2026/02/20/acting-eth

  39. "Even if #OpenAI was run by decent, ethical, friendly, trustworthy people (which would then of course make them not work on the products OpenAI has, but it’s just a thought experiment) their products would need to be criticized for what they are and what they do." — @blog

    #StochasticParrots
    #LLMs

    Acting ethically in an imperfect world
    tante.cc/2026/02/20/acting-eth

  40. "Large language models (LLMs) are widely described as artificial intelligence, yet their epistemic profile diverges sharply from human cognition. Here we show that the apparent alignment between human and machine outputs conceals a deeper structural mismatch in how judgments are produced. Tracing the historical shift from symbolic AI and information filtering systems to large-scale generative transformers, we argue that LLMs are not epistemic agents but stochastic pattern-completion systems, formally describable as walks on high-dimensional graphs of linguistic transitions rather than as systems that form beliefs or models of the world. By systematically mapping human and artificial epistemic pipelines, we identify seven epistemic fault lines, divergences in grounding, parsing, experience, motivation, causal reasoning, metacognition, and value. We call the resulting condition Epistemia: a structural situation in which linguistic plausibility substitutes for epistemic evaluation, producing the feeling of knowing without the labor of judgment. We conclude by outlining consequences for evaluation, governance, and epistemic literacy in societies increasingly organized around generative AI."

    osf.io/preprints/psyarxiv/c5gh

    #AI #GenerativeAI #Intelligence #StochasticParrots #Epistemology