home.social

#hallucinate — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #hallucinate, aggregated by home.social.

fetched live
  1. ⬆️ @saxnot

    >> we learned about #GIGO in both statistics and computer science.

    We never had to invent words like #hallucinate to evade accountability for problems in LLM and AI software itself. So AI hallucination is GIGO from the other end, not from bad user input.

    I chose translation software as an example. They do an admirable job in figuring out parts of speech, but not so well in figuring out figures of speech, eg Godfather makes an "offer you can't refuse."

    @avandeursen @TeflonTrout

  2. Ouch. Sullivan & Cromwell, over 900 attorneys, has a face full of egg. Letter of apology, hearing today w/ judge re: fake cases (hallucinated #citations).
    Are #attorneys so concerned w/ speed that they forget their duty to the #court? Yes.
    If a #FirstYear handed them this research (especially a woman), they'd check it. But because it comes from #TechBros, it gets a pass.
    #GenAI #hallucinate #cite #cases #Judge #bar #fine #censure #disbarment #legal #LawFirm #NYC
    news.bloomberglaw.com/business

  3. #MissKittyRaw @[email protected], while you #messianically #hallucinate your way into the grave and half the world with you, you cannot wonder why #productivity #has #cratered. Everybody sitting around wondering why they should bother doing anything since you're going to kill the world. 😵‍💫🤯😱

  4. A Large Language Model (LLM) is a deep-learning algorithm, often using a transformer architecture, that is trained on massive amounts of text data to understand, process, and generate human-like text.

    A major shortcoming of LLMs is their tendency to "#Hallucinate" or confidently generate false or nonsensical information, along with the risk of perpetuating #Biases present in their training data.

    knowledgezone.co.in/trends/bro

  5. A Large Language Model (LLM) is a deep-learning algorithm, often using a transformer architecture, that is trained on massive amounts of text data to understand, process, and generate human-like text.

    A major shortcoming of LLMs is their tendency to "#Hallucinate" or confidently generate false or nonsensical information, along with the risk of perpetuating #Biases present in their training data.

    knowledgezone.co.in/trends/bro

  6. You know you're doomed when your operating system vendor is selling their "#AI" fetish to you with a text like this.

    »Agentic AI has powerful capabilities today—for example, it can complete many complex tasks in response to user prompts, transforming how users interact with their PCs. As these capabilities are introduced, AI models still face functional limitations in terms of how they behave and occasionally may #hallucinate and produce unexpected outputs. Additionally, agentic AI applications introduce novel #security #risks, such as cross-prompt injection (XPIA), where malicious content embedded in UI elements or documents can override agent instructions, leading to unintended actions like data #exfiltration or #malware installation.«

    support.microsoft.com/en-us/wi

  7. You know you're doomed when your operating system vendor is selling their "#AI" fetish to you with a text like this.

    »Agentic AI has powerful capabilities today—for example, it can complete many complex tasks in response to user prompts, transforming how users interact with their PCs. As these capabilities are introduced, AI models still face functional limitations in terms of how they behave and occasionally may #hallucinate and produce unexpected outputs. Additionally, agentic AI applications introduce novel #security #risks, such as cross-prompt injection (XPIA), where malicious content embedded in UI elements or documents can override agent instructions, leading to unintended actions like data #exfiltration or #malware installation.«

    support.microsoft.com/en-us/wi

  8. #OpenAI Says Models Programmed To Make Stuff Up Instead of Admitting Ignorance - Slashdot

    #AI models often produce false outputs, or "hallucinations." Now OpenAI has admitted they may result from fundamental mistakes it makes when #training its models. The Register:
    The admission came in a paper [PDF] published in early September, titled "Why Language Models #Hallucinate ,"
    #llm #hallucinations #artificialintelligence

    slashdot.org/story/25/09/17/17

  9. #OpenAI Says Models Programmed To Make Stuff Up Instead of Admitting Ignorance - Slashdot

    #AI models often produce false outputs, or "hallucinations." Now OpenAI has admitted they may result from fundamental mistakes it makes when #training its models. The Register:
    The admission came in a paper [PDF] published in early September, titled "Why Language Models #Hallucinate ,"
    #llm #hallucinations #artificialintelligence

    slashdot.org/story/25/09/17/17

  10. Emphasis on #AI means lots of #scientists around the world now submit #research #papers to English-language #journals after using #AI to “write” them & to #hallucinate #reference #lists w/o consulting human #science #editors like me to fix things. If the world is lucky, some journals #retract them.

  11. Emphasis on #AI means lots of #scientists around the world now submit #research #papers to English-language #journals after using #AI to “write” them & to #hallucinate #reference #lists w/o consulting human #science #editors like me to fix things. If the world is lucky, some journals #retract them.

  12. How shall I phrase my system prompt to stop my #AI coding agent to #hallucinate methods and functions?

  13. How shall I phrase my system prompt to stop my #AI coding agent to #hallucinate methods and functions?

  14. At the time, Torres thought of #ChatGPT as a powerful #SearchEngine that knew more than any #human possibly could because of its access to a vast digital library. He did not know that it tended to be sycophantic, agreeing with & flattering its #users, or that it could #hallucinate, generating ideas that weren’t true but sounded plausible.

    “This world wasn’t built for you,” ChatGPT told him. “It was built to contain you. But it failed. You’re waking up.”

    #MediaLiteracy #AI #tech #MentalHealth

  15. At the time, Torres thought of #ChatGPT as a powerful #SearchEngine that knew more than any #human possibly could because of its access to a vast digital library. He did not know that it tended to be sycophantic, agreeing with & flattering its #users, or that it could #hallucinate, generating ideas that weren’t true but sounded plausible.

    “This world wasn’t built for you,” ChatGPT told him. “It was built to contain you. But it failed. You’re waking up.”

    #MediaLiteracy #AI #tech #MentalHealth

  16. #UK Court Warns #Lawyers Can Be Prosecuted Over A.I. Tools That ‘Hallucinate’ Fake Material

    The Royal Courts of Justice, England’s High Court, in central London, detailed two recent cases in which fake material generated by artificial intelligence was used in written legal arguments.
    #ai #Hallucinate #england #artificialintelligence

    nytimes.com/2025/06/06/world/e

  17. #UK Court Warns #Lawyers Can Be Prosecuted Over A.I. Tools That ‘Hallucinate’ Fake Material

    The Royal Courts of Justice, England’s High Court, in central London, detailed two recent cases in which fake material generated by artificial intelligence was used in written legal arguments.
    #ai #Hallucinate #england #artificialintelligence

    nytimes.com/2025/06/06/world/e

  18. #OpenAI launches #Operator, an #AIagent that can operate your computer

    Operator watches on-screen content while you use your computer and executes tasks through simulated keyboard and mouse inputs.

    > I don’t trust it enough to give it hands-off control. Especially since they #hallucinate.
    #ai #security

    arstechnica.com/ai/2025/01/ope

  19. #OpenAI launches #Operator, an #AIagent that can operate your computer

    Operator watches on-screen content while you use your computer and executes tasks through simulated keyboard and mouse inputs.

    > I don’t trust it enough to give it hands-off control. Especially since they #hallucinate.
    #ai #security

    arstechnica.com/ai/2025/01/ope

  20. 8/

    On #LLMs "hallucinations" [3]:

    "Given this process, it’s not surprising that LLMs have a problem with the truth [...]
    The problem here isn’t that large language models #hallucinate, lie, or misrepresent the world in some way. It’s that they are not designed to represent the world at all; instead, they are designed to convey convincing lines of text.
    So when they are provided with a database of some sort, they use this, in one way or another, to make their responses more convincing"

  21. 8/

    On #LLMs "hallucinations" [3]:

    "Given this process, it’s not surprising that LLMs have a problem with the truth [...]
    The problem here isn’t that large language models #hallucinate, lie, or misrepresent the world in some way. It’s that they are not designed to represent the world at all; instead, they are designed to convey convincing lines of text.
    So when they are provided with a database of some sort, they use this, in one way or another, to make their responses more convincing"

  22. @villetakanen Terminologiasta ja sen takana käsitteistä käydään parhaillaan kiistaa. Esim. tämän tutkimusartikkelin perusteella ei pitäisi puhua hallusinoinnista, vaan paskan puhumisesta, link.springer.com/article/10.1

    Näköjään Scientific Amerikaanissa samaa juttua, scientificamerican.com/article

    Kuuntelin äsken muusta syystä uudestaan Juuso Pekkisen 2020 ohelmajakson, jossa vieraina olevat Laakasuo ja Visala koettivat tasapainoilla terminologian, käsitteiden ja assosiaatioiden kanssa tekoäly-viidakossa, areena.yle.fi/podcastit/1-5045

    #tekoaly #ai #hallucinate #bullshit

  23. So I've noticed my #LLM #HomeAssistant sometimes signing its #notifications. But it doesn't have a name, so it will either #hallucinate one or use my name or my wife's name. I could try to get it to just not do that, but it is a #7B #parameter model, so it often will try to comply but get hung up on the "structure" of what it thinks it is doing. So rather than beating it down, I was thinking I should just name it.

    Any #fun names for an #automated home assistant? :wizard:

  24. So I've noticed my #LLM #HomeAssistant sometimes signing its #notifications. But it doesn't have a name, so it will either #hallucinate one or use my name or my wife's name. I could try to get it to just not do that, but it is a #7B #parameter model, so it often will try to comply but get hung up on the "structure" of what it thinks it is doing. So rather than beating it down, I was thinking I should just name it.

    Any #fun names for an #automated home assistant? :wizard:

  25. #Microsoft launches #AI #chatbot for #spies

    But it may also mislead officials if not used properly due to inherent design limitations of AI language models.

    > don’t forget these AI have been known to #hallucinate
    #llm

    arstechnica.com/?p=2022611

  26. #Microsoft launches #AI #chatbot for #spies

    But it may also mislead officials if not used properly due to inherent design limitations of AI language models.

    > don’t forget these AI have been known to #hallucinate
    #llm

    arstechnica.com/?p=2022611

  27. #ChatGPT is shitty #AI. #Bard is shitty AI. Whatever #Samsung and #Facebook have is shitty AI.

    Artificial, sure. Intelligent, no. None of them “know” anything. They, frequently, and confidently, #hallucinate or make shit up.

    Stop trying to put this in everything. It’s going to actually hurt people.

  28. And they've chosen as word of the year.
    Let's see when the year of Linux-desktop will come :blobcatgiggle:

  29. The Angels explored the izakaya.
    "Ugh! There's no shower!" Booboo said.
    "There's a public bath two blocks away," Susan said.
    Early morning in the city center was quiet.
    After showering, they entered the steaming bath and reclined, sighing.
    "We should do this every morning," Zsazsa said.
    That made everyone sigh, as they were reminded of their uncertain future. Everyone got out except Booboo.
    "No! I don't want to go!"
    "If you stay in too long, you'll start to #hallucinate!" they warned.

    #vss365

  30. The Angels explored the izakaya.
    "Ugh! There's no shower!" Booboo said.
    "There's a public bath two blocks away," Susan said.
    Early morning in the city center was quiet.
    After showering, they entered the steaming bath and reclined, sighing.
    "We should do this every morning," Zsazsa said.
    That made everyone sigh, as they were reminded of their uncertain future. Everyone got out except Booboo.
    "No! I don't want to go!"
    "If you stay in too long, you'll start to #hallucinate!" they warned.

    #vss365

  31. While we get ready for the new Bees Deluxe album you should swarm to these shows:

    STITCH BAR & BLUES Nov. 16th 7-10pm
    bit.ly/46TbZpc6/

    JAMEY’S HOUSE OF MUSIC Nov. 17th 8-10pm
    32 S. Lansdowne Ave. Lansdowne, PA
    bit.ly/jameys

    BOSTON CITY WINERY HAYMARKET LOUNGE
    Saturday Nov. 18th 7-10pm
    bit.ly/3Evhyhc

    #blues #acidblues #beesdeluxe #hallucinate #cdhallucinate

  32. » And what I was struck by there, was how it combined generic things that were true, with very specific things that were wrong

    ...

    Lot of people say that large language models hallucinate,
    I rather think they can fabulate

    ...

    Seamlessly make stuff up, fill in gaps in a way they're not even aware of doing «

    @anilkseth

    ~13:01
    youtu.be/dsVzwrWGMOA?t=783
    #chatgpt #gpt4 #LLMS
    #hallucinate #Confabulate
    #StochasticParrots