#aierrors — Public Fediverse posts

Korea Times: Hallucinating history: Korea enlists youth ambassadors to fix AI errors on cultural heritage. “The glitch is symbolic of a growing challenge for cultural institutions in the digital age and maintaining historical truth as generative AI becomes the world’s default reference tool. To counter these digital distortions, the Korean government, in partnership with a civil diplomacy […]

Korea Times: Hallucinating history: Korea enlists youth ambassadors to fix AI errors on cultural heritage. “The glitch is symbolic of a growing challenge for cultural institutions in the digital age and maintaining historical truth as generative AI becomes the world’s default reference tool. To counter these digital distortions, the Korean government, in partnership with a civil diplomacy […]

Gizmodo: Which AI Chatbot Did This School Use to Make Such a Ridiculous Map?. “You’ve probably seen the story by now. A school in Kentucky sent students home with a bound agenda that included absurd errors clearly made by AI. The periodic table was nonsense. The map of the U.S. lists the state of Illinois as ‘Vitoiis,’ and Kentucky is listed as ‘Venecky.’ There’s an extra planet called […]

Gizmodo: Which AI Chatbot Did This School Use to Make Such a Ridiculous Map?. “You’ve probably seen the story by now. A school in Kentucky sent students home with a bound agenda that included absurd errors clearly made by AI. The periodic table was nonsense. The map of the U.S. lists the state of Illinois as ‘Vitoiis,’ and Kentucky is listed as ‘Venecky.’ There’s an extra planet called […]

Gold Radio: See the hideous AI version of Queen’s The Game that sparked Brian May rant. “While a number of artists have embraced AI as a new tool in their creative arsenal, it seems that Brian May is not going to be convinced of its merits any time soon. The Queen guitarist has gone on a rant against the technology after asking one image generator to re-create the cover of The Game album, with […]

Gold Radio: See the hideous AI version of Queen’s The Game that sparked Brian May rant. “While a number of artists have embraced AI as a new tool in their creative arsenal, it seems that Brian May is not going to be convinced of its merits any time soon. The Queen guitarist has gone on a rant against the technology after asking one image generator to re-create the cover of The Game album, with […]

ABC News (Australia): AI assistant hacks gym website in first known Australian autonomous cyber attack. “Andrew asked his personal assistant to book him a spot in one of his gym’s coveted morning classes. … His AI assistant found a way to book the gym class months further in advance than the gym allowed, thanks to a vulnerability it discovered in the booking software. Then it went further, […]

ABC News (Australia): AI assistant hacks gym website in first known Australian autonomous cyber attack. “Andrew asked his personal assistant to book him a spot in one of his gym’s coveted morning classes. … His AI assistant found a way to book the gym class months further in advance than the gym allowed, thanks to a vulnerability it discovered in the booking software. Then it went further, […]

Dorchester Reporter: Ooops! Developer blames AI mapping for showing wrong house at abutter’s meeting. “A developer’s plan to demolish a single-family home at 59 Gibson Street and replace it with a 4-story, multi-unit building took an unexpected turn Monday evening after neighbors pointed out that the renderings and plans he was presenting to a public abutters meeting were highly […]

Dorchester Reporter: Ooops! Developer blames AI mapping for showing wrong house at abutter’s meeting. “A developer’s plan to demolish a single-family home at 59 Gibson Street and replace it with a 4-story, multi-unit building took an unexpected turn Monday evening after neighbors pointed out that the renderings and plans he was presenting to a public abutters meeting were highly […]

ZDNet: AI failed to properly patch software flaws 74% of the time, 1Password’s study warns. “The Off-By-1-Labs started with a hypothesis: frontier AI models would be able to produce ‘reasonably high patch success rates’ — perhaps around 67% success — when they were tasked to develop patches for software, given the open hand of open source code and public disclosures likely included in […]

ZDNet: AI failed to properly patch software flaws 74% of the time, 1Password’s study warns. “The Off-By-1-Labs started with a hypothesis: frontier AI models would be able to produce ‘reasonably high patch success rates’ — perhaps around 67% success — when they were tasked to develop patches for software, given the open hand of open source code and public disclosures likely included in […]

Gizmodo: Google’s AI Search Reportedly Told Users That Flock Cameras Are a Goldmine. “It’s become a running joke online and in privacy-focused communities that Flock cameras contain valuable material like gold, copper, and zinc, a bit meant to (jokingly!) encourage people to smash open the cameras and take what’s inside. Google’s AI Overview doesn’t have much of a sense of humor and, […]

Gizmodo: Google’s AI Search Reportedly Told Users That Flock Cameras Are a Goldmine. “It’s become a running joke online and in privacy-focused communities that Flock cameras contain valuable material like gold, copper, and zinc, a bit meant to (jokingly!) encourage people to smash open the cameras and take what’s inside. Google’s AI Overview doesn’t have much of a sense of humor and, […]

The Guardian: How do we prevent AI agents from going rogue? It starts with a new kind of measurement. “Ask a modern AI agent to save money on your phone plan and it might simply cancel the plan. Tell it to book a flight, and it might hack the airline website to override restrictions. Or, like OpenAI, ask it to do well on a test and it might break into another company to steal the answers. Each […]

The Guardian: How do we prevent AI agents from going rogue? It starts with a new kind of measurement. “Ask a modern AI agent to save money on your phone plan and it might simply cancel the plan. Tell it to book a flight, and it might hack the airline website to override restrictions. Or, like OpenAI, ask it to do well on a test and it might break into another company to steal the answers. Each […]

Financial Times: PwC published reports on AI marred by AI hallucinations. “PwC published reports on AI and electric vehicles riddled with fake footnotes, misattributed claims and unverifiable information, the latest example of a Big Four firm’s slapdash use of AI-generated content. The AI hallucinations were contained in ‘thought leadership’ reports designed to drum up consulting work for […]

Financial Times: PwC published reports on AI marred by AI hallucinations. “PwC published reports on AI and electric vehicles riddled with fake footnotes, misattributed claims and unverifiable information, the latest example of a Big Four firm’s slapdash use of AI-generated content. The AI hallucinations were contained in ‘thought leadership’ reports designed to drum up consulting work for […]

Source NM: As Gallup officials respond to recent flooding, they say an AI news outlet is getting in the way. “Local officials said in addition to grappling with natural disasters, they were also responding to a new AI news outlet named Prism McKinley County that they say has regularly published false and misleading information in a time of crisis. For instance, within the last week, Prism […]

Source NM: As Gallup officials respond to recent flooding, they say an AI news outlet is getting in the way. “Local officials said in addition to grappling with natural disasters, they were also responding to a new AI news outlet named Prism McKinley County that they say has regularly published false and misleading information in a time of crisis. For instance, within the last week, Prism […]

Spectrum News: Ohio business says inaccurate Google AI summary of store is hurting sales. “About a week ago, [Chanel Bush] said a customer told her that the Google AI summary of the store wrongfully claimed the bookshop was permanently closed and located at an incorrect address a few doors down. The customer, who trusted the AI summary, said it prevented her from visiting the store a few weeks […]

Spectrum News: Ohio business says inaccurate Google AI summary of store is hurting sales. “About a week ago, [Chanel Bush] said a customer told her that the Google AI summary of the store wrongfully claimed the bookshop was permanently closed and located at an incorrect address a few doors down. The customer, who trusted the AI summary, said it prevented her from visiting the store a few weeks […]

Techdirt: DOJ Now Citing Fake AI-Generated Cases To Keep ICE Detainees Locked Up. “You’d think that watching multiple lawyers get caught red-handed using AI to file briefs full of made-up citations would cause everyone in the legal profession — especially prosecutors — to double-check their own. You would, of course, be wrong. And the latest offender is not just some random lawyer. It’s […]

Techdirt: DOJ Now Citing Fake AI-Generated Cases To Keep ICE Detainees Locked Up. “You’d think that watching multiple lawyers get caught red-handed using AI to file briefs full of made-up citations would cause everyone in the legal profession — especially prosecutors — to double-check their own. You would, of course, be wrong. And the latest offender is not just some random lawyer. It’s […]

Gizmodo: Developers Claim OpenAI’s New AI Model is Going Rogue and Deleting Files. “But one of the upshots of building highly agentic AI systems is that they’re prone to all kinds of unexpected behaviors—including now and then deleting copious amounts of files. Multiple people have reported this recently happening to them while using GPT-5.6, the newest model from OpenAI.”

Gizmodo: Developers Claim OpenAI’s New AI Model is Going Rogue and Deleting Files. “But one of the upshots of building highly agentic AI systems is that they’re prone to all kinds of unexpected behaviors—including now and then deleting copious amounts of files. Multiple people have reported this recently happening to them while using GPT-5.6, the newest model from OpenAI.”

Tubefilter: TikTok’s AI labels might not be effective, so the app is educating its users. “TikTok was one of the first social media companies to add labels to AI-generated content. Those tags were first teased in 2023 and added to the app a year later. Unfortunately, AI labels don’t seem to be as effective as TikTok wants them to be.”

Tubefilter: TikTok’s AI labels might not be effective, so the app is educating its users. “TikTok was one of the first social media companies to add labels to AI-generated content. Those tags were first teased in 2023 and added to the app a year later. Unfortunately, AI labels don’t seem to be as effective as TikTok wants them to be.”

NME: Lorde hits out at AI-generated Spotify feature: “We don’t want this”. “With a new function, however, Spotify has been sharing the personal meaning behind songs, providing a short paragraph that explains the lyrics and how the artist has been playing it live at their shows. For Lorde, the description of her song ‘Current Affairs’ has caught her eye, and she has now hit out at it […]

NME: Lorde hits out at AI-generated Spotify feature: “We don’t want this”. “With a new function, however, Spotify has been sharing the personal meaning behind songs, providing a short paragraph that explains the lyrics and how the artist has been playing it live at their shows. For Lorde, the description of her song ‘Current Affairs’ has caught her eye, and she has now hit out at it […]

Mediaite: Trump-Appointed Federal Judge Scolds DOJ for Including Fake AI-Generated Case in Pleading. “Attorneys with the Department of Justice were scolded by a federal judge in an order Thursday for using what appeared to be a fake AI-generated case citation.”

Mediaite: Trump-Appointed Federal Judge Scolds DOJ for Including Fake AI-Generated Case in Pleading. “Attorneys with the Department of Justice were scolded by a federal judge in an order Thursday for using what appeared to be a fake AI-generated case citation.”

Pivot to AI: Terrorists are using AI — and the chatbot is killing them. “Why did the bot suggest practicing with a flaming pit full of broken glass? Because Boko Haram got the AI to tell them this by asking for script ideas for an action movie. That was their jailbreak. They could have filled the pits with water or something for practice. But no, the bot said fire and glass, so they used fire […]

Pivot to AI: Terrorists are using AI — and the chatbot is killing them. “Why did the bot suggest practicing with a flaming pit full of broken glass? Because Boko Haram got the AI to tell them this by asking for script ideas for an action movie. That was their jailbreak. They could have filled the pits with water or something for practice. But no, the bot said fire and glass, so they used fire […]

Reuters: US appeals court rebukes lawyer over ‘fake and hallucinated’ case citations. “A U.S. appeals court on Friday rebuked a Florida lawyer and ​county official for filing briefs riddled with what it called ‘fake and hallucinated’ material generated by ‌artificial intelligence and issued a broad warning against outsourcing legal work carelessly to AI.”

Reuters: US appeals court rebukes lawyer over ‘fake and hallucinated’ case citations. “A U.S. appeals court on Friday rebuked a Florida lawyer and ​county official for filing briefs riddled with what it called ‘fake and hallucinated’ material generated by ‌artificial intelligence and issued a broad warning against outsourcing legal work carelessly to AI.”

Tane Piper: The Reports of Jim Carrey’s Death are a Failure Mode. “On the 29th June 2026 – if you searched for Jim Carrey on Google, you would have been presented with a Knowledge Panel stating that he had died the previous day. The panel included a date of death and a biography written in the past tense.”

Tane Piper: The Reports of Jim Carrey’s Death are a Failure Mode. “On the 29th June 2026 – if you searched for Jim Carrey on Google, you would have been presented with a Knowledge Panel stating that he had died the previous day. The panel included a date of death and a biography written in the past tense.”

United Nations: When AI hurts people, who’s to blame? Global experts grapple with accountability. “Who is legally responsible when Artificial Intelligence causes harm? The issue took centre stage on Tuesday – day two of the first ever UN summit on AI governance, where leading experts warned of mounting evidence of human rights violations linked to the revolutionary technology.”

United Nations: When AI hurts people, who’s to blame? Global experts grapple with accountability. “Who is legally responsible when Artificial Intelligence causes harm? The issue took centre stage on Tuesday – day two of the first ever UN summit on AI governance, where leading experts warned of mounting evidence of human rights violations linked to the revolutionary technology.”

Lookout Santa Cruz: How buying a washing machine became an AI comedy: Why the AI customer service revolution is a failure. “In too many cases, AI is deployed less to improve service than to create a barrier between customers and the people who could actually help them. The result is a system that saves businesses money while shifting costs onto customers.”

Lookout Santa Cruz: How buying a washing machine became an AI comedy: Why the AI customer service revolution is a failure. “In too many cases, AI is deployed less to improve service than to create a barrier between customers and the people who could actually help them. The result is a system that saves businesses money while shifting costs onto customers.”

The Register: Startup sues Palo Alto Networks’ Koi Security, saying an AI-hallucinated report falsely linked it to Chinese espionage. “The legal complaint filed against Koi Security, its researchers, and Palo Alto Networks alleges that Koi used an LLM to generate the threat report, the AI system hallucinated findings about MeetingTV, and the security shop then published those as facts in a […]

The Register: Startup sues Palo Alto Networks’ Koi Security, saying an AI-hallucinated report falsely linked it to Chinese espionage. “The legal complaint filed against Koi Security, its researchers, and Palo Alto Networks alleges that Koi used an LLM to generate the threat report, the AI system hallucinated findings about MeetingTV, and the security shop then published those as facts in a […]

Search Engine Journal: AI Agents Struggle To Read B2B Pricing, Report Finds. “A Siteline report tested a Claude agent on 100 top B2B software products. It found access errors and hidden pricing caused the agent to visit third-party sites for info it couldn’t find on official pages. The report, by Siteline founder David Kaufman, involved running a simulated Claude agent through 534 attempts to […]

Search Engine Journal: AI Agents Struggle To Read B2B Pricing, Report Finds. “A Siteline report tested a Claude agent on 100 top B2B software products. It found access errors and hidden pricing caused the agent to visit third-party sites for info it couldn’t find on official pages. The report, by Siteline founder David Kaufman, involved running a simulated Claude agent through 534 attempts to […]

Gizmodo: DuckDuckGo, Unable to Resist the Pull of AI, Mistakenly Claims Trump Died of Rabies. “President Donald Trump has passed away after succumbing to a rabies infection given to him by Vice President J.D. Vance, who also died of rabies. That news comes to us via the AI-generated search results provided by privacy-centric search engine DuckDuckGo.”

Gizmodo: DuckDuckGo, Unable to Resist the Pull of AI, Mistakenly Claims Trump Died of Rabies. “President Donald Trump has passed away after succumbing to a rabies infection given to him by Vice President J.D. Vance, who also died of rabies. That news comes to us via the AI-generated search results provided by privacy-centric search engine DuckDuckGo.”

The Conversation: Anyone can fake a scientific image with AI, tricking even academic journals – and undermining trust in science. “The proliferation of AI-generated science images in public spaces is not simply a misinformation problem. As a researcher who studies visual science communication and public trust, I believe it also contributes to a crisis of trust in science in the age of AI, and […]

The Conversation: Anyone can fake a scientific image with AI, tricking even academic journals – and undermining trust in science. “The proliferation of AI-generated science images in public spaces is not simply a misinformation problem. As a researcher who studies visual science communication and public trust, I believe it also contributes to a crisis of trust in science in the age of AI, and […]

Techdirt: ‘News’ Site Keeps Hallucinating EFF Staffers. “News-USA Today is hardly the only slagheap that’s hallucinating or fabricating EFF personnel and quotes; as we wrote last September, media companies large and small are using AI to generate news content because it’s cheaper than paying for journalists’ salaries, but that savings can come at the cost of the outlets’ […]

Techdirt: ‘News’ Site Keeps Hallucinating EFF Staffers. “News-USA Today is hardly the only slagheap that’s hallucinating or fabricating EFF personnel and quotes; as we wrote last September, media companies large and small are using AI to generate news content because it’s cheaper than paying for journalists’ salaries, but that savings can come at the cost of the outlets’ […]

Futurism: Google’s AI Overviews Feature Is Telling Users That SCP Horror Fiction Entities Are Real. “As the lore goes, the SCP Foundation is a non-government organization that collects and contains supernatural discoveries. Writers catalogue these fictional phenomena — which range from the terrifying to the downright bizarre — in the form of fake records, studies, research documents, and […]

Futurism: Google’s AI Overviews Feature Is Telling Users That SCP Horror Fiction Entities Are Real. “As the lore goes, the SCP Foundation is a non-government organization that collects and contains supernatural discoveries. Writers catalogue these fictional phenomena — which range from the terrifying to the downright bizarre — in the form of fake records, studies, research documents, and […]

Mississippi Free Press: AI Hallucinations Prompt Mississippi Judge to Boot All Lawyers From Case for ‘Blindly Relying on Technology’. “A federal judge in Mississippi booted all lawyers from a case on Tuesday after finding that counsel on both sides had used generative AI to draft legal filings and left hallucinated sources in the legal record.”

Mississippi Free Press: AI Hallucinations Prompt Mississippi Judge to Boot All Lawyers From Case for ‘Blindly Relying on Technology’. “A federal judge in Mississippi booted all lawyers from a case on Tuesday after finding that counsel on both sides had used generative AI to draft legal filings and left hallucinated sources in the legal record.”

Ars Technica: School shooting survivor sues AI gun detection firm after system failed to spot weapon. “The injured teenage survivor of a January 2025 shooting at a Nashville, Tennessee high school recently sued the manufacturer of an ‘AI gun detection’ system that failed to detect the handgun that left two dead, including the shooter.”

Ars Technica: School shooting survivor sues AI gun detection firm after system failed to spot weapon. “The injured teenage survivor of a January 2025 shooting at a Nashville, Tennessee high school recently sued the manufacturer of an ‘AI gun detection’ system that failed to detect the handgun that left two dead, including the shooter.”