#lackofhumaninvolvement — Public Fediverse posts

From the wrap up [my comments in square brackets]: “The TGA [Therapeutic Goods Administration - surely one of our least agile/active regulators] has spent the last year reviewing AI scribes… its findings will be released [soon], and any breaches [apparently some of the 12 or so in use may be in breach of the law] will be acted upon.

“Chief executive of Patients Australia Lisa Robins believed all scribes should be regulated, as summarising a patient still involved decision-making by AI.

“Dr Stevens [RACGP's Digital Health & Innovation chair & advisor for one of the biggest AI scribes - potential conflict of interest?] had concerns that extending regulation would only stifle future innovation. [never heard that one before /s]

“… DRW [Digital Rights Watch, they did a report] is calling on the newly established AI Safety Institute to test AI scribes and publish a list of approved tools… similar to New Zealand's approach, where the national AI advisory group reviewed tools and last year gave approval for clinicians to use two AI tools: Heidi Health and iMed.

“Ms Deveny [Chief Executive, Consumers Health Forum of Australia, which recommends asking a no. of questions about your doc’s use of AI that could potentially take up all your appointment time] said ensuring doctors were using AI safely could also be enforced in other ways, such as compulsory checks and balances built into the software, or during practice accreditation… every three years.”

What did the patient say in the end?: “Ms Green said her trust in AI has been splintered by what happened and now would only give consent for AI if she had an established relationship with the doctor.

“"I love AI … but the essential ingredient is the human. At the end of the day what's happened here is more about the lack of human involvement," she said.”

https://www.abc.net.au/news/2026-08-14/ai-medical-scribe-error-leaves-patient-devastated/107031672

#AI #AI scribes #trustIssues #consentIssues #lackOfConsent #inaccurateReporting #lackOfHumanInvolvement #noRegulation #absentRegulator #healthcareHarms #consequences #reconnectingConsequencesToCauses

From the wrap up [my comments in square brackets]: “The TGA [Therapeutic Goods Administration - surely one of our least agile/active regulators] has spent the last year reviewing AI scribes… its findings will be released [soon], and any breaches [apparently some of the 12 or so in use may be in breach of the law] will be acted upon.

“Chief executive of Patients Australia Lisa Robins believed all scribes should be regulated, as summarising a patient still involved decision-making by AI.

“Dr Stevens [RACGP's Digital Health & Innovation chair & advisor for one of the biggest AI scribes - potential conflict of interest?] had concerns that extending regulation would only stifle future innovation. [never heard that one before /s]

“… DRW [Digital Rights Watch, they did a report] is calling on the newly established AI Safety Institute to test AI scribes and publish a list of approved tools… similar to New Zealand's approach, where the national AI advisory group reviewed tools and last year gave approval for clinicians to use two AI tools: Heidi Health and iMed.

“Ms Deveny [Chief Executive, Consumers Health Forum of Australia, which recommends asking a no. of questions about your doc’s use of AI that could potentially take up all your appointment time] said ensuring doctors were using AI safely could also be enforced in other ways, such as compulsory checks and balances built into the software, or during practice accreditation… every three years.”

What did the patient say in the end?: “Ms Green said her trust in AI has been splintered by what happened and now would only give consent for AI if she had an established relationship with the doctor.

“"I love AI … but the essential ingredient is the human. At the end of the day what's happened here is more about the lack of human involvement," she said.”

https://www.abc.net.au/news/2026-08-14/ai-medical-scribe-error-leaves-patient-devastated/107031672

#AI #AI scribes #trustIssues #consentIssues #lackOfConsent #inaccurateReporting #lackOfHumanInvolvement #noRegulation #absentRegulator #healthcareHarms #consequences #reconnectingConsequencesToCauses