The Promise of a Digital Assistant
An Artificial Intelligence (AI) scribe is a tool designed to tackle one of the biggest sources of physician burnout: administrative paperwork. Instead of typing notes during a consultation, a doctor can focus entirely on the patient while the AI system
listens, transcribes, and then summarises the conversation into a structured clinical note. For many overworked general practitioners (GPs), the appeal is immense. Proponents claim these tools can save doctors hours of documentation time each day, leading to better focus during patient visits, reduced burnout, and improved efficiency. This promise has led to a boom in adoption, with one survey showing the number of Australian doctors using AI scribes nearly doubling to 40% in late 2025 from 22% in August 2024.
How the Technology Works
In a typical setup, a microphone captures the conversation between the doctor and patient. Using advanced speech recognition and natural language processing, the AI scribe software transcribes the dialogue in real-time. But it does more than just type. The AI is designed to identify and structure clinically relevant information, such as symptoms, medical history, and treatment plans, while filtering out casual conversation. After the consultation, the doctor receives a drafted note ready for review and inclusion in the patient's electronic health record. This automation of clinical documentation is at the heart of both its popularity and the recent wave of concern.
The Source of Fresh Scrutiny
The rapid uptake has outpaced clear regulation, prompting Australia's federal health department and other bodies to take a closer look. Freedom of information requests have revealed that the health department has concerns that these tools have "little oversight". Regulators and patient advocates are now asking tough questions about several key areas. The Therapeutic Goods Administration (TGA), Australia's regulator for medical devices, is undertaking a review to determine if some AI scribes should be classified as medical devices and subject to stricter oversight, with a report expected in the coming months.
Patient Privacy and Consent Under Fire
A primary concern is patient privacy and the nature of consent. Guidelines from the Royal Australian College of General Practitioners (RACGP) are clear that doctors must obtain explicit and informed consent before using an AI scribe. However, consumer health groups report that patients are sometimes told they must agree to being recorded or find another doctor. There are also significant worries about data security. It is not always clear where the sensitive audio and text data is being stored, with fears that some platforms may send information to cloud servers located outside Australia, exposing it to different laws and security risks. The Privacy Commissioner's office is now tracking the rollout of this technology closely, engaging with both medical bodies and concerned civil society organisations.
Accuracy and Ultimate Responsibility
While AI can be impressively accurate, it is not infallible. The large language models that power these scribes can make mistakes, misinterpret accents or jargon, or even 'hallucinate' details that were never said. An error in a medical record can have serious consequences for a patient's future care. Medical bodies have been firm on this point: the doctor remains 100% legally and professionally responsible for the accuracy of every note in a patient's file, regardless of whether it was generated by an AI. This places the burden on clinicians to meticulously check every AI-generated summary, a step that could be easily missed in a busy clinic.
A Patchwork Regulatory Landscape
Currently, the oversight of AI scribes in Australia is fragmented between the TGA, the Australian Health Practitioner Regulation Agency (Ahpra), and the Office of the Australian Information Commissioner. The key distinction for the TGA is whether the tool simply transcribes or if it analyses information to suggest a diagnosis or treatment. If it does the latter, it is considered a medical device and requires TGA approval. However, many companies market their products as simple transcription tools to stay outside these regulations. This regulatory grey area is precisely what has prompted the government's fresh scrutiny, as the line between a helpful tool and a medical device can blur with a single software update.
