Utah's AI Prescription Pilot Raises Safety Concerns Amid Regulatory Scrutiny
Utah's Office of Artificial Intelligence Policy has approved Doctronic, a health technology startup, to autonomously renew medical prescriptions using AI. This marks the first instance in the U.S. where AI is allowed to handle prescription renewals without direct physician oversight. The pilot program, which spans three phases, begins with physician review of every renewal and gradually reduces oversight to 5-10% of renewals. Concerns have been raised about the safety of this approach, especially after a security research firm demonstrated vulnerabilities in Doctronic's public-facing AI tool. The American Medical Association and the Utah Academy of Family Physicians have expressed objections, citing potential risks to patient safety. The program's design includes monthly reporting requirements and excludes controlled substances, but questions remain about whether AI systems should be regulated as medical devices by the FDA. 
