Federal Clinical AI Roadmap Omits FDA Oversight Details for Utah's AI Prescription Pilots
The Department of Health and Human Services (HHS) has released a roadmap aimed at accelerating the use of artificial intelligence (AI) in clinical care. However, this roadmap does not clarify whether the Food and Drug Administration (FDA) will oversee Utah's pilot programs, which allow AI systems to renew and, in one instance, write new prescriptions. The FDA typically requires premarket authorization for software that diagnoses or treats patients, a category that Utah's AI tools appear to fall under. Despite this, FDA officials have not publicly stated whether they are regulating these specific AI tools. Utah's Office of AI Policy, established in 2024, grants temporary regulatory relief to companies testing AI tools in exchange for monthly reports, with the power to modify or terminate pilots. These pilots include Doctronic for chronic medication renewals, Legion Health for psychiatric medication refills, August AI for chronic medication renewals, and Nolla Health, which allows AI to write new acne prescr...