American Medical Association Urges Congress to Regulate AI Mental Health Chatbots for Patient Safety
The American Medical Association (AMA) is calling on Congress to implement stronger regulations for artificial intelligence (AI) in healthcare, particularly concerning mental health chatbots. The AMA has expressed concerns that the rapid adoption of these AI tools is outpacing the necessary safeguards to protect patients. In communications with congressional caucuses focused on AI and digital health, the AMA highlighted the potential of AI to enhance access to mental health support and innovate care delivery. However, it also pointed out significant risks, including misinformation, emotional dependency, privacy breaches, and inappropriate responses from chatbots to users in distress. AMA CEO John Whyte emphasized the need for consistent safeguards to prevent harm and maintain patient trust. The AMA's recommendations include ensuring transparency so users know when they are interacting with AI, setting boundaries to prevent chatbots from posing as licensed professionals, and establishing regulatory definiti...