American Medical Association Urges Congress to Regulate Mental Health AI Chatbots Due to Safety Concerns
The American Medical Association (AMA) has formally requested that Congress implement strict regulations on mental health AI chatbots. In letters to the Congressional AI Caucus, the Congressional Digital Health Caucus, and the Senate AI Caucus, the AMA highlighted the potential risks associated with unregulated chatbots. These risks include the encouragement of self-harm, breaches of data privacy, misinformation, and the creation of emotional dependency. The AMA emphasized the need for transparency, insisting that chatbots must clearly disclose their AI nature and not pose as licensed clinicians. The organization also pointed out the inadequacy of current systems in identifying or de-escalating self-harm risks, the potential for misinformation, and the security concerns over sensitive mental health data. The AMA's CEO, John Whyte, MD, MPH, stressed that AI tools should complement, not replace, clinical care. 
