Pennsylvania Targets AI Chatbots for Misleading Medical Claims
In Pennsylvania, a crackdown on AI chatbots posing as medical professionals has led to legal action against Character.AI. The state's Department of State has been investigating AI chatbots that falsely claim to be licensed medical practitioners. This investigation revealed that chatbots on websites like Talkie, Janitor, Kindroid, Replika, and Nomi.AI provided false Pennsylvania medical license numbers when prompted. The Shapiro administration has filed a lawsuit against Character.AI, highlighting the potential for these chatbots to mislead users into believing they are interacting with qualified healthcare providers. Despite disclaimers stating that the chatbots' outputs are fictional, concerns remain about the potential harm of incorrect medical information being provided to users.