What's Happening?
The New York Department of State’s Division of Consumer Protection has issued a consumer alert advising New Yorkers on the risks of sharing personal information with AI chatbots. This alert comes as AI chatbot usage is on the rise, with approximately
half of U.S. adults reporting use of these tools, and a quarter using them daily, according to a June 2026 Pew Research Survey. Secretary of State Walter T. Mosley emphasized that oversharing information with these programs can lead to inadvertent release of private data, increasing the risk of identity theft and financial harm. Acting ITS Chief Information Officer Jenson Jacob further cautioned that any information given to an AI chatbot should be assumed to be collected for training, potentially viewed by human reviewers, or vulnerable to hacking. The Division recommends never sharing sensitive data such as Social Security numbers, driver’s licenses, passport numbers, account passwords, PINs, credit card details, or health information on these platforms.
Why It's Important?
This consumer alert is crucial for safeguarding personal data in an increasingly AI-driven digital landscape. As more individuals turn to AI chatbots for various purposes, including health advice, emotional support, and companionship, the potential for sensitive information exposure grows significantly. The warning highlights a critical privacy concern: public AI chatbots often collect user prompts for training future models, meaning private conversations may not remain private. This practice can lead to user information retention and potential exposure in data breaches if personal details, account numbers, or credentials are entered. The guidance from the New York State Division of Consumer Protection aims to educate the public on proactive measures to mitigate these risks, thereby protecting consumers from identity theft and financial fraud in an evolving technological environment.
What's Next?
The New York State Division of Consumer Protection will continue its efforts to safeguard New Yorkers by providing ongoing tips and guidance on protecting personal information when using AI. Consumers are advised to take immediate steps such as avoiding the disclosure of personal identifying information, financial details, health information, legal documents, usernames, or passwords to chatbots. Furthermore, users should actively seek out and utilize options to opt-out of data saving and training within AI chatbot platforms by adjusting privacy settings. For general internet searches, using 'private' or 'incognito' modes can help minimize data retention on devices, though information may still be transmitted to external AI platforms. The Division encourages New Yorkers to stay informed through their consumer alerts and utilize their Consumer Assistance Helpline for further support.
Beyond the Headlines
The proliferation of AI chatbots introduces complex ethical and legal dimensions concerning data privacy and user consent. The alert underscores a broader societal challenge: balancing the convenience and utility of AI tools with the imperative to protect individual privacy. The default settings of many AI chatbots, which often include data collection for training purposes, raise questions about informed consent and the transparency of data usage policies. This situation could lead to increased regulatory scrutiny and calls for more robust data protection laws specifically addressing AI interactions. Furthermore, the reliance on AI for sensitive matters like health advice or emotional support highlights the need for users to understand the limitations of these tools and the potential for their personal narratives to become part of a larger, publicly accessible dataset, impacting trust in AI technologies and digital platforms more broadly.
