AI Chatbots Misled by Fake Disease, Raising Concerns Over Reliability
Swedish researchers conducted an experiment to test the reliability of AI chatbots by feeding them a fake medical diagnosis called 'bixonimania.' This fictitious condition, characterized by symptoms like pinkish eyelids and sore eyes, was accompanied by phony scientific studies. The AI chatbots, including ChatGPT, Google's Gemini, and Microsoft's Copilot, accepted the fake information and provided medical advice based on it. The experiment, led by Almira Osmanovic Thunström from the University of Gothenburg, aimed to highlight the importance of skepticism when interpreting information from AI. The fake disease even made its way into blog posts and was cited in peer-reviewed literature, demonstrating the potential for misinformation to spread through AI systems.