Are AI Chatbots Like ChatGPT, Gemini Giving You Wrong Diagnoses? Here's The Truth

Artificial Intelligence may appear confident, but have you ever wondered what may happen if it gives you a wrong diagnosis of your medical reports? A new report has highlighted that several AI chatbots may give you wrong advice when asked to diagnose your medical conditions without detailed information. The findings have raised concerns about the growing reliance on treating patients with the support of AI, especially in the early stages of their diseases. Here’s What The Report NotesAccording to an FT report, the study published on the Jama Network Open on Monday, tested several AI models and used over 25 clinical vignettes based on a standard medical reference text. While AI can perform well once a sufficient amount of clinical data is available

to it, researchers found that it may struggle at the initial stages of medical reasoning. It can face challenges because the symptoms might be incomplete and vague, marking a crucial stage for the treatment, where doctors are needed for their experience. As per the research, when theAImodels were given the task to analyse different diagnoses with partial information and offering multiple possible conditions, the failure rate of the AI was found to be less than 80 per cent across different models. It is important to note that once sufficient details, including examination findings and lab results, were given to the AI, it showed accuracy. In this case, the failure rate was less than 40 per cent, with the top-AI platforms scoring more than 90 per cent accuracy rate. The research evaluated LLMs from Anthropic, OpenAI, xAI, and DeepSeek.

What Are The Dangers Of Using AI?The findings note a major limitation of AI usage in healthcare. The AI may be confident even when it may not have the complete reasoning needed for the diagnosis. This can eventually be risky when users are not aware of their symptoms and are mainly depending on the AI tools.s Major AI developers acknowledged the risk, and some claimed that their systems are designed to redirect users to professionals.