Study Reveals ChatGPT's Diagnostic Accuracy for Health Symptoms
Top US Expert Answers If ChatGPT Can Diagnose Your Symptoms Accurately
Times Now NewsImage: Times Now News
A study led by Amulya Yadav at Penn State found that ChatGPT accurately diagnosed health-related queries about 76% of the time, outperforming traditional search engines. While it offers potential as a healthcare tool, especially for those lacking access to medical professionals, it cannot replace the nuanced judgment of a human doctor.
- 01ChatGPT achieved a diagnostic accuracy of approximately 76% when evaluated by board-certified physicians.
- 02The study involved over 200 health-related symptom descriptions submitted to various AI models.
- 03AI chatbots like ChatGPT significantly outperformed conventional search engines such as Google and Bing.
- 04AI systems struggle with dermatology, mental health, and internal medicine queries, where visual assessments are often necessary.
- 05The research highlights the potential of AI as an accessible healthcare tool for individuals with limited access to medical care.
Advertisement
In-Article Ad
A recent study conducted by Amulya Yadav, an associate professor at Penn State's College of Information Sciences and Technology, examined the accuracy of large language models (LLMs) like ChatGPT in diagnosing health-related symptoms. The findings revealed that ChatGPT provided accurate diagnoses about 76% of the time, outperforming traditional search engines such as Google and Bing. This research, which will be presented at the 2026 Association for Computing Machinery Fairness, Accountability and Transparency (FAccT) conference in Montreal, involved participants submitting over 200 symptom descriptions, which were then evaluated by nine board-certified physicians. While ChatGPT's conversational responses offer a more user-friendly experience compared to search engines, it lacks the ability to perform physical examinations or understand a patient's complete medical history. Despite these limitations, the study suggests that AI could be a valuable resource for individuals without access to healthcare, providing preliminary guidance on symptoms and potential warning signs. However, the researchers caution that AI should not replace human doctors, especially for complex health issues.
Advertisement
In-Article Ad
The findings suggest that AI could provide essential health information to individuals in remote areas or those facing financial barriers to healthcare.
Advertisement
In-Article Ad
Reader Poll
Do you think AI tools like ChatGPT can assist in diagnosing health symptoms effectively?
Connecting to poll...
More about Penn State University
Read the original article
Visit the source for the complete story.






