Human Physicians Outperform Diagnostic Apps by Wide Margin
|
By HospiMedica International staff writers Posted on 26 Oct 2016 |
|
Doctor’s diagnoses remain vastly superior to those of 23 commonly used symptom-checker apps, according to a new study.
Researchers at Harvard Medical School (HMS; Boston, MA, USA), the Human Diagnosis Project (Washington, DC, USA), and other institutions conducted a study in which 234 internal medicine physicians evaluated 45 clinical cases of both common and uncommon conditions, with varying degrees of severity. For each scenario, the physicians had to identify the most likely diagnosis along with two additional possible diagnoses. Each clinical vignette was solved by at least 20 physicians.
The researchers then compared the diagnostic accuracy of the physicians with computer algorithm symptom checker applications. The results showed that the physicians outperformed the symptom-checker apps, listing the correct diagnosis first 72% of the time, compared with 34% of the time for the digital platforms. In addition, 84% of clinicians listed the correct diagnosis in the top three possibilities, compared with 51% for the digital symptom-checkers.
The difference between physician and computer app performance was most dramatic in more severe and less common conditions; it was smaller for less acute and more common illnesses. But despite outperforming the apps by a wide margin, physicians still made errors in about 15% of cases. According to the researchers, developing computer-based algorithms to be used in conjunction with human decision-making may help further reduce diagnostic errors. The study was published on October 10, 2016, in JAMA Internal Medicine.
“While the computer programs were clearly inferior to physicians in terms of diagnostic accuracy, it will be critical to study future generations of computer programs that may be more accurate,” said senior author associate professor of health care policy Ateev Mehrotra, PhD, of HMS. “Clinical diagnosis is currently as much art as it is science, but there is great promise for technology to help augment clinical diagnoses. That is the true value proposition of these tools.”
Related Links:
Harvard Medical School
Human Diagnosis Project
Researchers at Harvard Medical School (HMS; Boston, MA, USA), the Human Diagnosis Project (Washington, DC, USA), and other institutions conducted a study in which 234 internal medicine physicians evaluated 45 clinical cases of both common and uncommon conditions, with varying degrees of severity. For each scenario, the physicians had to identify the most likely diagnosis along with two additional possible diagnoses. Each clinical vignette was solved by at least 20 physicians.
The researchers then compared the diagnostic accuracy of the physicians with computer algorithm symptom checker applications. The results showed that the physicians outperformed the symptom-checker apps, listing the correct diagnosis first 72% of the time, compared with 34% of the time for the digital platforms. In addition, 84% of clinicians listed the correct diagnosis in the top three possibilities, compared with 51% for the digital symptom-checkers.
The difference between physician and computer app performance was most dramatic in more severe and less common conditions; it was smaller for less acute and more common illnesses. But despite outperforming the apps by a wide margin, physicians still made errors in about 15% of cases. According to the researchers, developing computer-based algorithms to be used in conjunction with human decision-making may help further reduce diagnostic errors. The study was published on October 10, 2016, in JAMA Internal Medicine.
“While the computer programs were clearly inferior to physicians in terms of diagnostic accuracy, it will be critical to study future generations of computer programs that may be more accurate,” said senior author associate professor of health care policy Ateev Mehrotra, PhD, of HMS. “Clinical diagnosis is currently as much art as it is science, but there is great promise for technology to help augment clinical diagnoses. That is the true value proposition of these tools.”
Related Links:
Harvard Medical School
Human Diagnosis Project
Gold Member
STI Test
Vivalytic Sexually Transmitted Infection (STI) Array
Gold Member
SARS‑CoV‑2/Flu A/Flu B/RSV Sample-To-Answer Test
SARS‑CoV‑2/Flu A/Flu B/RSV Cartridge (CE-IVD)
New
Syringe Pump
SP50 Series
New
Hypodermic Syringe
SurTract™ Safety Syringe
Latest Health IT News
- AI System Detects and Quantifies Chronic Subdural Hematoma
- Continuous Monitoring Platform Detects Infection Risk Across Care Transitions
- Automated System Classifies and Tracks Cardiogenic Shock Across Hospital Settings
- Voice-Driven AI System Enables Structured GI Procedure Documentation
- EMR-Based Tool Predicts Graft Failure After Kidney Transplant
- Printable Molecule-Selective Nanoparticles Enable Mass Production of Wearable Biosensors
- Smartwatches Could Detect Congestive Heart Failure
- Versatile Smart Patch Combines Health Monitoring and Drug Delivery
Channels
Artificial Intelligence
view channel
Facial Image Analysis Tracks Biological Aging, Predicts Cancer Outcomes
Biological aging is the progressive loss of physiological function that may diverge from chronological age. In cancer care, clinicians need simple tools that reflect dynamic changes in patient resilience... Read more
AI Model Uses Eye Imaging to Identify Risk of Major Systemic Diseases
Early detection of systemic disease risk remains a persistent challenge in population health screening. Cardiometabolic conditions such as diabetes, heart disease, and stroke often progress without symptoms... Read more
Critical Care
view channel
Rapid Clotting Gel Improves Emergency Bleeding Control
Uncontrolled hemorrhage remains a leading cause of preventable death in trauma and major surgery. Conventional clots can form too slowly and fail under mechanical stress, limiting hemostasis and impairing... Read more
Spinal Cord Interface Restores Bladder Control in Preclinical Study
Loss of bladder sensation and control, known as neurogenic bladder, is a pervasive consequence of spinal cord injury. Patients face incontinence, recurrent urinary infections, and life‑threatening urosepsis,... Read more
Surgical Techniques
view channel
Glasses-Free 3D Imaging Software Receives FDA Clearance for Surgical Planning
Clinicians often make three-dimensional decisions from two-dimensional scans, which can limit depth perception and slow shared understanding of complex anatomy during planning and consultation.... Read more
Noninvasive Cardiac Radiotherapy Reduces Ventricular Tachycardia Events
Life-threatening ventricular tachycardia is a rapid heart rhythm originating in the ventricles that can trigger sudden cardiac death. Patients who continue to have ventricular tachycardia despite guideline-based... Read more
Patient Care
view channel
Wearable Sleep Data Predict Adherence to Pulmonary Rehabilitation
Chronic obstructive pulmonary disease (COPD) is a long-term lung disorder that makes breathing difficult and often disturbs sleep, reducing energy for daily activities. Limited engagement in pulmonary... Read more
Revolutionary Automatic IV-Line Flushing Device to Enhance Infusion Care
More than 80% of in-hospital patients receive intravenous (IV) therapy. Every dose of IV medicine delivered in a small volume (<250 mL) infusion bag should be followed by subsequent flushing to ensure... Read more
Point of Care
view channel
Business
view channel
Johnson & Johnson Launches AI-Driven Cardiac Mapping System
Johnson & Johnson has introduced the CARTOSOUND SONATA Module for the CARTO System at the Heart Rhythm Society (HRS) 2026 meeting in Chicago. The module uses artificial intelligence with the CARTO... Read more
