Human Physicians Outperform Diagnostic Apps by Wide Margin
|
By HospiMedica International staff writers Posted on 26 Oct 2016 |
|
Doctor’s diagnoses remain vastly superior to those of 23 commonly used symptom-checker apps, according to a new study.
Researchers at Harvard Medical School (HMS; Boston, MA, USA), the Human Diagnosis Project (Washington, DC, USA), and other institutions conducted a study in which 234 internal medicine physicians evaluated 45 clinical cases of both common and uncommon conditions, with varying degrees of severity. For each scenario, the physicians had to identify the most likely diagnosis along with two additional possible diagnoses. Each clinical vignette was solved by at least 20 physicians.
The researchers then compared the diagnostic accuracy of the physicians with computer algorithm symptom checker applications. The results showed that the physicians outperformed the symptom-checker apps, listing the correct diagnosis first 72% of the time, compared with 34% of the time for the digital platforms. In addition, 84% of clinicians listed the correct diagnosis in the top three possibilities, compared with 51% for the digital symptom-checkers.
The difference between physician and computer app performance was most dramatic in more severe and less common conditions; it was smaller for less acute and more common illnesses. But despite outperforming the apps by a wide margin, physicians still made errors in about 15% of cases. According to the researchers, developing computer-based algorithms to be used in conjunction with human decision-making may help further reduce diagnostic errors. The study was published on October 10, 2016, in JAMA Internal Medicine.
“While the computer programs were clearly inferior to physicians in terms of diagnostic accuracy, it will be critical to study future generations of computer programs that may be more accurate,” said senior author associate professor of health care policy Ateev Mehrotra, PhD, of HMS. “Clinical diagnosis is currently as much art as it is science, but there is great promise for technology to help augment clinical diagnoses. That is the true value proposition of these tools.”
Related Links:
Harvard Medical School
Human Diagnosis Project
Researchers at Harvard Medical School (HMS; Boston, MA, USA), the Human Diagnosis Project (Washington, DC, USA), and other institutions conducted a study in which 234 internal medicine physicians evaluated 45 clinical cases of both common and uncommon conditions, with varying degrees of severity. For each scenario, the physicians had to identify the most likely diagnosis along with two additional possible diagnoses. Each clinical vignette was solved by at least 20 physicians.
The researchers then compared the diagnostic accuracy of the physicians with computer algorithm symptom checker applications. The results showed that the physicians outperformed the symptom-checker apps, listing the correct diagnosis first 72% of the time, compared with 34% of the time for the digital platforms. In addition, 84% of clinicians listed the correct diagnosis in the top three possibilities, compared with 51% for the digital symptom-checkers.
The difference between physician and computer app performance was most dramatic in more severe and less common conditions; it was smaller for less acute and more common illnesses. But despite outperforming the apps by a wide margin, physicians still made errors in about 15% of cases. According to the researchers, developing computer-based algorithms to be used in conjunction with human decision-making may help further reduce diagnostic errors. The study was published on October 10, 2016, in JAMA Internal Medicine.
“While the computer programs were clearly inferior to physicians in terms of diagnostic accuracy, it will be critical to study future generations of computer programs that may be more accurate,” said senior author associate professor of health care policy Ateev Mehrotra, PhD, of HMS. “Clinical diagnosis is currently as much art as it is science, but there is great promise for technology to help augment clinical diagnoses. That is the true value proposition of these tools.”
Related Links:
Harvard Medical School
Human Diagnosis Project
Gold Member
POC Blood Gas Analyzer
Stat Profile Prime Plus
New
Radiation Safety Barrier
RayShield Intensi-Barrier
New
Adjustable Mobile Barrier
M-458
Channels
Critical Care
view channel
New Ultrasound Technique Enables Safer Vein Access in Critically Ill Patient
Cannulation, the insertion of catheters into major veins near the collarbone, is a common but risky procedure that can cause complications such as pneumothorax or arterial injury. While ultrasound scanning... Read more
Wearable Devices Could Revolutionize Pregnancy Monitoring and Detect Abnormalities
Pregnancy complications such as miscarriage and preterm birth remain major risks to maternal and child health, especially in the United States, where more than 2 million women live in maternal care deserts.... Read more
Surgical Techniques
view channel
Novel Method Uses Interstitial Fluid Flow to Predict Where Brain Tumor Can Grow Next
Glioblastoma is one of the most aggressive brain cancers, with patients surviving on average only 15 months after diagnosis. Surgery and radiation can temporarily control the tumor, but the disease almost... Read more
World’s First Custom Anterior Cervical Spine Surgery Performed Using Personalized Implant
Anterior cervical fusion has been performed since the 1950s and is one of the most common spine procedures. Traditional implants are designed as one-size-fits-all, which can affect spinal alignment, healing,... Read more
Patient Care
view channel
Revolutionary Automatic IV-Line Flushing Device to Enhance Infusion Care
More than 80% of in-hospital patients receive intravenous (IV) therapy. Every dose of IV medicine delivered in a small volume (<250 mL) infusion bag should be followed by subsequent flushing to ensure... Read more
VR Training Tool Combats Contamination of Portable Medical Equipment
Healthcare-associated infections (HAIs) impact one in every 31 patients, cause nearly 100,000 deaths each year, and cost USD 28.4 billion in direct medical expenses. Notably, up to 75% of these infections... Read more
Portable Biosensor Platform to Reduce Hospital-Acquired Infections
Approximately 4 million patients in the European Union acquire healthcare-associated infections (HAIs) or nosocomial infections each year, with around 37,000 deaths directly resulting from these infections,... Read more
First-Of-Its-Kind Portable Germicidal Light Technology Disinfects High-Touch Clinical Surfaces in Seconds
Reducing healthcare-acquired infections (HAIs) remains a pressing issue within global healthcare systems. In the United States alone, 1.7 million patients contract HAIs annually, leading to approximately... Read moreBusiness
view channel
Philips and Masimo Partner to Advance Patient Monitoring Measurement Technologies
Royal Philips (Amsterdam, Netherlands) and Masimo (Irvine, California, USA) have renewed their multi-year strategic collaboration, combining Philips’ expertise in patient monitoring with Masimo’s noninvasive... Read more
B. Braun Acquires Digital Microsurgery Company True Digital Surgery
The high-end microsurgery market in neurosurgery, spine, and ENT is undergoing a significant transformation. Traditional analog microscopes are giving way to digital exoscopes, which provide improved visualization,... Read more
CMEF 2025 to Promote Holistic and High-Quality Development of Medical and Health Industry
The 92nd China International Medical Equipment Fair (CMEF 2025) Autumn Exhibition is scheduled to be held from September 26 to 29 at the China Import and Export Fair Complex (Canton Fair Complex) in Guangzhou.... Read more