

A collaborative team of researchers from the University of Minnesota Medical School, Stanford University, Beth Israel Deaconess Medical Center, and the University of Virginia published their findings in JAMA Network Open. They investigated how well doctors used GPT-4, an artificial intelligence (AI) large language model system, for patient diagnosis.
GPT- 4 Study
The study included 50 U.S.-licensed family, internal, and emergency medicine physicians. The research team discovered that providing GPT-4 to physicians as a diagnostic assistance did not significantly improve clinical reasoning when compared to conventional resources. Other major discoveries are:
- GPT-4 alone produced much higher diagnostic performance scores, outperforming physicians utilizing traditional diagnostic web tools and clinicians supported by GPT-4.
- When comparing doctors who used GPT-4 to those who used standard diagnostic resources, there was no significant improvement in diagnostic performance.
“The field of AI is expanding rapidly and impacting our lives inside and outside of medicine. It is important that we study these tools and understand how we best use them to improve the care we provide as well as the experience of providing it,” said Andrew Olson, MD, a professor at the U of M Medical School and hospitalist with M Health Fairview.
This study suggests that there are opportunities for further improvement in physician-AI collaboration in clinical practice.”
Andrew Olson, MD, Professor, University of Minnesota Medical School
These findings highlight the complexities of integrating AI into clinical practice. While GPT-4 alone produced promising outcomes, combining GPT-4 with physicians did not significantly exceed the utilization of traditional diagnostic resources. This implies a nuanced potential for AI in healthcare, underlining the need for additional research on how AI might effectively help clinical practice. Further research is needed to determine how clinicians should be trained to use these tools.
For more information: Goh, E., et al. (2024) Large Language Model Influence on Diagnostic Reasoning. JAMA Network Open. doi.org/10.1001/jamanetworkopen.2024.40969.
more recommended stories
Harmful Chemicals in Children’s Mattresses
A recent study has brought to.
TMS for Post-Stroke Aphasia Shows Remarkable Gains
A new clinical study led by.
CT Scan Overuse May Cause 1 in 20 New U.S. Cancers
A recent study published in JAMA.
Lactation Metabolism: Brain-Hormone Link Uncovered
Understanding how the body adjusts to.
Osteoarthritis Genetics Study Uncovers New Treatment Hope
Osteoarthritis- the world’s leading cause of.
Quantum Technology in Cancer Surgery: New Probe Aims to Improve Outcomes
A groundbreaking project from the University.
Antibody Breakthrough in Whooping Cough Vaccine
Whooping cough vaccine development is entering.
Bean-Based Gum Offers New Approach to Combat Influenza and Herpes
In an era where infectious diseases.
Shingles Vaccine May Cut Dementia Risk by 20%
A new study shows that the.
Scientists Unveil Next-Gen Eye-Tracking with Unmatched Precision
Eye-tracking technology has long been a.
Leave a Comment