Implementation of a curriculum on communicating diagnostic uncertainty for clerkship-level medical students: a pseudorandomized and controlled study
-
Neha Bansal Etherington
, Casey N. McQuade
, Amar Kohli , Deborah DiNardo , Scott Rothenberger und Eliana Bonifacino
Abstract
Objectives
Physicians rarely receive formal training on communicating diagnostic uncertainty to patients. Best practices in timing and educational strategies are not established. We aimed to develop, implement and assess a curriculum on communicating uncertainty for medical students.
Methods
This was a pseudorandomized and controlled study. Students on their Internal Medicine Clerkship during the study period from February to August 2023 were invited to participate and separated into control and intervention groups based on assigned rotation site. Students in the intervention group received a curriculum on communicating diagnostic uncertainty. All students completed a subscale of the Physicians’ Reaction to Uncertainty Scale (PRUS) at the beginning of their clerkship and at the end of week 4 and an Objective Structured Clinical Examination (OSCE) at the end of week 4.
Results
Fifty-four students participated in the curriculum (29 intervention, 25 control). Intervention group students scored 2.13 points higher than control group students on their skills assessment (mean OSCE for intervention group=14.3, control group=12.17, p<0.001). PRUS increased in both groups, indicating improved tolerance of uncertainty, with no significant difference in change in PRUS between groups (mean change in PRUS for intervention group=2.68, control group=4.82, p=0.33). 97.7 % of students agreed that a curriculum on uncertainty should be included in their medical training.
Conclusions
Students who participated in a curriculum on communication of uncertainty demonstrated superior skills in communicating uncertainty during their OSCE. There was a significant increase in PRUS indicating decreased stress associated with uncertainty for all students. This may reflect high levels of baseline stress associated with starting a clerkship, maturation, exposure to cases, or role-modeling by the clinical team.
Funding source: Gordon and Betty Moore Foundation
Funding source: Society to Improve Diagnosis in Medicine
Funding source: Thomas H Nimick Research Fund
Acknowledgments
The authors wish to thank Dr. Reed Van Deusen and the simulation education team at the University of Pittsburgh School of Medicine for their contributions to SP case development and implementation.
-
Research ethics: The project met criteria for exemption for educational strategies and curricula by the University of Pittsburgh Institutional Review Board.
-
Informed consent: Participants were informed of the study using a pre-approved script at their clerkship orientation and were given the opportunity to request that their work not be used for research purposes.
-
Author contributions: All authors have accepted responsibility for the entire content of this manuscript and approved its submission. Neha Bansal Etherington is the first author and corresponding author. She is a board-certified internist, Associate Professor of Clinical Medicine in the Department of Medicine at the Lewis Katz School of Medicine at Temple University, and Associate Program Director for the Internal Medicine Residency Program at Temple University Hospital in Philadelphia, PA. Casey McQuade is a board-certified internist, Assistant Professor of Medicine in the Department of Medicine, and co-Lead of the Clinical Reasoning Thread for the University of Pittsburgh School of Medicine in Pittsburgh, PA. Amar Kohli is a board-certified internist, Assistant Professor of Medicine in the Department of Medicine and Clerkship Director of the Adult Inpatient Internal Medicine Clerkship at the University of Pittsburgh School of Medicine in Pittsburgh, PA. Deborah DiNardo is a board-certified internist, Associate Professor of Medicine and co-Lead of the Clinical Reasoning Thread for the University of Pittsburgh School of Medicine, and Associate Program Director for Outpatient VA Education at the University of Pittsburgh Internal Medicine Residency Program, in Pittsburgh, PA. Scott Rothenberger is a statistician and Assistant Professor of Medicine in the Department of Medicine at the University of Pittsburgh School of Medicine in Pittsburgh, PA. Eliana Bonifacino is the senior author. She is a board-certified internist and Academic Hospitalist at MedStar Washington Hospital Center in Washington, D.C.
-
Use of Large Language Models, AI and Machine Learning Tools: None declared.
-
Conflict of interest: The authors state no conflict of interest.
-
Research funding: This project was supported by the Thomas H Nimick Research Fund and by the Society to Improve Diagnosis in Medicine.
-
Data availability: The participants of this study did not give written consent for their data to be shared publicly, so due to the sensitive nature of the research supporting data is not available.
References
1. Bhise, V, Rajan, SS, Sittig, DF, Morgan, RO, Chaudhary, P, Singh, H. Defining and measuring diagnostic uncertainty in medicine: a systematic review. J Gen Intern Med 2018;33:103–15. https://doi.org/10.1007/s11606-017-4164-1. Epub 2017 Sep 21.Suche in Google Scholar PubMed PubMed Central
2. Alam, R, Cheraghi-Sohi, S, Panagioti, M, Esmail, A, Campbell, S, Panagopoulou, E. Managing diagnostic uncertainty in primary care: a systematic critical review. BMC Fam Pract 2017;18:79. https://doi.org/10.1186/s12875-017-0650-0.Suche in Google Scholar PubMed PubMed Central
3. Hillen, MA, Gutheil, CM, Strout, TD, Smets, EMA, Han, PKJ. Tolerance of uncertainty: conceptual analysis, integrative model, and implications for healthcare. Soc Sci Med 2017;180:62–75. https://doi.org/10.1016/j.socscimed.2017.03.024. Epub 2017 Mar 14.Suche in Google Scholar PubMed
4. Hancock, J, Mattick, K. Tolerance of ambiguity and psychological well-being in medical training: a systematic review. Med Educ 2020;54:125–37. https://doi.org/10.1111/medu.14031. Epub 2019 Dec 22.Suche in Google Scholar PubMed PubMed Central
5. Stephens, GC, Sarkar, M, Lazarus, MD. I was uncertain, but I was acting on it’: a longitudinal qualitative study of medical students’ responses to uncertainty. Med Educ 2024;58:869–79. https://doi.org/10.1111/medu.15269.Suche in Google Scholar PubMed
6. Santhosh, L, Chou, CL, Connor, DM. Diagnostic uncertainty: from education to communication. Diagn (Berl). 2019;6:121–6. https://doi.org/10.1515/dx-2018-0088.Suche in Google Scholar PubMed
7. Simpkin, AL, Armstrong, KA. Communicating uncertainty: a narrative review and framework for future research. J Gen Intern Med 2019;34:2586–91. https://doi.org/10.1007/s11606-019-04860-8. Epub 2019 Jun 13.Suche in Google Scholar PubMed PubMed Central
8. Moulder, G, Harris, E, Santhosh, L. Teaching the science of uncertainty. Diagn (Berl). 2022;10:13–18. https://doi.org/10.1515/dx-2022-0045.Suche in Google Scholar PubMed
9. Olson, A, Rencic, J, Cosby, K, Rusz, D, Papa, F, Croskerry, P, et al.. Competencies for improving diagnosis: an interprofessional framework for education and training in healthcare. Diagnosis 2019;6:335–41. https://doi.org/10.1515/dx-2018-0107.Suche in Google Scholar PubMed
10. Patel, P, Hancock, J, Rogers, M, Pollard, SR. Improving uncertainty tolerance in medical students: a scoping review. Med Educ 2022;56:1163–73. https://doi.org/10.1111/medu.14873. Epub 2022 Jul 18.Suche in Google Scholar PubMed PubMed Central
11. Poluch, M, Feingold-Link, J, Ankam, N, Kilpatrick, J, Cameron, K, Chandra, S, et al.. I don’t have a diagnosis for you: preparing medical students to communicate diagnostic uncertainty in the emergency department. MedEdPORTAL 2022;18:11218. https://doi.org/10.15766/mep_2374-8265.11218.Suche in Google Scholar PubMed PubMed Central
12. Olson, ME, Borman-Shoap, E, Mathias, K, Barnes, TL, Olson, APJ. Case-based simulation empowering pediatric residents to communicate about diagnostic uncertainty. Diagn (Berl). 2018;5:243–8. https://doi.org/10.1515/dx-2018-0025.Suche in Google Scholar PubMed
13. Rising, KL, Cameron, KA, Salzman, DH, Papanagnou, D, Doty, AMB, Piserchia, K, et al.. Communicating diagnostic uncertainty at emergency department discharge: a simulation-based mastery learning randomized trial. Acad Med 2023;98:384–93. https://doi.org/10.1097/ACM.0000000000004993. Epub 2022 Oct 4.Suche in Google Scholar PubMed
14. Torre, DM, Daley, BJ, Sebastian, JL, Elnicki, DM. Overview of current learning theories for medical educators. Am J Med 2006;119:903–7. https://doi.org/10.1016/j.amjmed.2006.06.037.Suche in Google Scholar PubMed
15. Simpkin, AL, Schwartzstein, RM. Tolerating uncertainty – the next medical revolution? N Engl J Med 2016;375:1713–15. https://doi.org/10.1056/NEJMp1606402.Suche in Google Scholar PubMed
16. Rising, KL, Powell, RE, Cameron, KA, Salzman, DH, Papanagnou, D, Doty, AMB, et al.. Development of the uncertainty communication checklist: a patient-centered approach to patient discharge from the emergency department. Acad Med 2020;95:1026–34. https://doi.org/10.1097/ACM.0000000000003231.Suche in Google Scholar PubMed PubMed Central
17. Salzman, DH, Rising, KL, Cameron, KA, Powell, RE, Papanagnou, D, Doty, A, et al.. Setting a minimum passing standard for the uncertainty communication checklist through patient and physician engagement. J Grad Med Educ 2020;12:58–65. https://doi.org/10.4300/JGME-D-19-00483.1.Suche in Google Scholar PubMed PubMed Central
18. Dahm, MR, Crock, C. Understanding and communicating uncertainty in achieving diagnostic excellence. JAMA 2022;327:1127–8. https://doi.org/10.1001/jama.2022.2141.Suche in Google Scholar PubMed
19. Dahm, MR, Cattanach, W, Williams, M, Basseal, JM, Gleason, K, Crock, C. Communication of diagnostic uncertainty in primary care and its impact on patient experience: an integrative systematic review. J Gen Intern Med 2023;38:738–54. https://doi.org/10.1007/s11606-022-07768-y. Epub 2022 Sep 20.Suche in Google Scholar PubMed PubMed Central
20. Gerrity, MS, DeVellis, RF, Earp, JA. Physicians’ reactions to uncertainty in patient care. A new measure and new insights. Med Care 1990;28:724–36. https://doi.org/10.1097/00005650-199008000-00005.Suche in Google Scholar PubMed
21. Gerrity, MS, White, KP, DeVellis, RF, Dittus, RS. Physicians’ reactions to uncertainty: refining the constructs and scales. Motiv Emot 1995;19:175–91. https://doi.org/10.1007/BF02250510.Suche in Google Scholar
22. Stephens, GC, Lazarus, MD, Sarkar, M, Karim, MN, Wilson, AB. Identifying validity evidence for uncertainty tolerance scales: a systematic review. Med Educ 2023;57:844–56. https://doi.org/10.1111/medu.15014. Epub 2023 Jan 13.Suche in Google Scholar PubMed
23. Stephens, GC, Karim, MN, Sarkar, M, Wilson, AB, Lazarus, MD. Reliability of uncertainty tolerance scales implemented among physicians and medical students: a systematic review and meta-analysis. Acad Med 2022;97:1413–22. https://doi.org/10.1097/ACM.0000000000004641. Epub 2022 Mar 1.Suche in Google Scholar PubMed
24. Valentine, KD, Leavitt, L, Sepucha, KR, Atlas, SJ, Simmons, L, Siegel, L, et al.. Uncertainty tolerance among primary care physicians: relationship to shared decision making-related perceptions, practices, and physician characteristics. Patient Educ Couns 2024;123:108232. https://doi.org/10.1016/j.pec.2024.108232. Epub 2024 Mar 2.Suche in Google Scholar PubMed PubMed Central
Supplementary Material
This article contains supplementary material (https://doi.org/10.1515/dx-2025-0006).
© 2025 Walter de Gruyter GmbH, Berlin/Boston
Artikel in diesem Heft
- Frontmatter
- Reviews
- Accuracy of pulse wave velocity for screening coronary artery disease: a systematic review and meta-analysis
- Prenatal screening for genetic disorders: updated guidelines, proposed counseling, a holistic approach for primary health care providers in developing countries
- A scoping review of fever of unknown origin with normal serum C-reactive protein
- Mini Review
- Overview of dengue diagnostic limitations and potential strategies for improvement
- Opinion Papers
- Demystifying cognitive bias in the diagnostic process for frontline clinicians and educators; new words for old ideas
- Physicians’ prism: illuminating history with structured expertise
- Original Articles
- Implementation of a curriculum on communicating diagnostic uncertainty for clerkship-level medical students: a pseudorandomized and controlled study
- A synthesized differential diagnosis is associated with fewer diagnostic errors compared to an inventorial list
- Equity-Driven Diagnostic Excellence framework: An upstream approach to minimize risk of diagnostic inequity
- Two decades of autopsy-detected diagnostic errors in Japan
- Does management reasoning display context specificity? An exploration of sleep loss and other distracting situational (contextual) factors in clinical reasoning
- Cognitive biases in osteopathic diagnosis: a mixed study among French osteopaths
- Racial and ethnic disparities in pediatric emergency department patients with missed opportunities for diagnostic excellence
- Diagnostic accuracy of non-mydriatic fundus photography as a triage and telemedicine tool for patients with vision loss
- “Innumerable” lesion burden on brain MRI ‒ a diagnostic approach
- Factors associated with positive findings of deep infection on computed tomography among patients with extremity cellulitis
- Exploring emergency department providers’ uncertainty in neurological clinical reasoning
- Analytical performance and user-friendliness of four point-of-care measuring systems for monitoring prothrombin time international normalized ratio in the hands of the intended users
- Fetal hematological phenotypes of various hemoglobinopathies and demonstration of embryonic hemoglobins on capillary electrophoresis: a large cohort data from prenatal screening program
- Development and assessment of autoverification system for routine coagulation assays in inpatient and outpatient settings of tertiary care hospital: algorithm performance and impact on laboratory efficiency
- Validation of new, circulating biomarkers for gliomas
- Short Communications
- Using language to evaluate curricular impact: a novel approach in assessing clinical reasoning curricula
- Comparative evaluation of routine coagulation testing on Stago sthemO 301 and Werfen ACL TOP 750
- Letters to the Editor
- Reversible systemic vasoconstriction syndrome: a new diagnostic family of generalized vasospasm in multiple organs
- The value of designating symptoms as “vague” in diagnosis
- Immunoglobulin E in an inverted skin-prick test for rapid detection of cutaneous antigens
Artikel in diesem Heft
- Frontmatter
- Reviews
- Accuracy of pulse wave velocity for screening coronary artery disease: a systematic review and meta-analysis
- Prenatal screening for genetic disorders: updated guidelines, proposed counseling, a holistic approach for primary health care providers in developing countries
- A scoping review of fever of unknown origin with normal serum C-reactive protein
- Mini Review
- Overview of dengue diagnostic limitations and potential strategies for improvement
- Opinion Papers
- Demystifying cognitive bias in the diagnostic process for frontline clinicians and educators; new words for old ideas
- Physicians’ prism: illuminating history with structured expertise
- Original Articles
- Implementation of a curriculum on communicating diagnostic uncertainty for clerkship-level medical students: a pseudorandomized and controlled study
- A synthesized differential diagnosis is associated with fewer diagnostic errors compared to an inventorial list
- Equity-Driven Diagnostic Excellence framework: An upstream approach to minimize risk of diagnostic inequity
- Two decades of autopsy-detected diagnostic errors in Japan
- Does management reasoning display context specificity? An exploration of sleep loss and other distracting situational (contextual) factors in clinical reasoning
- Cognitive biases in osteopathic diagnosis: a mixed study among French osteopaths
- Racial and ethnic disparities in pediatric emergency department patients with missed opportunities for diagnostic excellence
- Diagnostic accuracy of non-mydriatic fundus photography as a triage and telemedicine tool for patients with vision loss
- “Innumerable” lesion burden on brain MRI ‒ a diagnostic approach
- Factors associated with positive findings of deep infection on computed tomography among patients with extremity cellulitis
- Exploring emergency department providers’ uncertainty in neurological clinical reasoning
- Analytical performance and user-friendliness of four point-of-care measuring systems for monitoring prothrombin time international normalized ratio in the hands of the intended users
- Fetal hematological phenotypes of various hemoglobinopathies and demonstration of embryonic hemoglobins on capillary electrophoresis: a large cohort data from prenatal screening program
- Development and assessment of autoverification system for routine coagulation assays in inpatient and outpatient settings of tertiary care hospital: algorithm performance and impact on laboratory efficiency
- Validation of new, circulating biomarkers for gliomas
- Short Communications
- Using language to evaluate curricular impact: a novel approach in assessing clinical reasoning curricula
- Comparative evaluation of routine coagulation testing on Stago sthemO 301 and Werfen ACL TOP 750
- Letters to the Editor
- Reversible systemic vasoconstriction syndrome: a new diagnostic family of generalized vasospasm in multiple organs
- The value of designating symptoms as “vague” in diagnosis
- Immunoglobulin E in an inverted skin-prick test for rapid detection of cutaneous antigens