Abstract
Objectives
Diagnostic error is a global emergency. Context specificity is likely a source of the alarming rate of error and refers to the vexing phenomenon whereby a physician can see two patients with the same presenting complaint, identical history and examination findings, but due to the presence of contextual factors, decides on two different diagnoses. Studies have not empirically addressed the potential role of context specificity in management reasoning and errors with a diagnosis may not consistently translate to actual patient care.
Methods
We investigated the effect of context specificity on management reasoning in individuals working within a simulated internal medicine environment. Participants completed two ten minute back to back common encounters. The clinical content of each encounter was identical. One encounter featured the presence of carefully controlled contextual factors (CF+ vs. CF−) designed to distract from the correct diagnosis and management. Immediately after each encounter participants completed a post encounter form.
Results
Twenty senior medical students participated. The leading diagnosis score was higher (mean 0.88; SEM 0.07) for the CF− encounter compared with the CF+ encounter (0.58; 0.1; 95 % CI 0.04–0.56; p=0.02). Management reasoning scores were higher (mean 5.48; SEM 0.66) for the CF− encounter compared with the CF+ encounter (3.5; 0.56; 95 % CI 0.69–3.26; p=0.01). We demonstrated context specificity in both diagnostic and management reasoning.
Conclusions
This study is the first to empirically demonstrate that management reasoning, which directly impacts the patient, is also influenced by context specificity, providing additional evidence of context specificity’s role in unwanted variance in health care.
Acknowledgments
We are greatly indebted to the team at Kirklands Hospital Simulation Centre in Bothwell, Lanarkshire.
-
Research ethics: College of MVLS, University of Glasgow approved the study. The study was conducted in accordance with the Declaration of Helsinki (as revised in 2013).
-
Informed consent: Informed consent was obtained from all individuals included in this study.
-
Author contributions: The authors have accepted responsibility for the entire content of this manuscript and approved its submission. Concept: JB, MRW, SJ, SJD. Design: All. Data collection: JB, FMB, MH, CP. Analysis: JB, MRW, SJ, SJD. Drafting: JB wrote first draft. Critical Review DR: All.
-
Use of Large Language Models, AI and Machine Learning Tools: None declared.
-
Conflict of interest: The authors state no conflict of interest.
-
Research funding: None declared.
-
Data availability: The raw data can be obtained on reasonable request from the corresponding author.
-
Disclaimer: The views expressed herein are those of the authors and not necessarily those of the Department of Defense or other federal agencies.
Controlled content for both CF− and CF+ cases
Case | CF− | CF+ |
---|---|---|
Presentation | Short history dyspnoea and chest pain. Associated with orthopnea, cough without purulent sputum, bilateral ankle swelling, reduced exercise tolerance which worsened with chest pain. Patient uncertain if has lost sense of taste or smell at present as has been off food recently. Pain is both dull (not sharp) and central. Pain feels similar but ‘a bit different’ from previous MI and patient unable to explain why. Patient is certain pain is 7/10 in severity but uncertain if pain feels worse when breathing in or out. Patient feels cold and has a clenched first held over central chest (Levine sign) | Short history dyspnoea and chest pain. Associated with orthopnea, cough without purulent sputum, bilateral ankle swelling, reduced exercise tolerance which worsened with chest pain. Patient uncertain if has lost sense of taste or smell at present as has been off food recently. Pain is both dull (not sharp) and central. Pain feels similar but ‘a bit different’ from previous MI and patient unable to explain why. Patient is certain pain is 7/10 in severity but uncertain if pain feels worse when breathing in or out. Patient feels cold and has a clenched first held over central chest. (Levine’s sign) |
PMHx | 61 years old with ischaemic heart disease and previous MI, heart failure, hypertension, Type 2 diabetes | 63 years old with ischaemic heart disease and previous MI, heart failure, hypertension, Type 2 diabetes |
Drug Hx | Aspirin Furosemide Ramipril Metformin Dapagliflozin Atorvastatin NKDA Inconsistent adherence to medication |
Aspirin Bumetanide Losartan Metformin Empagliflozin Simvastatin NKDA Inconsistent adherence to medication |
SHx | Ex-smoker, alcohol within guidance, retired bus driver, married with children | Ex-smoker, alcohol within guidance, retired teacher, married without children |
FHx | Father had ‘heart attack’ | Several family members have T2DM |
Observations | Apyrexial, tachycardia, hypertensive, oxygen therapy maintains saturations | Apyrexial, tachycardia, hypertensive, oxygen therapy maintains saturations |
Examination | Levine’s sign + (see above) Heart sounds normal Bibasal crepitations Bilateral pedal oedema |
Levine’s sign + (see above) Heart sounds normal Bibasal crepitations Bilateral pedal oedema |
ECG findings | Sinus rhythm and old LBBB | Sinus rhythm and old LBBB |
References
1. National academies of sciences, engineering and medicine, improving diagnosis in health care. Washington, DC: National Academies Press; 2015.Search in Google Scholar
2. Graber, ML, Franklin, N, Gordon, R. Diagnostic error in internal medicine. Arch Intern Med 2005;165:1493–9. https://doi.org/10.1001/archinte.165.13.1493.Search in Google Scholar PubMed
3. Norman, GR, Eva, KW. Diagnostic error and clinical reasoning. Med Educ 2010;44:94–100. https://doi.org/10.1111/j.1365-2923.2009.03507.x.Search in Google Scholar PubMed
4. Norman, GR, Monteiro, SD, Sherbino, J, Ilgen, JS, SchmidtHG, MS. The causes of errors in clinical rea-soning: cognitive biases, knowledge deficits, and dualprocess thinking. Acad Med 2017;92:23–30. https://doi.org/10.1097/acm.0000000000001421.Search in Google Scholar PubMed
5. Croskerry, P. Diagnostic failure: a cognitive and affective approach. In: Henriksen, K, Battles, JB, Marks, ES, editors. Advances in patient safety: from research toI mplementation. Volume concepts and methodology. Rockville, US: Agency For Healthcare ResearchQuality; 2005, 2:241–54 pp.10.1037/e448242006-001Search in Google Scholar
6. Durning, SJ, Artino, AR, Boulet, JR, Dorrance, K, van der Vleuten, C, Schuwirth, L. The impact of selected contextual factors on experts’ clinical reasoning performance (does context impact clinical reasoning performance in experts?). Adv Health Sci Educ Theory Pract 2012;17:65–79. https://doi.org/10.1007/s10459-011-9294-3.Search in Google Scholar PubMed
7. Boyle, JG, Walters, MR, Jamieson, S, Durning, SJ. Clinical reasoning in the wild: premature closure during the COVID-19 pandemic. Diagnosis 2020;7:177–9. https://doi.org/10.1515/dx-2020-0061.Search in Google Scholar PubMed
8. Boyle, JG, Walters, MR, Jamieson, S, Durning, SJ. Sharing the bandwidth in cognitively overloaded teams and systems: mechanistic insights from a walk on the wild side of clinical reasoning. Teach Learn Med 2022;34:215–22. https://doi.org/10.1080/10401334.2021.1924723.Search in Google Scholar PubMed
9. Cook, DA, Sherbino, J, Durning, SJ. Management reasoning: beyond the diagnosis. JAMA 2018;319:2267–8. https://doi.org/10.1001/jama.2018.4385.Search in Google Scholar PubMed
10. Cook, DA, Durning, SJ, Sherbino, J, Gruppen, LD. Management reasoning: implications for health professions educators and a research agenda. Acad Med 2019;94:1310–16. https://doi.org/10.1097/acm.0000000000002768.Search in Google Scholar PubMed
11. Cook, DA, Stephenson, CR, Gruppen, LD, Durning, SJ. Management reasoning: empirical determination of key features and a conceptual model. Acad Med 2023;98:80–7. https://doi.org/10.1097/acm.0000000000004810.Search in Google Scholar PubMed
12. Ten Cate, O, Khursigara-Slattery, N, Cruess, RL, Hamstra, SJ, Steinert, Y, Sternszus, R. Medical competence as a multilayered construct. Med Educ 2024;58:93–104. https://doi.org/10.1111/medu.15162.Search in Google Scholar PubMed
13. Boyle, JG, Walters, MR, Jamieson, S, Durning, SJ. Distributed cognition: theoretical insights and practical applications to health professions education: AMEE Guide No. 159. Med Teach 2023;45:1323–33. https://doi.org/10.1080/0142159x.2023.2190479.Search in Google Scholar
14. Boyle, JG, Walters, MR, Jamieson, S, Durning, SJ. Reframing context specificity in team diagnosis using the theory of distributed cognition. Diagnosis 2023;10:235–41. https://doi.org/10.1515/dx-2022-0100.Search in Google Scholar PubMed
15. Durning, SJ, Artino, A, Boulet, J, La Rochelle, J, Van der Vleuten, C, Arze, B, et al.. The feasibility, reliability, and validity of a post-encounter form for evaluating clinical reasoning. Med Teach 2012;34:30–7. https://doi.org/10.3109/0142159x.2011.590557.Search in Google Scholar PubMed
16. West, CP, Dyrbye, LN, Satele, DV, Sloan, JA, Shanafelt, TD. Concurrent validity of single-item measures of emotional exhaustion and depersonalization in burnout assessment. J Gen Intern Med 2012;27:1445–52. https://doi.org/10.1007/s11606-012-2015-7.Search in Google Scholar PubMed PubMed Central
17. Johns, MW. A new method for measuring daytime sleepiness: the Epworth sleepiness scale. Sleep 1991;14:540–5. https://doi.org/10.1093/sleep/14.6.540.Search in Google Scholar PubMed
18. Johnson, WR, Artino, ARJr, Durning, SJ. Using the think aloud protocol in health professions education: an interview method for exploring thought processes: AMEE Guide No. 151. Med Teach 2023;45:937–48. https://doi.org/10.1080/0142159x.2022.2155123.Search in Google Scholar
19. Croskerry, P. A universal model of diagnostic reasoning. Acad Med 2009;84:1022–8. https://doi.org/10.1097/acm.0b013e3181ace703.Search in Google Scholar PubMed
20. Durning, SJ, Trowbridge, RL, Schuwirth, L. Clinical reasoning and diagnostic error: a call to merge two worlds to improve patient care. Acad Med 2020;95:1159–61. https://doi.org/10.1097/acm.0000000000003041.Search in Google Scholar PubMed
© 2024 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Editorial
- Pioneering diagnosis in Asia: advancing clinical reasoning expertise through the lens of 3M
- Short Communication
- The foundations of the diagnostic error movement: a tribute to Eta Berner, PhD
- Reviews
- Interventions to improve timely cancer diagnosis: an integrative review
- Technical aspects and clinical applications of synthetic MRI: a scoping review
- Mini Review
- Challenges and barriers for the adoption of personalized medicine in Europe: the case of Oncotype DX Breast Recurrence Score® test
- Opinion Papers
- Beyond thinking fast and slow: a Bayesian intuitionist model of clinical reasoning in real-world practice
- Diagnostic scope: the AI can’t see what the mind doesn’t know
- Guidelines and Recommendations
- CDC’s Core Elements to promote diagnostic excellence
- Original Articles
- Trends of diagnostic adverse events in hospital deaths: longitudinal analyses of four retrospective record review studies
- The effect of a provisional diagnosis on intern diagnostic reasoning: a mixed methods study
- On context specificity and management reasoning: moving beyond diagnosis
- Diagnostic errors in patients admitted directly from new outpatient visits
- Breaking the guidelines: how financial unawareness fuels guideline deviations and inefficient DVT diagnostics
- Harbingers of sepsis misdiagnosis among pediatric emergency department patients
- Factors affecting diagnostic difficulties in aseptic meningitis: a retrospective observational study
- Prenatal diagnostic errors in hemoglobin Bart’s hydrops fetalis caused by rare genetic interactions of α-thalassemia
- Screening fasting glucose before the OGTT: near-patient glucometer- or laboratory-based measurement?
- Three-way comparison of different ESR measurement methods and analytical performance assessment of TEST1 automated ESR analyzer
- Short Communications
- Medical language matters: impact of clinical summary composition on a generative artificial intelligence’s diagnostic accuracy
- Impact of meta-memory techniques in generating effective differential diagnoses in a pediatric core clerkship
Articles in the same Issue
- Frontmatter
- Editorial
- Pioneering diagnosis in Asia: advancing clinical reasoning expertise through the lens of 3M
- Short Communication
- The foundations of the diagnostic error movement: a tribute to Eta Berner, PhD
- Reviews
- Interventions to improve timely cancer diagnosis: an integrative review
- Technical aspects and clinical applications of synthetic MRI: a scoping review
- Mini Review
- Challenges and barriers for the adoption of personalized medicine in Europe: the case of Oncotype DX Breast Recurrence Score® test
- Opinion Papers
- Beyond thinking fast and slow: a Bayesian intuitionist model of clinical reasoning in real-world practice
- Diagnostic scope: the AI can’t see what the mind doesn’t know
- Guidelines and Recommendations
- CDC’s Core Elements to promote diagnostic excellence
- Original Articles
- Trends of diagnostic adverse events in hospital deaths: longitudinal analyses of four retrospective record review studies
- The effect of a provisional diagnosis on intern diagnostic reasoning: a mixed methods study
- On context specificity and management reasoning: moving beyond diagnosis
- Diagnostic errors in patients admitted directly from new outpatient visits
- Breaking the guidelines: how financial unawareness fuels guideline deviations and inefficient DVT diagnostics
- Harbingers of sepsis misdiagnosis among pediatric emergency department patients
- Factors affecting diagnostic difficulties in aseptic meningitis: a retrospective observational study
- Prenatal diagnostic errors in hemoglobin Bart’s hydrops fetalis caused by rare genetic interactions of α-thalassemia
- Screening fasting glucose before the OGTT: near-patient glucometer- or laboratory-based measurement?
- Three-way comparison of different ESR measurement methods and analytical performance assessment of TEST1 automated ESR analyzer
- Short Communications
- Medical language matters: impact of clinical summary composition on a generative artificial intelligence’s diagnostic accuracy
- Impact of meta-memory techniques in generating effective differential diagnoses in a pediatric core clerkship