Analyzing diagnostic errors in the acute setting: a process-driven approach
-
Jacqueline A. Griffin
, Kevin Carr
, Kerrin Bersani , Nicholas Piniella , Daniel Motta-Calderon , Maria Malik , Alison Garber , Kumiko Schnock , Ronen Rozenblum , David W. Bates , Jeffrey L. Schnipper and Anuj K. Dalal
Abstract
Objectives
We describe an approach for analyzing failures in diagnostic processes in a small, enriched cohort of general medicine patients who expired during hospitalization and experienced medical error. Our objective was to delineate a systematic strategy for identifying frequent and significant failures in the diagnostic process to inform strategies for preventing adverse events due to diagnostic error.
Methods
Two clinicians independently reviewed detailed records of purposively sampled cases identified from established institutional case review forums and assessed the likelihood of diagnostic error using the Safer Dx instrument. Each reviewer used the modified Diagnostic Error Evaluation and Research (DEER) taxonomy, revised for acute care (41 possible failure points across six process dimensions), to characterize the frequency of failure points (FPs) and significant FPs in the diagnostic process.
Results
Of 166 cases with medical error, 16 were sampled: 13 (81.3%) had one or more diagnostic error(s), and a total of 113 FPs and 30 significant FPs were identified. A majority of significant FPs (63.3%) occurred in “Diagnostic Information and Patient Follow-up” and “Patient and Provider Encounter and Initial Assessment” process dimensions. Fourteen (87.5%) cases had a significant FP in at least one of these dimensions.
Conclusions
Failures in the diagnostic process occurred across multiple dimensions in our purposively sampled cohort. A systematic analytic approach incorporating the modified DEER taxonomy, revised for acute care, offered critical insights into key failures in the diagnostic process that could serve as potential targets for preventative interventions.
Funding source: Agency for Healthcare Research and Quality
Award Identifier / Grant number: R18HS026613
Acknowledgments
We would like to thank Drs. Marc Pimentel and Mallika Mendu and Dr. Nina Chalfin for providing cases from the Brigham and Women’s Hospital (BWH) Morbidity and Mortality review process, and Brigham Health’s Hospital Medicine Unit Quality Assurance committee, respectively.
-
Research funding: This research is funded by AHRQ PSLL Award R18 - HS026613.
-
Author contributions: All authors have accepted responsibility for the entire content of this manuscript and approved its submission.
-
Competing interests: Dr. Dalal reports consulting fees from MayaMD, which makes AI software for patient engagement and decision support. Dr. Rozenblum reports having an equity in Hospitech Respiration Ltd, which makes Airway Management Solutions. Dr. Bates reports grants and personal fees from EarlySense, personal fees from CDI Negev, equity from ValeraHealth, equity from Clew, equity from MDClone, personal fees and equity from AESOP, and grants from IBM Watson Health, outside the submitted work. Authors otherwise report no conflicts of interest.
-
Informed consent: Not applicable.
-
Ethical approval: The local Institutional Review Board provided approval for the conduct of this study.
References
1. Singh, H, Graber, ML. Improving diagnosis in health care — the next imperative for patient safety. N Engl J Med 2015;373:2493–5. https://doi.org/10.1056/NEJMp1512241.Search in Google Scholar PubMed
2. Medford-Davis, L, Park, E, Shlamovitz, G, Suliburk, J, Meyer, AND, Singh, H. Diagnostic errors related to acute abdominal pain in the emergency department. Emerg Med J 2016;33:253–9. https://doi.org/10.1136/emermed-2015-204754.Search in Google Scholar PubMed
3. Zwaan, L, Schiff, GD, Singh, H. Advancing the research agenda for diagnostic error reduction. BMJ Qual Saf 2013;22(Suppl 2):52–7. https://doi.org/10.1136/bmjqs-2012-001624.Search in Google Scholar PubMed PubMed Central
4. Zwaan, L, Singh, H. Diagnostic error in hospitals : finding forests not just the big trees; 2020. pp. 1–4.10.1136/bmjqs-2020-011099Search in Google Scholar PubMed
5. Newman-Toker, DE, Pronovost, PJ. Diagnostic errors the next Frontier for patient safety. JAMA, J Am Med Assoc 2009;301:1060–2. https://doi.org/10.1001/jama.2009.249.Search in Google Scholar PubMed
6. Itri, JN, Tappouni, RR, Mceachern, RO, Pesch, AJ, Patel, SH. Fundamentals of diagnostic error in imaging. Radiographics 2018;38:1845–65. https://doi.org/10.1148/rg.2018180021.Search in Google Scholar PubMed
7. Voisin, S, Pinto, F, Morin-Ducote, G, Hudson, KB, Tourassi, GD. Predicting diagnostic error in radiology via eye-tracking and image analytics: preliminary investigation in mammography. Med Phys 2013;40:1–10. https://doi.org/10.1118/1.4820536.Search in Google Scholar PubMed
8. Bakradze, E, Liberman, AL. Diagnostic error in stroke—reasons and proposed Solutions. Curr Atherosclerosis Rep 2018;20:1–13. https://doi.org/10.1007/s11883-018-0712-3.Search in Google Scholar PubMed
9. Carberry, AR, Hanson, K, Flannery, A, Fischer, M, Gehlbach, J, Diamond, C, et al.. Diagnostic error in pediatric cancer. Clin Pediatr 2017;57:11–8. https://doi.org/10.1177/0009922816687325.Search in Google Scholar PubMed
10. Davalos, MC, Samuels, K, Meyer, AND, Thammasitboon, S, Sur, M, Roy, K, et al.. Finding diagnostic errors in children admitted to the PICU. Pediatr Crit Care Med 2017;18:265–71. https://doi.org/10.1097/pcc.0000000000001059.Search in Google Scholar
11. Perry, MF, Melvin, JE, Kasick, RT, Kersey, KE, Scherzer, DJ, Kamboj, MK, et al.. The diagnostic error index: a quality improvement initiative to identify and measure diagnostic errors. J Pediatr 2021;232:257–63. https://doi.org/10.1016/j.jpeds.2020.11.065.Search in Google Scholar PubMed
12. Gupta, A, Snyder, A, Kachalia, A, Flanders, S, Saint, S, Chopra, V. Malpractice claims related to diagnostic errors in the hospital. BMJ Qual Saf 2018;27:53–60. https://doi.org/10.1136/bmjqs-2017-006774.Search in Google Scholar PubMed
13. Graber, ML. The incidence of diagnostic error in medicine. BMJ Qual Saf 2013;22(Suppl 2):21–7. https://doi.org/10.1136/bmjqs-2012-001615.Search in Google Scholar PubMed PubMed Central
14. Gunderson, CG, Bilan, VP, Holleck, JL, Nickerson, P, Cherry, BM, Chui, P, et al.. Prevalence of harmful diagnostic errors in hospitalised adults: a systematic review and meta-analysis. BMJ Qual Saf 2020;29:1008–18. https://doi.org/10.1136/bmjqs-2019-010822.Search in Google Scholar PubMed
15. Raffel, KE, Kantor, MA, Barish, P, Esmaili, A, Lim, H, Xue, F, et al.. Prevalence and characterisation of diagnostic error among 7-day all-cause hospital medicine readmissions: a retrospective cohort study. BMJ Qual Saf 2020;29:971–9. https://doi.org/10.1136/bmjqs-2020-010896.Search in Google Scholar PubMed
16. Zwaan, L, Singh, H. The challenges in defining and measuring diagnostic error. Diagnosis 2015;2:97–103. https://doi.org/10.1515/dx-2014-0069.Search in Google Scholar PubMed PubMed Central
17. Shenvi, EC, El-Kareh, R. Clinical criteria to screen for inpatient diagnostic errors: a scoping review. Diagnosis 2014;2:3–19. https://doi.org/10.1515/dx-2014-0047.Search in Google Scholar PubMed PubMed Central
18. Singh, H, Khanna, A, Spitzmueller, C, Meyer, AND. Recommendations for using the Revised Safer Dx Instrument to help measure and improve diagnostic safety. Diagnosis 2019;6:315–23. https://doi.org/10.1515/dx-2019-0012.Search in Google Scholar PubMed
19. Mendu, ML, Lu, Y, Petersen, A, Tellez, MG, Beloff, J, Fiumara, K, et al.. Reflections on implementing a hospital-wide provider-based electronic inpatient mortality review system: lessons learnt. BMJ Qual Saf 2020;29:304–12. https://doi.org/10.1136/bmjqs-2019-009864.Search in Google Scholar PubMed
20. Provenzano, A, Rohan, S, Trevejo, E, Burdick, E, Lipsitz, S, Kachalia, A. Evaluating inpatient mortality: a new electronic review process that gathers information from front-line providers. BMJ Qual Saf 2015;24:31–7. https://doi.org/10.1136/bmjqs-2014-003120.Search in Google Scholar PubMed
21. Lavrakas, P. Encyclopedia of survey research methods. California: Thousand Oaks; 2008.10.4135/9781412963947Search in Google Scholar
22. Al-Mutairi, A, Meyer, AND, Thomas, EJ, Etchegaray, JM, Roy, KM, Davalos, MC, et al.. Accuracy of the safer dx instrument to identify diagnostic errors in primary care. J Gen Intern Med 2016;31:602–8. https://doi.org/10.1007/s11606-016-3601-x.Search in Google Scholar
23. Piniella, N, Malik, M, Bersani, K, Schnock, K, Garabedian, P, Bates, DW, et al.. Developing an electronic chart review tool to identify and assess diagnostic errors in the acute care setting. Washington DC; 2019.Search in Google Scholar
24. Schiff, GD, Hasan, O, Kim, S, Abrams, R, Cosby, K, Lambert, BL, et al.. Diagnostic error in medicine: analysis of 583 physician-reported errors. Arch Intern Med 2009;169:1881–7. https://doi.org/10.1001/archinternmed.2009.333.Search in Google Scholar
25. Schiff, GD, Kim, S, Abrams, R, Cosby, K, Lambert, B, Elstein, AS, et al.. Diagnosing diagnosis errors: lessons from a multi-institutional collaborative project. In: Henriksen, K, Battles, JB, Marks, ES, Lewin, DI, editors. Rockville (MD); 2005.Search in Google Scholar
26. Saber Tehrani, AS, Lee, HW, Mathews, SC, Shore, A, Makary, MA, Pronovost, PJ, et al.. 25-Year summary of US malpractice claims for diagnostic errors 1986-2010: an analysis from the National Practitioner Data Bank. BMJ Qual Saf 2013;22:672–80. https://doi.org/10.1136/bmjqs-2012-001550.Search in Google Scholar
27. Ryan, AM. Paid malpractice claims for adverse events in inpatient and outpatient settings (Journal of the American Medical Association (2011) 305, 23 (2427-2431)). JAMA, J Am Med Assoc 2011;306:384. https://doi.org/10.1001/jama.2011.1046.Search in Google Scholar
28. Schaffer, AC, Jena, AB, Seabury, SA, Singh, H, Chalasani, V, Kachalia, A. Rates and characteristics of paid malpractice claims among US Physicians by Specialty, 1992-2014. JAMA Intern Med 2017;177:710–8. https://doi.org/10.1001/jamainternmed.2017.0311.Search in Google Scholar
29. Singh, H, Sittig, DF. Advancing the science of measurement of diagnostic errors in healthcare: the Safer Dx framework. BMJ Qual Saf 2015;24:103–10. https://doi.org/10.1136/bmjqs-2014-003675.Search in Google Scholar
30. Roy, CL, Rothschild, JM, Dighe, AS, Schiff, GD, Graydon-Baker, E, Lenoci-Edwards, J, et al.. An initiative to improve the management of clinically significant test results in a large health care network. Joint Comm J Qual Patient Saf 2013;39:517–27. https://doi.org/10.1016/s1553-7250(13)39068-0.Search in Google Scholar
31. Garber, A, Wu, L, Malik, M, Carr, K, Bersani, K, Fraser, H, et al.. Design and development OF a diagnostic time-out to address diagnostic errors in acute care. In: Abstract published at hospital medicine 2020, virtual competition abstract 386 journal of hospital medicine; 2021.Search in Google Scholar
32. Kipnis, P, Turk, BJ, Wulf, DA, LaGuardia, JC, Liu, V, Churpek, MM, et al.. Development and validation of an electronic medical record- based alert score for detection of inpatient deterioration outside the ICU. J Biomed Inf 2016;64:10–9. https://doi.org/10.1016/j.jbi.2016.09.013.Search in Google Scholar PubMed PubMed Central
33. Dalal, AK, Schnipper, JL. Care team identification in the electronic health record: a critical first step for patient-centered communication. J Hosp Med 2016;11:381–5. https://doi.org/10.1002/jhm.2542.Search in Google Scholar PubMed
Supplementary Material
The online version of this article offers supplementary material (https://doi.org/10.1515/dx-2021-0033).
© 2021 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Editorial
- From Camille Nούς to Apollonian and the Dionysian scientists
- Review
- The role of D-dimer in periprosthetic joint infection: a systematic review and meta-analysis
- Mini Reviews
- Updated picture of SARS-CoV-2 variants and mutations
- Systematic review and cumulative meta-analysis of the diagnostic accuracy of glial fibrillary acidic protein vs. S100 calcium binding protein B as blood biomarkers in observational studies of patients with mild or moderate acute traumatic brain injury
- Opinion Papers
- The 6C model for accurately capturing the patient’s medical history
- Webside manner: maskless communication
- Original Articles
- Ways that nurse practitioner students self-explain during diagnostic reasoning
- Diagnostic reasoning: relationships among expertise, accuracy, and ways that nurse practitioner students self-explain
- Perspectives on the current state of pre-clerkship clinical reasoning instruction in United States medical schools: a survey of clinical skills course directors
- Use of a structured approach and virtual simulation practice to improve diagnostic reasoning
- Analyzing diagnostic errors in the acute setting: a process-driven approach
- Morning report goes virtual: learner experiences in a virtual, case-based diagnostic reasoning conference
- Stroke hospitalization after misdiagnosis of “benign dizziness” is lower in specialty care than general practice: a population-based cohort analysis of missed stroke using SPADE methods
- Discrepancy between emergency department admission diagnosis and hospital discharge diagnosis and its impact on length of stay, up-triage to the intensive care unit, and mortality
- Automated capture-based NGS workflow: one thousand patients experience in a clinical routine framework
- Short Communication
- Characterizing the relationship between diagnostic intensity and quality of care
- Case Reports – Lessons in Clinical Reasoning
- Lessons in clinical reasoning ‒ pitfalls, myths, and pearls: a case of confusion, disequilibrium, and “picking at the air”
- Hickam’s dictum, Occam’s razor, and Crabtree’s bludgeon: a case of renal failure and a clavicular mass
- Letters to the Editor
- Three learning concepts to improve diagnosis and enhance the practice of medicine
- Distributed cognition: a framework for conceptualizing telediagnosis in teams
- Performance of Fujirebio Espline SARS-CoV-2 rapid antigen test for identifying potentially infectious individuals
Articles in the same Issue
- Frontmatter
- Editorial
- From Camille Nούς to Apollonian and the Dionysian scientists
- Review
- The role of D-dimer in periprosthetic joint infection: a systematic review and meta-analysis
- Mini Reviews
- Updated picture of SARS-CoV-2 variants and mutations
- Systematic review and cumulative meta-analysis of the diagnostic accuracy of glial fibrillary acidic protein vs. S100 calcium binding protein B as blood biomarkers in observational studies of patients with mild or moderate acute traumatic brain injury
- Opinion Papers
- The 6C model for accurately capturing the patient’s medical history
- Webside manner: maskless communication
- Original Articles
- Ways that nurse practitioner students self-explain during diagnostic reasoning
- Diagnostic reasoning: relationships among expertise, accuracy, and ways that nurse practitioner students self-explain
- Perspectives on the current state of pre-clerkship clinical reasoning instruction in United States medical schools: a survey of clinical skills course directors
- Use of a structured approach and virtual simulation practice to improve diagnostic reasoning
- Analyzing diagnostic errors in the acute setting: a process-driven approach
- Morning report goes virtual: learner experiences in a virtual, case-based diagnostic reasoning conference
- Stroke hospitalization after misdiagnosis of “benign dizziness” is lower in specialty care than general practice: a population-based cohort analysis of missed stroke using SPADE methods
- Discrepancy between emergency department admission diagnosis and hospital discharge diagnosis and its impact on length of stay, up-triage to the intensive care unit, and mortality
- Automated capture-based NGS workflow: one thousand patients experience in a clinical routine framework
- Short Communication
- Characterizing the relationship between diagnostic intensity and quality of care
- Case Reports – Lessons in Clinical Reasoning
- Lessons in clinical reasoning ‒ pitfalls, myths, and pearls: a case of confusion, disequilibrium, and “picking at the air”
- Hickam’s dictum, Occam’s razor, and Crabtree’s bludgeon: a case of renal failure and a clavicular mass
- Letters to the Editor
- Three learning concepts to improve diagnosis and enhance the practice of medicine
- Distributed cognition: a framework for conceptualizing telediagnosis in teams
- Performance of Fujirebio Espline SARS-CoV-2 rapid antigen test for identifying potentially infectious individuals