Rate of sepsis hospitalizations after misdiagnosis in adult emergency department patients: a look-forward analysis with administrative claims data using Symptom-Disease Pair Analysis of Diagnostic Error (SPADE) methodology in an integrated health system
-
Michael A. Horberg
, Najlla Nassery
, Kevin B. Rubenstein , Julia M. Certa, Ejaz A. Shamim
, Richard Rothman , Zheyu Wang , Ahmed Hassoon , Jennifer L. Townsend , Panagis Galiatsatos , Samantha I. Pitts und David E. Newman-Toker
Abstract
Objectives
Delays in sepsis diagnosis can increase morbidity and mortality. Previously, we performed a Symptom-Disease Pair Analysis of Diagnostic Error (SPADE) “look-back” analysis to identify symptoms at risk for delayed sepsis diagnosis. We found treat-and-release emergency department (ED) encounters for fluid and electrolyte disorders (FED) and altered mental status (AMS) were associated with downstream sepsis hospitalizations. In this “look-forward” analysis, we measure the potential misdiagnosis-related harm rate for sepsis among patients with these symptoms.
Methods
Retrospective cohort study using electronic health record and claims data from Kaiser Permanente Mid-Atlantic States (2013–2018). Patients ≥18 years with ≥1 treat-and-release ED encounter for FED or AMS were included. Observed greater than expected sepsis hospitalizations within 30 days of ED treat-and-release encounters were considered potential misdiagnosis-related harms. Temporal analyses were employed to differentiate case and comparison (superficial injury/contusion ED encounters) cohorts.
Results
There were 4,549 treat-and-release ED encounters for FED or AMS, 26 associated with a sepsis hospitalization in the next 30 days. The observed (0.57%) minus expected (0.13%) harm rate was 0.44% (absolute) and 4.5-fold increased over expected (relative). There was a spike in sepsis hospitalizations in the week following FED/AMS ED visits. There were fewer sepsis hospitalizations and no spike in admissions in the week following superficial injury/contusion ED visits. Potentially misdiagnosed patients were older and more medically complex.
Conclusions
Potential misdiagnosis-related harms from sepsis are infrequent but measurable using SPADE. This look-forward analysis validated our previous look-back study, demonstrating the SPADE approach can be used to study infectious disease syndromes.
Funding source: Gordon and Betty Moore Foundation
Award Identifier / Grant number: GBMF5756
Acknowledgments
We would like to thank Carla V. Rodriguez-Watson, PhD (formerly of KPMAS) and Yuxin Zhu, PhD (Johns Hopkins) for their contributions to this project, and the patients of Kaiser Permanente for helping us improve care using information collected via the electronic health record system.
-
Research funding: This journal article was supported by a sub-agreement from the Johns Hopkins University with funds provided by Grant No. #GBMF5756 from the Gordon and Betty Moore Foundation. Its contents are solely the responsibility of the authors and do not necessarily represent the official views of the Gordon and Betty Moore Foundation or the Johns Hopkins University. Dr. Newman-Toker’s effort was supported partly by the Armstrong Institute Center for Diagnostic Excellence at the Johns Hopkins University School of Medicine.
-
Author contributions: All authors have accepted responsibility for the entire content of this manuscript and approved its submission.
-
Competing interests: Dr. Newman-Toker conducts research related to diagnostic error, including serving as the principal investigator for grants on this topic. He serves as an unpaid member of the Board of Directors of the Society to Improve Diagnosis in Medicine and as its President (2018–2020). He serves as a medico-legal consultant for both plaintiff and defense in cases related to diagnostic error. There are no other conflicts of interest. None of the authors have any financial or personal relationships with other people or organizations that could inappropriately influence (bias) their work.
-
Informed consent: Informed consent requirement was waived by the KPMAS Institutional Review Board.
-
Ethical approval: This study was approved with waived informed consent by the KP Mid-Atlantic States (KPMAS) Institutional Review Board.
References
1. Newman-Toker, DE, Schaffer, AC, Yu-Moe, CW, Nassery, N, Saber Tehrani, AS, Clemens, GD, et al.. Serious misdiagnosis-related harms in malpractice claims: the “Big Three” – vascular events, infections, and cancers. Diagnosis (Berl) 2019;6:227–40. https://doi.org/10.1515/dx-2019-0019.Suche in Google Scholar PubMed
2. National Academies of Sciences Engineering and Medicine. Improving diagnosis in health care. Balogh, EP, Miller, BT, Ball, JR, editors. Washington DC: The National Academies Press; 2015.Suche in Google Scholar
3. Leape, LL, Brennan, TA, Laird, N, Lawthers, AG, Localio, AR, Barnes, BA, et al.. The nature of adverse events in hospitalized patients. N Engl J Med 1991;324:377–84. https://doi.org/10.1056/nejm199102073240605.Suche in Google Scholar
4. Thomas, EJ, Studdert, DM, Burstin, HR, Orav, EJ, Zeena, T, Williams, EJ, et al.. Incidence and types of adverse events and negligent care in Utah and Colorado. Med Care 2000;38:261–71. https://doi.org/10.1097/00005650-200003000-00003.Suche in Google Scholar PubMed
5. Zwaan, L, De Bruijne, M, Wagner, C, Thijs, A, Smits, M, Van Der Wal, G, et al.. Patient record review of the incidence, consequences, and causes of diagnostic adverse events. Arch Intern Med 2010;170:1015–21. https://doi.org/10.1001/archinternmed.2010.146.Suche in Google Scholar PubMed
6. Singh, H, Meyer, AND, Thomas, EJ. The frequency of diagnostic errors in outpatient care: estimations from three large observational studies involving US adult populations. BMJ Qual Saf 2014;23:727–31. https://doi.org/10.1136/bmjqs-2013-002627.Suche in Google Scholar PubMed PubMed Central
7. Singer, M, Deutschman, CS, Seymour, CW, Shankar-Hari, M, Annane, D, Bauer, M, et al.. The third international consensus definitions for sepsis and septic shock (Sepsis-3). J Am Med Assoc 2016;315:801–10. https://doi.org/10.1001/jama.2016.0287.Suche in Google Scholar PubMed PubMed Central
8. Rhee, C, Dantes, R, Epstein, L, Murphy, DJ, Seymour, CW, Iwashyna, TJ, et al.. Incidence and trends of sepsis in US hospitals using clinical vs claims data, 2009-2014. J Am Med Assoc 2017;318:1241–9. https://doi.org/10.1001/jama.2017.13836.Suche in Google Scholar PubMed PubMed Central
9. Liu, V, Escobar, GJ, Greene, JD, Soule, J, Whippy, A, Angus, DC, et al.. Hospital deaths in patients with sepsis from 2 independent cohorts. J Am Med Assoc 2014;312:90–2. https://doi.org/10.1001/jama.2014.5804.Suche in Google Scholar PubMed
10. Kumar, A, Roberts, D, Wood, KE, Light, B, Parrillo, JE, Sharma, S, et al.. Duration of hypotension before initiation of effective antimicrobial therapy is the critical determinant of survival in human septic shock. Crit Care Med 2006;34:1589–96. https://doi.org/10.1097/01.ccm.0000217961.75225.e9.Suche in Google Scholar
11. Vaillancourt, S, Guttmann, A, Li, Q, Chan, IY, Vermeulen, MJ, Schull, MJ. Repeated emergency department visits among children admitted with meningitis or septicemia: a population-based study. Ann Emerg Med 2015;65:625–32 e3. https://doi.org/10.1016/j.annemergmed.2014.10.022.Suche in Google Scholar PubMed
12. Cifra, CL, Westlund, E, Eyck, PT, Ward, MM, Mohr, NM, Katz, DA. An estimate of missed pediatric sepsis in the emergency department. Diagnosis 2020:20200023.10.1515/dx-2020-0023Suche in Google Scholar PubMed PubMed Central
13. Liberman, AL, Newman-Toker, DE. Symptom-Disease Pair Analysis of Diagnostic Error (SPADE): a conceptual framework and methodological approach for unearthing misdiagnosis-related harms using big data. BMJ Qual Saf 2018;27:557–66. https://doi.org/10.1136/bmjqs-2017-007032.Suche in Google Scholar PubMed PubMed Central
14. Nassery, N, Horberg, MA, Rubenstein, KB, Certa, JM, Watson, E, Somasundaram, B, et al.. Antecedent treat-and-release diagnoses prior to sepsis hospitalization among adult emergency department patients: a look-back analysis employing insurance claims data using SPADE methodology. Diagnosis 2021. PMID: 33650389. https://doi.org/10.1515/dx-2020-0140 8;471–471.10.1515/dx-2020-0145Suche in Google Scholar PubMed
15. Newman-Toker, DE, Pronovost, PJ. Diagnostic errors – the next frontier for patient safety. Jama 2009;301:1060–2. https://doi.org/10.1001/jama.2009.249.Suche in Google Scholar PubMed
16. Newman-Toker, DE. A unified conceptual model for diagnostic errors: underdiagnosis, overdiagnosis, and misdiagnosis. Diagnosis (Berl) 2014;1:43–8. https://doi.org/10.1515/dx-2013-0027.Suche in Google Scholar PubMed PubMed Central
17. Shahraz, S, Lagu, T, Ritter, GA, Liu, X, Tompkins, C. Use of systematic methods to improve disease identification in administrative data: the case of severe sepsis. Med Care 2017;55:e16–24. https://doi.org/10.1097/mlr.0000000000000156.Suche in Google Scholar PubMed PubMed Central
18. Wang, ZZ, Yuxin. Risk-adjusted immediate 30-day rate for H.A.R.M.E.D-dizzy-stroke with shrinkage. In: Rate NMR-AId, editor; 2018.Suche in Google Scholar
19. Kaiser Permanente. About us: Mid-Atlantic States fast facts 2019 [updated September 30, 2019. Available from: https://share.kaiserpermanente.org/article/mid-atlantic-states-fast-facts/.Suche in Google Scholar
20. Kaiser Foundation Health Plan of Mid-Atlantic States Inc. KPMAS equity, inclusion, & diversity annual report with language analysis supplements: October 1, 2017–September 31, 2018; 2019.Suche in Google Scholar
21. Clift, K, Scott, L, Johnson, M, Gonzalez, C. Leveraging geographic information systems in an integrated health care delivery organization. Perm J 2014;18:71–5. https://doi.org/10.7812/tpp/13-097.Suche in Google Scholar
22. Koebnick, C, Langer-Gould, AM, Gould, MK, Chao, CR, Iyer, RL, Smith, N, et al.. Sociodemographic characteristics of members of a large, integrated health care system: comparison with US Census Bureau data. Perm J 2012;16:37–41. https://doi.org/10.7812/tpp/12-031.Suche in Google Scholar PubMed PubMed Central
23. Moore, BJ, White, S, Washington, R, Coenen, N, Elixhauser, A. Identifying increased risk of readmission and in-hospital mortality using hospital administrative data: the AHRQ Elixhauser comorbidity index. Med Care 2017;55:698–705. https://doi.org/10.1097/mlr.0000000000000735.Suche in Google Scholar PubMed
24. Boscoe, A, Paramore, C, Verbalis, JG. Cost of illness of hyponatremia in the United States. Cost Eff Resour Alloc 2006;4:10. https://doi.org/10.1186/1478-7547-4-10.Suche in Google Scholar PubMed PubMed Central
25. Han, JH, Wilber, ST. Altered mental status in older patients in the emergency department. Clin Geriatr Med 2013;29:101–36. https://doi.org/10.1016/j.cger.2012.09.005.Suche in Google Scholar PubMed PubMed Central
26. Prescott, HC, Angus, DC. Enhancing recovery from sepsis: a review. Jama 2018;319:62–75. https://doi.org/10.1001/jama.2017.17687.Suche in Google Scholar PubMed PubMed Central
27. National Quality Forum. Improving diagnostic quality and safety – final report. 2017 September 19; 2017.Suche in Google Scholar
28. National Quality Forum. Improving diagnostic quality and safety/reducing diagnostic error: measurement considerations – final report. 2020 October 6; 2020.Suche in Google Scholar
29. National Quality Forum. Advancing chief complaint-based quality measurement – final report. 2019 June 24; 2019.Suche in Google Scholar
30. Clifford, KM, Dy-Boarman, EA, Haase, KK, Maxvill, K, Pass, SE, Alvarez, CA. Challenges with diagnosing and managing sepsis in older adults. Expert Rev Anti Infect Ther 2016;14:231–41. https://doi.org/10.1586/14787210.2016.1135052.Suche in Google Scholar PubMed PubMed Central
31. Paoli, CJ, Reynolds, MA, Sinha, M, Gitlin, M, Crouser, E. Epidemiology and costs of sepsis in the United States-an analysis based on timing of diagnosis and severity level. Crit Care Med 2018;46:1889–97. https://doi.org/10.1097/ccm.0000000000003342.Suche in Google Scholar
32. Society to Improve Diagnosis in Medicine. Improvediagnosis.org [Internet]. From a small scrape to sepsis: Rory Staunton’s story. [updated 3 Aug 2020; cited 29 Oct 2020]. Available from: https://www.improvediagnosis.org/stories_posts/from-a-small-scrape-to-sepsis/.Suche in Google Scholar
33. End Sepsis: The Legacy of Rory Staunton. Endsepsis.org [Internet]. Sepsis and children. [updated 16 May 2020; cited 29 Oct 2020]. Available from: https://www.endsepsis.org/what-is-sepsis/sepsis-and-children/.Suche in Google Scholar
34. End Sepsis: The Legacy of Rory Staunton. Endsepsis.org [Internet]. Sepsis and wounds. [updated 16 May 2020; cited 29 Oct 2020]. Available from: https://www.endsepsis.org/what-is-sepsis/sepsis-and-wounds/.Suche in Google Scholar
35. Sharp, AL, Baecker, A, Nassery, N, Park, S, Hassoon, A, Lee, MS, et al.. Missed acute myocardial infarction in the emergency department-standardizing measurement of misdiagnosis-related harms using the SPADE method. Diagnosis (Berl) 2020. https://doi.org/10.1515/dx-2020-0049 [Epub ahead of print]. 32701479.Suche in Google Scholar PubMed
36. Newman-Toker, DE, Moy, E, Valente, E, Coffey, R, Hines, AL. Missed diagnosis of stroke in the emergency department: a cross-sectional analysis of a large population-based sample. Diagnosis (Berl) 2014;1:155–66. https://doi.org/10.1515/dx-2013-0038.Suche in Google Scholar PubMed PubMed Central
Supplementary Material
The online version of this article offers supplementary material (https://doi.org/10.1515/dx-2020-0145).
© 2021 Walter de Gruyter GmbH, Berlin/Boston
Artikel in diesem Heft
- Frontmatter
- Reviews
- An overview of mental health during the COVID-19 pandemic
- Potential mechanisms of action of convalescent plasma in COVID-19
- Mini Review
- Gap of knowledge in diagnosis of pyoderma gangrenosum in clinical specialties education
- Opinion Papers
- Learning clinical reasoning from the fictional detectives
- Integrating infection and sepsis management through holistic early warning systems and heuristic approaches: a concept proposal
- (F)utility of urine Bence Jones proteins for “routine” screening for plasma cell dyscrasia
- COVID-19 and the Le Chatelier’s principle
- Original Articles
- Are sniffer dogs a reliable approach for diagnosing SARS-CoV-2 infection?
- Using body temperature and variables commonly available in the EHR to predict acute infection: a proof-of-concept study showing improved pretest probability estimates for acute COVID-19 infection among discharged emergency department patients
- Identifying children at high risk for infection-related decompensation using a predictive emergency department-based electronic assessment tool
- Antecedent treat-and-release diagnoses prior to sepsis hospitalization among adult emergency department patients: a look-back analysis employing insurance claims data using Symptom-Disease Pair Analysis of Diagnostic Error (SPADE) methodology
- Rate of sepsis hospitalizations after misdiagnosis in adult emergency department patients: a look-forward analysis with administrative claims data using Symptom-Disease Pair Analysis of Diagnostic Error (SPADE) methodology in an integrated health system
- Real-world virtual patient simulation to improve diagnostic performance through deliberate practice: a prospective quasi-experimental study
- Overutilization and underutilization of autoantibody tests in patients with suspected autoimmune disorders
- Postnatal ultrasound follow-up in neonates with prenatal hydronephrosis
- Clinical performance of amperometry compared with enzymatic ultra violet method for lactate quantification in cerebrospinal fluid
- Case Report – Lessons in Clinical Reasoning
- Lessons in clinical reasoning – pitfalls, myths, and pearls: the contribution of faulty data gathering and synthesis to diagnostic error
- Case Report
- The COVID trap: pediatric diagnostic errors in a pandemic world
- Letters to the Editor
- Atrial arrhythmia and its association with COVID-19 outcome: a pooled analysis
- Serious game training in medical education: potential to mitigate cognitive biases of healthcare professionals
- Revisiting handoffs: an opportunity to prevent error
Artikel in diesem Heft
- Frontmatter
- Reviews
- An overview of mental health during the COVID-19 pandemic
- Potential mechanisms of action of convalescent plasma in COVID-19
- Mini Review
- Gap of knowledge in diagnosis of pyoderma gangrenosum in clinical specialties education
- Opinion Papers
- Learning clinical reasoning from the fictional detectives
- Integrating infection and sepsis management through holistic early warning systems and heuristic approaches: a concept proposal
- (F)utility of urine Bence Jones proteins for “routine” screening for plasma cell dyscrasia
- COVID-19 and the Le Chatelier’s principle
- Original Articles
- Are sniffer dogs a reliable approach for diagnosing SARS-CoV-2 infection?
- Using body temperature and variables commonly available in the EHR to predict acute infection: a proof-of-concept study showing improved pretest probability estimates for acute COVID-19 infection among discharged emergency department patients
- Identifying children at high risk for infection-related decompensation using a predictive emergency department-based electronic assessment tool
- Antecedent treat-and-release diagnoses prior to sepsis hospitalization among adult emergency department patients: a look-back analysis employing insurance claims data using Symptom-Disease Pair Analysis of Diagnostic Error (SPADE) methodology
- Rate of sepsis hospitalizations after misdiagnosis in adult emergency department patients: a look-forward analysis with administrative claims data using Symptom-Disease Pair Analysis of Diagnostic Error (SPADE) methodology in an integrated health system
- Real-world virtual patient simulation to improve diagnostic performance through deliberate practice: a prospective quasi-experimental study
- Overutilization and underutilization of autoantibody tests in patients with suspected autoimmune disorders
- Postnatal ultrasound follow-up in neonates with prenatal hydronephrosis
- Clinical performance of amperometry compared with enzymatic ultra violet method for lactate quantification in cerebrospinal fluid
- Case Report – Lessons in Clinical Reasoning
- Lessons in clinical reasoning – pitfalls, myths, and pearls: the contribution of faulty data gathering and synthesis to diagnostic error
- Case Report
- The COVID trap: pediatric diagnostic errors in a pandemic world
- Letters to the Editor
- Atrial arrhythmia and its association with COVID-19 outcome: a pooled analysis
- Serious game training in medical education: potential to mitigate cognitive biases of healthcare professionals
- Revisiting handoffs: an opportunity to prevent error