Computable phenotype for diagnostic error: developing the data schema for application of symptom-disease pair analysis of diagnostic error (SPADE)
-
Ahmed Hassoon
, Charles Ng
, Harold Lehmann , Hetal Rupani , Susan Peterson , Michael A. Horberg , Ava L. Liberman , Adam L. Sharp, Michelle C. Johansen
, Kathy McDonald , J. Mathrew Austin and David E. Newman-Toker
Abstract
Objectives
Diagnostic errors are the leading cause of preventable harm in clinical practice. Implementable tools to quantify and target this problem are needed. To address this gap, we aimed to generalize the Symptom-Disease Pair Analysis of Diagnostic Error (SPADE) framework by developing its computable phenotype and then demonstrated how that schema could be applied in multiple clinical contexts.
Methods
We created an information model for the SPADE processes, then mapped data fields from electronic health records (EHR) and claims data in use to that model to create the SPADE information model (intention) and the SPADE computable phenotype (extension). Later we validated the computable phenotype and tested it in four case studies in three different health systems to demonstrate its utility.
Results
We mapped and tested the SPADE computable phenotype in three different sites using four different case studies. We showed that data fields to compute an SPADE base measure are fully available in the EHR Data Warehouse for extraction and can operationalize the SPADE framework from provider and/or insurer perspective, and they could be implemented on numerous health systems for future work in monitor misdiagnosis-related harms.
Conclusions
Data for the SPADE base measure is readily available in EHR and administrative claims. The method of data extraction is potentially universally applicable, and the data extracted is conveniently available within a network system. Further study is needed to validate the computable phenotype across different settings with different data infrastructures.
Acknowledgments
The author would like to thank Jamal Badr for assisting in manuscript formatting.
-
Research ethics: This study was approved by the JHU IRB for Quality Improvement. Each case study was approved by their respective research IRB at Johns Hopkins Medicine, Kaiser Permanente Southern California, and Kaiser Permanente Mid-Atlantic States.
-
Informed consent: Not applicable.
-
Author contributions: The authors have accepted responsibility for the entire content of this manuscript and approved its submission.
-
Competing interests: The authors state no conflict of interest.
-
Research funding: None declared.
-
Data availability: Not applicable.
References
1. Newman-Toker, DE, Nassery, N, Schaffer, AC, Yu-Moe, CW, Clemens, GD, Wang, Z, et al.. Burden of serious harms from diagnostic error in the USA. BMJ Qual Saf 2023;33:109–20. https://doi.org/10.1136/bmjqs-2021-014130.Search in Google Scholar PubMed PubMed Central
2. National Academy of Sciences. Improving diagnosis in healthcare. IOM reports; 2015. Available from: http://www.nap.edu/catalog/21794%5Cnhttp://www.iom.edu/Reports.aspxPMID:26803862.Search in Google Scholar
3. Liberman, AL, Newman-Toker, DE. Symptom-Disease Pair Analysis of Diagnostic Error (SPADE): a conceptual framework and methodological approach for unearthing misdiagnosis-related harms using big data. BMJ Qual Saf 2018;27:557–66. https://doi.org/10.1136/bmjqs-2017-007032.Search in Google Scholar PubMed PubMed Central
4. Liberman, AL, Wang, Z, Zhu, Y, Hassoon, A, Choi, J, Austin, JM, et al.. Optimizing measurement of misdiagnosis-related harms using symptom-disease pair analysis of diagnostic error (SPADE): comparison groups to maximize SPADE validity. Diagnosis 2023;10:225–34.10.1515/dx-2022-0130Search in Google Scholar PubMed PubMed Central
5. Avoid Hospitalization After Release with a Misdiagnosis—ED Stroke/Dizziness (Avoid H.A.R.M.—ED Stroke/Dizziness). Partnership for quality measurement [Internet]; 2023. p4qm.org. https://p4qm.org/measures/3746 [Accessed 24 Apr 2024].Search in Google Scholar
6. Richesson, R, Smerek, M, Cameron, CB. A framework to support the sharing and reuse of computable phenotype definitions across health care delivery and clinical research applications. EGEMS (Wash DC) 2016;4:2. https://doi.org/10.13063/2327-9214.1232.Search in Google Scholar PubMed PubMed Central
7. Cook, R. A dictionary of philosophical logic. Edinburgh: Edinburgh University Press; 2009.Search in Google Scholar
8. ISO – ISO 8601. Date and time format. The International Organization for Standardization; 2017. https://www.iso.org/iso-8601-date-and-time-format.html [Accessed 28 Jan 2024].Search in Google Scholar
9. NUBC Uniform Billing (UB-04). Patient discharge status (FL17/CL103) – Terminology authority – confluence; 2022. https://confluence.hl7.org/pages/viewpage.action?pageId=97452084 [Accessed 28 Jan 2024].Search in Google Scholar
10. Liberman, AL, Hassoon, A, Fanai, M, Badihian, S, Rupani, H, Peterson, SM, et al.. Cerebrovascular disease hospitalizations following emergency department headache visits: a nested case–control study. Acad Emerg Med 2021;29:41–50. https://doi.org/10.1111/acem.14353.Search in Google Scholar PubMed PubMed Central
11. Nassery, N, Horberg, MA, Rubenstein, KB, Certa, JM, Watson, E, Somasundaram, B, et al.. Antecedent treat-and-release diagnoses prior to sepsis hospitalization among adult emergency department patients: a look-back analysis employing insurance claims data using Symptom-Disease Pair Analysis of Diagnostic Error (SPADE) methodology. Diagnosis 2021;8:469–78. https://doi.org/10.1515/dx-2020-0140.Search in Google Scholar PubMed
12. Horberg, MA, Nassery, N, Rubenstein, KB, Certa, JM, Shamim, EA, Rothman, R, et al.. Rate of sepsis hospitalizations after misdiagnosis in adult emergency department patients: a look-forward analysis with administrative claims data using Symptom-Disease Pair Analysis of Diagnostic Error (SPADE) methodology in an integrated health system. Diagnosis 2021;8:479–88.10.1515/dx-2020-0145Search in Google Scholar PubMed
13. Sharp, AL, Baecker, A, Nassery, N, Park, S, Hassoon, A, Lee, MS, et al.. Missed acute myocardial infarction in the emergency department-standardizing measurement of misdiagnosis-related harms using the SPADE method. Diagnosis 2020;8:177–86. https://doi.org/10.1515/dx-2020-0049.Search in Google Scholar PubMed
14. Thomas, EJ, Petersen, LA. Measuring errors and adverse events in health care. J Gen Intern Med 2003;18:61. https://doi.org/10.1046/j.1525-1497.2003.20147.x.Search in Google Scholar PubMed PubMed Central
15. Luck, J, Peabody, JW, Dresselhaus, TR, Lee, M, Glassman, P. How well does chart abstraction measure quality? A prospective comparison of standardized patients with the medical record. Am J Med 2000;108:642–9. https://doi.org/10.1016/s0002-9343(00)00363-6.Search in Google Scholar PubMed
16. Weingart, SN, Davis, RB, Palmer, RH, Cahalane, M, Hamel, MB, Mukamal, K, et al.. Discrepancies between explicit and implicit review: physician and nurse assessments of complications and quality. Health Serv Res 2002;37:483–98. https://doi.org/10.1111/1475-6773.033.Search in Google Scholar PubMed PubMed Central
17. Hayward, RA, Hofer, TP. Estimating hospital deaths due to medical errors: preventability is in the eye of the reviewer. JAMA 2001;286:415–20. https://doi.org/10.1001/jama.286.4.415.Search in Google Scholar PubMed
18. Wears, RL, Nemeth, CP. Replacing hindsight with insight: toward better understanding of diagnostic failures. Ann Emerg Med 2007;49:206–9. https://doi.org/10.1016/j.annemergmed.2006.08.027.Search in Google Scholar PubMed
19. Murphy, DR, Wu, L, Thomas, EJ, Forjuoh, SN, Meyer, AND, Singh, H. Electronic trigger-based intervention to reduce delays in diagnostic evaluation for cancer: a cluster randomized controlled trial. J Clin Oncol 2015;33:3560. https://doi.org/10.1200/jco.2015.61.1301.Search in Google Scholar
20. Schiff, GD. Diagnosis and diagnostic errors: time for a new paradigm. BMJ Qual Saf 2014;23:1–3. https://doi.org/10.1136/bmjqs-2013-002426.Search in Google Scholar PubMed
21. Singh, H, Giardina, TD, Forjuoh, SN, Reis, MD, Kosmach, S, Khan, MM, et al.. Electronic health record-based surveillance of diagnostic errors in primary care. BMJ Qual Saf 2012;21:93–100. https://doi.org/10.1136/bmjqs-2011-000304.Search in Google Scholar PubMed PubMed Central
22. FHIR. HL7; 2019. Available from: http://hl7.org/fhir/ [Accessed 17 Apr 2022].Search in Google Scholar
© 2024 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Editorial
- The growing threat of hijacked journals
- Review
- Effects of SNAPPS in clinical reasoning teaching: a systematic review with meta-analysis of randomized controlled trials
- Mini Review
- Diagnostic value of D-dimer in differentiating multisystem inflammatory syndrome in Children (MIS-C) from Kawasaki disease: systematic literature review and meta-analysis
- Opinion Papers
- Masquerade of authority: hijacked journals are gaining more credibility than original ones
- FRAMED: a framework facilitating insight problem solving
- Algorithms in medical decision-making and in everyday life: what’s the difference?
- Original Articles
- Computerized diagnostic decision support systems – a comparative performance study of Isabel Pro vs. ChatGPT4
- Comparative analysis of diagnostic accuracy in endodontic assessments: dental students vs. artificial intelligence
- Assessing the Revised Safer Dx Instrument® in the understanding of ambulatory system design changes for type 1 diabetes and autism spectrum disorder in pediatrics
- The Big Three diagnostic errors through reflections of Japanese internists
- SASAN: ground truth for the effective segmentation and classification of skin cancer using biopsy images
- Computable phenotype for diagnostic error: developing the data schema for application of symptom-disease pair analysis of diagnostic error (SPADE)
- Development of a disease-based hospital-level diagnostic intensity index
- HbA1c and fasting plasma glucose levels are equally related to incident cardiovascular risk in a high CVD risk population without known diabetes
- Short Communications
- Can ChatGPT-4 evaluate whether a differential diagnosis list contains the correct diagnosis as accurately as a physician?
- Analysis of thicknesses of blood collection needle by scanning electron microscopy reveals wide heterogeneity
- Letters to the Editor
- For any disease a human can imagine, ChatGPT can generate a fake report
- The dilemma of epilepsy diagnosis in Pakistan
- The Japanese universal health insurance system in the context of diagnostic equity
- Case Report – Lessons in Clinical Reasoning
- Lessons in clinical reasoning – pitfalls, myths, and pearls: a case of tarsal tunnel syndrome caused by an intraneural ganglion cyst
Articles in the same Issue
- Frontmatter
- Editorial
- The growing threat of hijacked journals
- Review
- Effects of SNAPPS in clinical reasoning teaching: a systematic review with meta-analysis of randomized controlled trials
- Mini Review
- Diagnostic value of D-dimer in differentiating multisystem inflammatory syndrome in Children (MIS-C) from Kawasaki disease: systematic literature review and meta-analysis
- Opinion Papers
- Masquerade of authority: hijacked journals are gaining more credibility than original ones
- FRAMED: a framework facilitating insight problem solving
- Algorithms in medical decision-making and in everyday life: what’s the difference?
- Original Articles
- Computerized diagnostic decision support systems – a comparative performance study of Isabel Pro vs. ChatGPT4
- Comparative analysis of diagnostic accuracy in endodontic assessments: dental students vs. artificial intelligence
- Assessing the Revised Safer Dx Instrument® in the understanding of ambulatory system design changes for type 1 diabetes and autism spectrum disorder in pediatrics
- The Big Three diagnostic errors through reflections of Japanese internists
- SASAN: ground truth for the effective segmentation and classification of skin cancer using biopsy images
- Computable phenotype for diagnostic error: developing the data schema for application of symptom-disease pair analysis of diagnostic error (SPADE)
- Development of a disease-based hospital-level diagnostic intensity index
- HbA1c and fasting plasma glucose levels are equally related to incident cardiovascular risk in a high CVD risk population without known diabetes
- Short Communications
- Can ChatGPT-4 evaluate whether a differential diagnosis list contains the correct diagnosis as accurately as a physician?
- Analysis of thicknesses of blood collection needle by scanning electron microscopy reveals wide heterogeneity
- Letters to the Editor
- For any disease a human can imagine, ChatGPT can generate a fake report
- The dilemma of epilepsy diagnosis in Pakistan
- The Japanese universal health insurance system in the context of diagnostic equity
- Case Report – Lessons in Clinical Reasoning
- Lessons in clinical reasoning – pitfalls, myths, and pearls: a case of tarsal tunnel syndrome caused by an intraneural ganglion cyst