Abstract
Objectives
Patients with mental illness are less likely to receive the same physical healthcare as those without mental illness and are less likely to be treated in accordance with established guidelines. This study employed a randomized experiment to investigate the influence of comorbid depression on diagnostic accuracy.
Methods
Physicians were presented with an interactive vignette describing a patient with a complex presentation of pernicious anemia. They were randomized to diagnose either a patient with or without (control) comorbid depression and related behaviors. All other clinical information was identical. Physicians recorded a differential diagnosis, ordered tests, and rated patient likeability.
Results
Fifty-nine physicians completed the study. The patient with comorbid depression was less likeable than the control patient (p=0.03, 95 % CI [0.09, 1.53]). Diagnostic accuracy was lower in the depression compared to control condition (59.4 % vs. 40.7 %), however this difference was not statistically significant χ2(1)=2.035, p=0.15. Exploratory analyses revealed that patient condition (depression vs. control) interacted with the number of diagnostic tests ordered to predict diagnostic accuracy (OR=2.401, p=0.038). Accuracy was lower in the depression condition (vs. control) when physicians ordered fewer tests (1 SD below mean; OR=0.103, p=0.028), but there was no difference for physicians who ordered more tests (1 SD above mean; OR=2.042, p=0.396).
Conclusions
Comorbid depression and related behaviors lowered diagnostic accuracy when physicians ordered fewer tests – a time when more possibilities should have been considered. These findings underscore the critical need to develop interventions to reduce diagnostic error when treating vulnerable populations such as those with depression.
Funding source: Agency for Healthcare Research and Quality
Award Identifier / Grant number: R01HS025752
Acknowledgments
We thank Charles P. Friedman, PhD for providing us with the clinical case used in the current study. In accordance with an agreement with Dr. Friedman to use his cases for research purposes, we are unable to distribute or share the clinical case used in this study.
-
Research funding: This project was partially funded by a grant from the Agency for Healthcare Research and Quality (AHRQ; grant number R01HS025752), US Department of Health and Human Services (HHS) awarded to LMI. The authors are solely responsible for this document’s contents, findings and conclusions, which do not necessarily represent the views of AHRQ. Readers should not interpret any statement in this report as an official position of AHRQ or of HHS.
-
Author contributions: All authors have accepted responsibility for the entire content of this manuscript and approved its submission.
-
Competing interests: Authors state no conflict of interest.
-
Informed consent: Informed consent was obtained from all individuals included in this study.
-
Ethical approval: Research involving human subjects complied with all relevant national regulations, institutional policies and is in accordance with the tenets of the Helsinki Declaration (as revised in 2013) and has been approved by the authors’ Institutional Review Board (Protocol #: 2016-3291).
References
1. National Academies of Sciences, Engineering, and Medicine. Improving diagnosis in health care [Internet]. Washington, DC: The National Academies Press; 2015. Available from: https://www.nap.edu/catalog/21794/improving-diagnosis-in-health-care.Search in Google Scholar
2. Hinshaw, SP, Stier, A. Stigma as related to mental disorders. Annu Rev Clin Psychol 2008;4:367–93. https://doi.org/10.1146/annurev.clinpsy.4.022007.141245.Search in Google Scholar PubMed
3. Center for Behavioral Health Statistics and Quality. Behavioral health trends in the United States: results from the 2014 National Survey on Drug Use and Health [Internet]; 2015:64 p. (NSDUH Series H-50). Report No.: No. SMA 15-4927. Available from: https://www.samhsa.gov/data/sites/default/files/NSDUH-FRR1-2014/NSDUH-FRR1-2014.pdf.Search in Google Scholar
4. Owens, PL, Mutter, R, Stocks, C. Mental health and substance abuse-related emergency department visits among adults, 2007: statistical brief #92. In: Healthcare Cost and Utilization Project (HCUP) statistical briefs [Internet]. Rockville (MD): Agency for Healthcare Research and Quality (US); 2010. [cited 2019 Jul 17]. Available from: http://www.ncbi.nlm.nih.gov/books/NBK52659/.Search in Google Scholar
5. Weiss, AJ, Barrett, ML, Heslin, KC, Stocks, C. Trends in Emergency Department visits involving mental and substance use disorders, 2006-2013 [Internet]. Rockville, MD: Agency for Healthcare Research and Quality; 2016. Report No.: HCUP Statistical Brief #216. Available from: http://www.hcup-us.ahrq.gov/reports/statbriefs/sb216-Mental-Substance-Use-Disorder-ED-VisitTrends.pdf.Search in Google Scholar
6. Fernholm, R, Holzmann, MJ, Wachtler, C, Szulkin, R, Carlsson, AC, Pukk Härenstam, K. Patient-related factors associated with an increased risk of being a reported case of preventable harm in first-line health care: a case-control study. BMC Fam Pract 2020;21:20. https://doi.org/10.1186/s12875-020-1087-4.Search in Google Scholar PubMed PubMed Central
7. DeHert, M, Correll, CU, Bobes, J, Cetkovich‐Bakmas, M, Cohen, D, Asai, I, et al.. Physical illness in patients with severe mental disorders. I. Prevalence, impact of medications and disparities in health care. World Psychiatr 2011;10:52–77. https://doi.org/10.1002/j.2051-5545.2011.tb00014.x.Search in Google Scholar PubMed PubMed Central
8. Firth, J, Rosenbaum, S, Galletly, C, Siddiqi, N, Stubbs, B, Killackey, E, et al.. Protecting physical health in people with mental illness – authors’ reply. Lancet Psychiatr 2019;6:890–1. https://doi.org/10.1016/s2215-0366(19)30387-6.Search in Google Scholar
9. McGinty, EE, Baller, J, Azrin, ST, Juliano-Bult, D, Daumit, GL. Quality of medical care for persons with serious mental illness: a comprehensive review. Schizophr Res 2015;165:227–35. https://doi.org/10.1016/j.schres.2015.04.010.Search in Google Scholar PubMed PubMed Central
10. Rosenbaum, L. Closing the mortality gap — mental illness and medical care. N Engl J Med 2016;375:1585–9. https://doi.org/10.1056/nejmms1610125.Search in Google Scholar
11. Thornicroft, G. Premature death among people with mental illness. BMJ [Internet] 2013;346. https://doi.org/10.1136/bmj.f2969. Available from: https://www.bmj.com/content/346/bmj.f2969.Search in Google Scholar PubMed
12. Frayne, SM, Halanych, JH, Miller, DR, Wang, F, Lin, H, Pogach, L, et al.. Disparities in diabetes care: impact of mental illness. Arch Intern Med 2005;165:2631–8. https://doi.org/10.1001/archinte.165.22.2631.Search in Google Scholar PubMed
13. Mahabaleshwarkar, R, Taylor, YJ, Spencer, MD, Mohanan, S. Prevalence of metabolic syndrome in a large integrated health care system in North Carolina. N C Med J 2016;77:168–74. https://doi.org/10.18043/ncm.77.3.168.Search in Google Scholar PubMed
14. Druss, BG, Bradford, DW, Rosenheck, RA, Radford, MJ, Krumholz, HM. Mental disorders and use of cardiovascular procedures after myocardial infarction. JAMA 2000;283:506–11. https://doi.org/10.1001/jama.283.4.506.Search in Google Scholar PubMed
15. Sullivan, G, Han, X, Moore, S, Kotrla, K. Disparities in hospitalization for diabetes among persons with and without co-occurring mental disorders. Psychiatr Serv 2006;57:1126–31. https://doi.org/10.1176/ps.2006.57.8.1126.Search in Google Scholar PubMed
16. Koroukian, SM, Bakaki, PM, Golchin, N, Tyler, C, Loue, S. Mental illness and use of screening mammography among medicaid beneficiaries. Am J Prev Med 2012;42:606–9. https://doi.org/10.1016/j.amepre.2012.03.002.Search in Google Scholar PubMed PubMed Central
17. Graber, MA, Bergus, G, Dawson, JD, Wood, GB, Levy, BT, Levin, I. Effect of a patient’s psychiatric history on physicians’ estimation of probability of disease. J Gen Intern Med 2000;15:204–6. https://doi.org/10.1046/j.1525-1497.2000.04399.x.Search in Google Scholar PubMed PubMed Central
18. Jones, S, Howard, L, Thornicroft, G. “Diagnostic overshadowing”: worse physical health care for people with mental illness. Acta Psychiatr Scand 2008;118:169–71. https://doi.org/10.1111/j.1600-0447.2008.01211.x.Search in Google Scholar PubMed
19. Shefer, G, Henderson, C, Howard, LM, Murray, J, Thornicroft, G. Diagnostic overshadowing and other challenges involved in the diagnostic process of patients with mental illness who present in emergency departments with physical symptoms--a qualitative study. PLoS One 2014;9:e111682. https://doi.org/10.1371/journal.pone.0111682.Search in Google Scholar PubMed PubMed Central
20. Shefer, G, Cross, S, Howard, LM, Murray, J, Thornicroft, G, Henderson, C. Improving the diagnosis of physical illness in patients with mental illness who present in Emergency Departments: Consensus Study. J Psychosom Res 2015;78:346–51. https://doi.org/10.1016/j.jpsychores.2015.01.010.Search in Google Scholar PubMed
21. van Nieuwenhuizen, A, Henderson, C, Kassam, A, Graham, T, Murray, J, Howard, LM, et al.. Emergency department staff views and experiences on diagnostic overshadowing related to people with mental illness. Epidemiol Psychiatr Sci 2013;22:255–62. https://doi.org/10.1017/s2045796012000571.Search in Google Scholar
22. Henderson, C, Noblett, J, Parke, H, Clement, S, Caffrey, A, Gale-Grant, O, et al.. Mental health-related stigma in health care and mental health-care settings. Lancet Psychiatr 2014;1:467–82. https://doi.org/10.1016/s2215-0366(14)00023-6.Search in Google Scholar
23. Wallace, JE. Mental health and stigma in the medical profession. Health (NY) 2012;16:3–18. https://doi.org/10.1177/1363459310371080.Search in Google Scholar PubMed
24. Isbell, LM, Boudreaux, ED, Chimowitz, H, Liu, G, Cyr, E, Kimball, E. What do emergency department physicians and nurses feel? A qualitative study of emotions, triggers, regulation strategies, and effects on patient care. BMJ Qual Saf [Internet] 2020;29, 815–25. https://doi.org/10.1136/bmjqs-2019-010179. Search in Google Scholar PubMed PubMed Central
25. Isbell, LM, Chimowitz, H, Huff, NR, Liu, G, Kimball, E, Boudreaux, E. A qualitative study of emergency physicians’ and nurses’ experiences caring for patients with psychiatric conditions and/or substance use disorders. Ann Emerg Med 2023. https://doi.org/10.1016/j.annemergmed.2022.10.014.36669922, in press.Search in Google Scholar PubMed
26. Isbell, LM, Tager, J, Beals, K, Liu, G. Emotionally evocative patients in the emergency department: a mixed methods investigation of providers’ reported emotions and implications for patient safety. BMJ Qual Saf [Internet] 2020;29:803–14. https://doi.org/10.1136/bmjqs-2019-010110. Search in Google Scholar PubMed PubMed Central
27. Bodenhausen, GV, Sheppard, LA, Kramer, GP. Negative affect and social judgment: the differential impact of anger and sadness. Eur J Soc Psychol 1994;24:45–62. https://doi.org/10.1002/ejsp.2420240104.Search in Google Scholar
28. Huntsinger, JR, Isbell, LM, Clore, GL. The affective control of thought: malleable, not fixed. Psychol Rev 2014;121:600–18. https://doi.org/10.1037/a0037669.Search in Google Scholar PubMed
29. Isbell, LM, Lair, EC. Moods, emotions, and evaluations as information. In: Carlston, D, editor. The Oxford handbook of social cognition; 2013:435–62 pp.10.1093/oxfordhb/9780199730018.013.0021Search in Google Scholar
30. Isbell, LM, McCabe, J, Burns, KC, Lair, EC. Who am I?: the influence of affect on the working self-concept. Cogn Emot 2013;27:1073–90. https://doi.org/10.1080/02699931.2013.765388.Search in Google Scholar PubMed
31. Isbell, LM, Rovenpor, DR, Lair, EC. The impact of negative emotions on self-concept abstraction depends on accessible information processing styles. Emotion 2016;16:1040–9. https://doi.org/10.1037/emo0000193.Search in Google Scholar PubMed
32. Parker, MT, Isbell, LM. How I vote depends on how I feel: the differential impact of anger and fear on political information processing. Psychol Sci 2010;21:548–50. https://doi.org/10.1177/0956797610364006.Search in Google Scholar PubMed
33. Small, DA, Lerner, JS. Emotional policy: personal sadness and anger shape judgments about a welfare case. Polit Psychol 2008;29:149–68. https://doi.org/10.1111/j.1467-9221.2008.00621.x.Search in Google Scholar
34. Liu, G, Chimowitz, H, Isbell, LM. Affective influences on clinical reasoning and diagnosis: insights from social psychology and new research opportunities. Diagnosis 2022;9:295–305. https://doi.org/10.1515/dx-2021-0115.Search in Google Scholar PubMed PubMed Central
35. Friedman, CP, Elstein, AS, Wolf, FM, Murphy, GC, Franz, TM, Heckerling, PS, et al.. Enhancement of clinicians’ diagnostic reasoning by computer-based consultation: a multisite study of 2 systems. JAMA 1999;282:1851–6. https://doi.org/10.1001/jama.282.19.1851.Search in Google Scholar PubMed
36. Hayes, AF. Introduction to mediation, moderation, and conditional process analysis. In: A regression-based approach, 2nd ed. New York: The Guilford Press; 2018.Search in Google Scholar
37. Faul, F, Erdfelder, E, Buchner, A, Lang, AG. Statistical power analyses using G*power 3.1: tests for correlation and regression analyses. Behav. Res. Methods 2009;41:1149–60. 10.3758/BRM.41.4.1149Search in Google Scholar PubMed
38. Mamede, S, Gog, TV, Schuit, SCE, Berge, KVden, Daele, PLAV, Bueving, H, et al.. Why patients’ disruptive behaviours impair diagnostic reasoning: a randomised experiment. BMJ Qual Saf 2016;26:13–8. https://doi.org/10.1136/bmjqs-2015-005065.Search in Google Scholar PubMed
39. Schmidt, HG, Gog, Tvan, Schuit, SC, Berge, KVden, Daele, PLV, Bueving, H, et al.. Do patients’ disruptive behaviours influence the accuracy of a doctor’s diagnosis? A randomised experiment. BMJ Qual Saf 2016;26:19–23. https://doi.org/10.1136/bmjqs-2015-004109.Search in Google Scholar PubMed
40. Croskerry, P. The importance of cognitive errors in diagnosis and strategies to minimize them. Acad Med 2003;78:775–80. https://doi.org/10.1097/00001888-200308000-00003.Search in Google Scholar PubMed
41. Croskerry, P, Singhal, G, Mamede, S. Cognitive debiasing 2: impediments to and strategies for change. BMJ Qual Saf 2013;22:ii65–72. https://doi.org/10.1136/bmjqs-2012-001713.Search in Google Scholar PubMed PubMed Central
42. Graber, ML, Kissam, S, Payne, VL, Meyer, AND, Sorensen, A, Lenfestey, N, et al.. Cognitive interventions to reduce diagnostic error: a narrative review. BMJ Qual Saf 2012;21:535–57. https://doi.org/10.1136/bmjqs-2011-000149.Search in Google Scholar PubMed
43. Norman, G, Sherbino, J, Dore, K, Wood, T, Young, M, Gaissmaier, W, et al.. The etiology of diagnostic errors: a controlled trial of system 1 versus system 2 reasoning. Acad Med 2014;89:277–84. https://doi.org/10.1097/acm.0000000000000105.Search in Google Scholar PubMed
44. Burgoon, EM, Henderson, MD, Markman, AB. There are many ways to see the forest for the trees: a tour guide for abstraction. Perspect Psychol Sci 2013;8:501–20. https://doi.org/10.1177/1745691613497964.Search in Google Scholar PubMed
45. Gross, JJ, John, OP. Individual differences in two emotion regulation processes: implications for affect, relationships, and well-being. J Pers Soc Psychol 2003;85:348–62. https://doi.org/10.1037/0022-3514.85.2.348.Search in Google Scholar PubMed
46. Salovey, P, Mayer, JD. Emotional intelligence. Imagin Cognit Pers 1990;9:185–211. https://doi.org/10.2190/dugg-p24e-52wk-6cdg.Search in Google Scholar
47. Libbrecht, N, Lievens, F, Carette, B, Côté, S. Emotional intelligence predicts success in medical school. Emotion 2014;14:64–73. https://doi.org/10.1037/a0034392.Search in Google Scholar PubMed
48. Bourgeon, L, Bensalah, M, Vacher, A, Ardouin, JC, Debien, B. Role of emotional competence in residents’ simulated emergency care performance: a mixed-methods study. BMJ Qual Saf 2016;25:364–71. https://doi.org/10.1136/bmjqs-2015-004032.Search in Google Scholar PubMed
49. Nightingale, S, Spiby, H, Sheen, K, Slade, P. The impact of emotional intelligence in health care professionals on caring behaviour towards patients in clinical and long-term care settings: findings from an integrative review. Int J Nurs Stud 2018;80:106–17. https://doi.org/10.1016/j.ijnurstu.2018.01.006.Search in Google Scholar PubMed
50. Shouhed, D, Beni, C, Manguso, N, IsHak, WW, Gewertz, BL. Association of emotional intelligence with malpractice claims: a review. JAMA Surg 2019;154:250–6. https://doi.org/10.1001/jamasurg.2018.5065.Search in Google Scholar PubMed
51. Hodzic, S, Scharfen, J, Ripoll, P, Holling, H, Zenasni, F. How efficient are emotional intelligence trainings: a meta-analysis. Emot Rev 2018;10:138–48. https://doi.org/10.1177/1754073917708613.Search in Google Scholar
52. Mattingly, V, Kraiger, K. Can emotional intelligence be trained? A meta-analytical investigation. Hum Resour Manag Rev 2019;29:140–55. https://doi.org/10.1016/j.hrmr.2018.03.002.Search in Google Scholar
53. Mohan, D, Fischhoff, B, Farris, C, Switzer, GE, Rosengart, MR, Yealy, DM, et al.. Validating a vignette-based instrument to study physician decision making in trauma triage. Med Decis Mak Int J Soc Med Decis Mak 2014;34:242–52. https://doi.org/10.1177/0272989x13508007.Search in Google Scholar PubMed PubMed Central
54. Peabody, JW, Luck, J, Glassman, P, Dresselhaus, TR, Lee, M. Comparison of vignettes, standardized patients, and chart abstraction: a prospective validation study of 3 methods for measuring quality. JAMA 2000;283:1715–22. https://doi.org/10.1001/jama.283.13.1715.Search in Google Scholar PubMed
55. Peabody, JW, Luck, J, Glassman, P, Jain, S, Hansen, J, Spell, M, et al.. Measuring the quality of physician practice by using clinical vignettes: a Prospective Validation Study. Ann Intern Med 2004;141:771–80. https://doi.org/10.7326/0003-4819-141-10-200411160-00008.Search in Google Scholar PubMed
56. Lambe, KA, O’Reilly, G, Kelly, BD, Curristan, S. Dual-process cognitive interventions to enhance diagnostic reasoning: a systematic review. BMJ Qual Saf 2016;25:808–20. https://doi.org/10.1136/bmjqs-2015-004417.Search in Google Scholar PubMed
Supplementary Material
This article contains supplementary material (https://doi.org/10.1515/dx-2020-0106).
© 2023 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Review
- Cognitive biases in internal medicine: a scoping review
- Opinion Papers
- “Pivot and Cluster Strategy” in the light of Kahneman’s “Decision Hygiene” template
- Developing a European longitudinal and interprofessional curriculum for clinical reasoning
- Optimizing measurement of misdiagnosis-related harms using symptom-disease pair analysis of diagnostic error (SPADE): comparison groups to maximize SPADE validity
- Reframing context specificity in team diagnosis using the theory of distributed cognition
- Original Articles
- Promoting clinical reasoning with meta-memory techniques to teach broad differential diagnosis generation in a pediatric core clerkship
- Semantic competence and prototypical verbalizations are associated with higher OSCE and global medical degree scores: a multi-theory pilot study on year 6 medical student verbalizations
- Influence of comorbid depression and diagnostic workup on diagnosis of physical illness: a randomized experiment
- Recognition, diagnostic practices, and cancer outcomes among patients with unintentional weight loss (UWL) in primary care
- Quantitation of neurofilament light chain protein in serum and cerebrospinal fluid from patients with multiple sclerosis using the MSD R-PLEX NfL assay
- Analysis of common biomarkers in capillary blood in routine clinical laboratory. Preanalytical and analytical comparison with venous blood
- Comparison between cerebrospinal fluid biomarkers for differential diagnosis of acute meningitis
- Short Communications
- Exploring relationships between physician stress, burnout, and diagnostic elements in clinician notes
- Development of a student-created internal medicine frameworks website for healthcare trainees
- Case Report - Lessons in Clinical Reasoning
- Lessons in clinical reasoning – pitfalls, myths, and pearls: a case of crushing, substernal chest pain
- Letters to the Editor
- Ample room for cognitive bias in diagnosing accidental hypothermia
- Auscultation order of lung and heart sounds and autonomous noise cancellation
- Reliability of a single-nostril nasopharyngeal swab for diagnosing SARS-CoV-2 infection
Articles in the same Issue
- Frontmatter
- Review
- Cognitive biases in internal medicine: a scoping review
- Opinion Papers
- “Pivot and Cluster Strategy” in the light of Kahneman’s “Decision Hygiene” template
- Developing a European longitudinal and interprofessional curriculum for clinical reasoning
- Optimizing measurement of misdiagnosis-related harms using symptom-disease pair analysis of diagnostic error (SPADE): comparison groups to maximize SPADE validity
- Reframing context specificity in team diagnosis using the theory of distributed cognition
- Original Articles
- Promoting clinical reasoning with meta-memory techniques to teach broad differential diagnosis generation in a pediatric core clerkship
- Semantic competence and prototypical verbalizations are associated with higher OSCE and global medical degree scores: a multi-theory pilot study on year 6 medical student verbalizations
- Influence of comorbid depression and diagnostic workup on diagnosis of physical illness: a randomized experiment
- Recognition, diagnostic practices, and cancer outcomes among patients with unintentional weight loss (UWL) in primary care
- Quantitation of neurofilament light chain protein in serum and cerebrospinal fluid from patients with multiple sclerosis using the MSD R-PLEX NfL assay
- Analysis of common biomarkers in capillary blood in routine clinical laboratory. Preanalytical and analytical comparison with venous blood
- Comparison between cerebrospinal fluid biomarkers for differential diagnosis of acute meningitis
- Short Communications
- Exploring relationships between physician stress, burnout, and diagnostic elements in clinician notes
- Development of a student-created internal medicine frameworks website for healthcare trainees
- Case Report - Lessons in Clinical Reasoning
- Lessons in clinical reasoning – pitfalls, myths, and pearls: a case of crushing, substernal chest pain
- Letters to the Editor
- Ample room for cognitive bias in diagnosing accidental hypothermia
- Auscultation order of lung and heart sounds and autonomous noise cancellation
- Reliability of a single-nostril nasopharyngeal swab for diagnosing SARS-CoV-2 infection