Home Online public reactions to frequency of diagnostic errors in US outpatient care
Article Publicly Available

Online public reactions to frequency of diagnostic errors in US outpatient care

  • Traber Davis Giardina EMAIL logo , Urmimala Sarkar , Gato Gourley , Varsha Modi , Ashley N.D. Meyer and Hardeep Singh
Published/Copyright: February 19, 2016

Abstract

Background: Diagnostic errors pose a significant threat to patient safety but little is known about public perceptions of diagnostic errors. A study published in BMJ Quality & Safety in 2014 estimated that diagnostic errors affect at least 5% of US adults (or 12 million) per year. We sought to explore online public reactions to media reports on the reported frequency of diagnostic errors in the US adult population.

Methods: We searched the World Wide Web for any news article reporting findings from the study. We then gathered all the online comments made in response to the news articles to evaluate public reaction to the newly reported diagnostic error frequency (n=241). Two coders conducted content analyses of the comments and an experienced qualitative researcher resolved differences.

Results: Overall, there were few comments made regarding the frequency of diagnostic errors. However, in response to the media coverage, 44 commenters shared personal experiences of diagnostic errors. Additionally, commentary centered on diagnosis-related quality of care as affected by two emergent categories: (1) US health care providers (n=79; 63 commenters) and (2) US health care reform-related policies, most commonly the Affordable Care Act (ACA) and insurance/reimbursement issues (n=62; 47 commenters).

Conclusion: The public appears to have substantial concerns about the impact of the ACA and other reform initiatives on the diagnosis-related quality of care. However, policy discussions on diagnostic errors are largely absent from the current national conversation on improving quality and safety. Because outpatient diagnostic errors have emerged as a major safety concern, researchers and policymakers should consider evaluating the effects of policy and practice changes on diagnostic accuracy.

Introduction

Errors of diagnosis pose a significant threat to patient safety [1–3]. Most diagnostic error research has been focused on the identification and reduction of errors from the medical perspective [4–9]. There are limited data from patients’ perspectives [10]. Consequently, it is unknown how the public perceives and reacts to the issue of diagnostic errors, commonly referred to as misdiagnosis in the media. Perceptions and misperceptions of diagnostic errors can shape public opinion about the nature of the problem of diagnostic errors and can influence policy makers who might be able to address the problem. Traditionally, surveys and interviews have been used to assess this type of data. However, recently, online commentary has been used to access public perceptions for health issues, such as influenza and vaccines [11–14]. This platform offers commenters an interactive space to anonymously post opinions and participate in discussions [15]. To date, no studies have analyzed online commentary to explore perceptions of diagnostic error.

A 2014 study estimated that diagnostic errors affect 1 in 20 US adults per year; [16] or approximately 12 million adults per year in outpatient settings. Being the first estimate of its kind, this study was widely discussed in the lay press. We used this opportunity to conduct an exploratory qualitative analysis of online public perceptions of the reported frequency of diagnostic error in the US adult population.

Methods

We searched the World Wide Web and conducted a qualitative analysis of online comments made in response to the media coverage related to the study. The study was considered exempt from Institutional Board Review.

Data set

The study was released on April 17, 2014 in BMJ Quality & Safety [16] and garnered national media attention. Search terms included a combination of “Hardeep Singh” (study’s lead author), “12 million diagnostic errors”, and “1 in 20 US adults”. We identified 25 online articles reporting on the error frequency, including an op-ed written by one of the authors [17]. Thirteen websites had public comments available up to August 31, 2014, all of which were included. There were a total of 289 anonymous comments, ranging from 1 to 79 comments per site. Forty-eight comments (16.6%) were excluded due to lack of relevance to the research objective or because they contained derogatory language, involved commenters insulting each other or the author, or involved discussions of unrelated topics (e.g. gun control). The remaining 241 comments were subsequently analyzed.

Table 1 lists online media outlets and the number of comments, conversations and individual commenters included in the study. We did not have access to any demographic information but some commenters identified themselves as physicians or other health care providers (n=31) or patients (n=67); identities of 64 commenters were unclear.

Table 1

Media websites included in the study.

Online media outletComments (n=241)Conversationsa (n=92)Individual commentersb (n=162)
The Wall Street Journal [17]673935
NBC News [18]622233
Medscape [19]36034
Newser.com [20]241417
CBS News [21]1579
DailyMail.com [22]14913
Fox News [23]716
Reuters News Agency [24]605
RT Network [25]303
U.S. News & World Report [26]202
Medical News Today [27]202
LiveScience.com [28]202
Modern Healthcare [29]101

aConversation is defined as an initial comment that other individuals replied to resulting in a conversation between two or more people. bDetermined by unique user names.

Data analysis

We conducted a qualitative content analysis [15, 30] of the 241 included comments. All commenters and conversations within the discussion boards selected for the study were examined and copied verbatim into Word documents. The coding team (TDG, GG, and VM) familiarized themselves with all data and created an initial code book. All comments were independently coded by two reviewers (GG and VM) in Atlas TI and any newly emergent categories were added to the code book. The data sets were merged, reviewed for disagreements, and resolved by the first author (TDG, an experienced qualitative researcher) by including all appropriate codes or the most accurate code. Codes that conveyed similar meanings or ideas were combined to form new categories. To maintain anonymity, commenter user names were excluded.

Results

Overall, there were few comments made regarding the frequency of diagnostic errors. However, in response to the media coverage, 44 commenters shared 54 personal experiences of diagnostic errors. Additionally, commentary centered on diagnosis-related quality and safety of care in the US as affected by two emergent categories: (1) US health care providers (n=79; 63 commenters) and (2) US health care reform-related policies (n=62; 47 commenters), most commonly the Affordable Care Act (ACA) and insurance/reimbursement issues.

Personal experiences related to diagnostic errors

Forty-four commenters shared personal experiences they had with diagnostic errors including patients who shared their own or their relatives’ experiences and health care providers who shared colleagues’ experiences. Overwhelmingly, patients and their relatives expressed fear and anger and told stories of symptoms being dismissed by their physicians or healthcare teams. For example, one patient shared the following (paraphrased to maintain anonymity):

I was misdiagnosed. I had continuing chest pain following gallbladder removal. Pain occurred after eating as if I had not had my gallbladder removed. The surgeon referred me to a gastroenterologist doctor after an upper endoscopy did not reveal any problems. The gastroenterologist told me that if I kept this up I would be an addict and I needed to get over it and go back to work! I am a health care professional. My colleague, a physician, finally asked my surgeon to refer me to another gastroenterology specialist after significant weight loss. Finally, I was diagnosed with chronic smoldering pancreatitis. It was not all in my head.

Despite the anger and fear, there were some commenters who sympathized with physicians by acknowledging that doctors are capable of mistakes. For instance, a patient wrote (paraphrased to maintain anonymity),

My mother was misdiagnosed for several weeks. She was diagnosed with things such as the flu and kidney infection. She was sent home despite continuing to becoming increasingly ill. By the time a cardiologist diagnosed endocarditis, IV antibiotics were not able to stop the infection. She died in surgery. I was infuriated that had it been caught sooner, she may have survived. But doctors are human and they’re going to miss things sometimes. I just wish I didn’t need to lose my mom in order to learn that tough lesson.

Another commenter, whose symptoms were misdiagnosed as an allergy, wrote, “Not blaming the doctor at all, because he had seen those exact symptoms so many times that he was certain it was an allergy. This just happened to be the one time in a hundred when it wasn’t”.

A few respondents (n=4) were self-identified physicians or other health care providers who shared stories of diagnostic errors. They tended to include reasons for diagnostic errors such as lack of knowledge or failure to perform appropriate histories and physical exams, competing incentives, or the limitations of the practice of medicine.

“Everyone looks retrospectively at these cases with 20/20 hindsight but try living it in the ER. These doctors are working hard under conditions most people would find unbearable. We are always aware that we may be sending someone home to their death because clinical judgment/tests etc. are not perfect”.

Perceptions of US health care providers

Commenters expressed strong feelings, both positive and negative, about the quality and safety of care in the US. Specifically, commenters indicated mixed perceptions of the physician’s role in care. Positive comments (n=31; 24 commenters, one physician, two health care providers) acknowledged the complicated diagnostic process and tended to focus on the notion that physicians are human and therefore not immune to making mistakes. For example, one commenter wrote

“What I find interesting is that medicine is one of the only professions that people are not allowed to make mistakes in. We are all human. We have all made mistakes in our jobs. But physicians, PAs, NPs, pharmacists, and nurses are never allowed to make an error. The stakes may be higher, but the PRACTICE of medicine is not an easy thing”.

Negative comments (n=48, 39 commenters, three health care providers) tended to express anger and criticize physician knowledge and ethics. As an example, a commenter wrote

“I am convinced that there are way too many doctors with nonexistent diagnostic skills. Three times now I have told patients that they were in heart failure and they needed to go back to their doctors and DEMAND a cardiac workup”.

Another wrote, “DOCTORS are very uninformed… the longer out of school, the more antiquated the knowledge”. As might be expected, many of these commenters expressed anger towards physicians as related to diagnostic errors. For instance, “Only profession that can literally KILL you and still get paid!”

Some commenters indicated that physicians are dismissive of patients’ symptoms and questions. One commenter expressed, “Shocker! I’m an RN and Physicians seem to be quick to dismiss and hand out ice cream cones to move on to the next $$$”. Another wrote, “When explaining symptoms to them they make a snap judgment. If you ask a question they get angry”. Finally, some commenters expressed a loss of trust, based on their personal interactions with physicians and the health care system, “Wrong diagnosis and no diagnosis have undermined my trust in the medical profession as a whole. And, I am not alone”.

The role of current US health policy

Overwhelmingly, commenters had negative perceptions of current US health care policy as it relates to diagnostic errors and quality and safety of care (n=62; 47 commenters). Policy concerns were generally focused on the impact of the Affordable Care Act (ACA). Many commenters issued warnings that the ACA will only exacerbate error rates; however, few indicated how this might occur. Examples include: “If you think this is bad, then just wait until the Obamacare environment settles in. Errors will probably triple or quadruple…”, “Not to worry, Obamacare is on the scene. Take two aspirin and call back your health care provider next year. Good luck, Mr. and Mrs. America”; “Oh pitiful us! If you think it is bad now (which it is not), give it about 2 years with Obamacare. Doctors are retiring in droves…”.

Both patients and health care providers articulated frustration over interactions with insurance companies as an added complication in the diagnostic process. A physician commenter said, “Can’t help but wonder how many important diagnoses-especially cancers-get delayed past the point of effective treatment, thanks to back-and-forth battles and phone tag games with the insurance companies”? A patient commenter also remarked on the problematic relationship between physicians and insurance companies as it relates to the practice of medicine. “It doesn’t help that insurance companies are often the ones dictating how much time a physician can spend with a patient… Most doctors I know would relish more time with their patients, if only reimbursement wasn’t so bad, and reduced nearly every year”.

Despite the generally negative tone, some commenters held expectations that the ACA would positively impact care. “Pay our health care providers the good wages they deserve, but take the obscene profits out of it. The ACA is but a small step in the right direction. We need major changes, and it is not going to happen with our current system”.

Discussion

We analyzed online commentary to media reports on newly reported frequency of diagnostic errors in the US adult population in order to gain insight into public perceptions of diagnostic error. While methods to analyze online news media commentary to explore public perceptions of health issues have only recently emerged [11–14, 31], we found they provided useful insights into patients’ perceptions of diagnostic errors.

We found an absence of alarm at the frequency or potential harm related to diagnostic error. Those that did comment suggested that the rate of error reported was probably a conservative estimate. Indeed, a little over one-fourth of the individual commenters shared personal stories of diagnostic errors either experienced by themselves, family members, or colleagues. This awareness may be an indicator of patients’ increasing willingness to participate in patient safety and engage in diagnostic error improvement activities.

We also found that the public had substantial concerns about the impact of the ACA and other reform initiatives on diagnosis-related quality and safety of care, with many fearing additional decline. Resentment towards the ACA may be due in part to the timing of the release of the diagnostic error frequency study. On April 1, 2014, President Barack Obama announced that 7.1 million consumers enrolled in care through the ACA marketplaces [32]. During this time a number of media reports were simultaneously released criticizing the value of the ACA. Furthermore, on April 10, 2014, Kathleen Sebelius, Health and Human Services Secretary, resigned her position related to issues with the ACA marketplaces, which further triggered national media coverage of the ACA.

Health care reform initiatives as well as evaluations of quality and safety related to these reforms are not specifically focused on diagnosis related issues. Moreover, what long-term effect the ACA will have on improving diagnosis is unknown. Due to the emerging concern related to outpatient diagnostic errors [33], researchers and policymakers should investigate the effects of changes in policy and practice on diagnostic accuracy. Unfortunately, policy issues around diagnostic errors are understudied and underdeveloped and are largely absent from the current national conversation on improving quality and safety [34].

This study has several limitations. We collected online, publicly available data which does not include demographic details. We do not expect those who comment on media websites to be representative of the US population. The online comments included in this study reflect spontaneous, unsolicited opinions unaffected by researchers or the research process. Despite the lack of generalizability, the opinions contextualized the diagnostic process within current health care reform initiatives, thus showing the need for more policy-related conversations related to diagnosis. Since our study was completed, selected issues related to diagnosis such as reimbursement for cognitive work, have been recently highlighted in the recent Institute of Medicine report on “Improving Diagnosis in Health Care” [8].

In conclusion, we found that some members of the public have substantial concerns about the impact of the ACA and other reform initiatives on the diagnosis-related quality and safety of care. Because outpatient diagnostic errors have emerged as a major safety concern, researchers and policymakers should consider evaluating the effects of policy and practice changes on diagnostic accuracy.


Corresponding author: Traber Davis Giardina, Houston VA HSR&D Center for Innovations, Michael E. DeBakey Veterans Affairs Medical Center (152) and the Section of Health Services Research, Department of Medicine, Baylor College of Medicine, 2002 Holcombe Blvd, Houston, TX 77030, USA, Phone: +(713) 440-4695, Fax: +713-748-7359, E-mail:

  1. Author contributions: All the authors have accepted responsibility for the entire content of this submitted manuscript and approved submission.

  2. Research funding: Dr. Giardina is a VA Health Services Research postdoctoral fellow supported by VA Office of Academic Affiliations, Advanced Fellowships in Health Services Research. Dr. Sarkar is supported by Agency for Healthcare Research and Quality P30HS023558. Dr. Singh is supported by the VA Health Services Research and Development Service (CRE 12-033; Presidential Early Career Award for Scientists and Engineers USA 14-274), the VA National Center for Patient Safety and the Agency for Health Care Research and Quality (R01HS022087 and R21HS023602). This work is supported in part by the Houston VA Health Services Research and Development Center for Innovations in Quality, Effectiveness and Safety (CIN 13–413).

  3. Employment or leadership: None declared.

  4. Honorarium: None declared.

  5. Competing interests: The funding organization(s) played no role in the study design; in the collection, analysis, and interpretation of data; in the writing of the report; or in the decision to submit the report for publication.

References

1. Singh H, Thomas EJ, Khan MM, Petersen LA. Identifying diagnostic errors in primary care using an electronic screening algorithm. Arch Intern Med 2007;167:302–8.10.1001/archinte.167.3.302Search in Google Scholar PubMed

2. Singh H, Weingart SN. Diagnostic errors in ambulatory care: dimensions and preventive strategies. Adv Health Sci Educ Theory Pract 2009;14(Suppl 1):57–61.10.1007/s10459-009-9177-zSearch in Google Scholar PubMed PubMed Central

3. Singh H, Graber ML. Improving diagnosis in health care – the next imperative for patient safety. N Engl J Med 2015;373:2493–5.10.1056/NEJMp1512241Search in Google Scholar PubMed

4. Ely JW, Graber ML, Croskerry P. Checklists to reduce diagnostic errors. Acad Med 2011;86:307–13.10.1097/ACM.0b013e31820824cdSearch in Google Scholar PubMed

5. Singh H, Graber ML, Kissam SM, Sorensen AV, Lenfestey NF, Tant EM, et al. System-related interventions to reduce diagnostic errors: a narrative review. BMJ Qual Saf 2012;21:160–70.10.1136/bmjqs-2011-000150Search in Google Scholar PubMed PubMed Central

6. Graber ML, Kissam S, Payne VL, Sorensen A, Lenfestey N, Tant E, et al. Cognitive interventions to reduce diagnostic error: a narrative review. BMJ Qual Saf 2012;21:535–57.10.1136/bmjqs-2011-000149Search in Google Scholar PubMed

7. Khullar D, Jha AK, Jena AB. Reducing diagnostic errors – why now? N Engl J Med 2015;373:2491–3.10.1056/NEJMp1508044Search in Google Scholar PubMed PubMed Central

8. National Academies of Sciences EaM. Improving diagnosis in health care. 9-22-2015. Washington, DC: The National Academies Press, 2015.Search in Google Scholar

9. Newman-Toker DE, Pronovost PJ. Diagnostic errors – the next frontier for patient safety. J Am Med Assoc 2009;301:1060–2.10.1001/jama.2009.249Search in Google Scholar PubMed

10. Harrison R, Walton M, Manias E, Smith-Merry J, Kelly P, Iedema R, et al. The missing evidence: a systematic review of patients’ experiences of adverse events in health care. Int J Qual Health Care 2015;27:423–41.10.1093/intqhc/mzv075Search in Google Scholar PubMed

11. Lei Y, Pereira JA, Quach S, Bettinger JA, Kwong JC, Corace K, et al. Examining Perceptions about mandatory influenza vaccination of healthcare workers through online comments on news stories. PLoS One 2015;10:e0129993.10.1371/journal.pone.0129993Search in Google Scholar PubMed PubMed Central

12. Feinberg Y, Pereira JA, Quach S, Kwong JC, Crowcroft NS, Wilson SE, et al. Understanding public perceptions of the HPV vaccination based on online comments to Canadian news articles. PLoS One 2015;10:e0129587.10.1371/journal.pone.0129587Search in Google Scholar PubMed PubMed Central

13. Pereira JA, Quach S, Dao HH, Kwong JC, Deeks SL, Crowcroft NS, et al. Contagious comments: what was the online buzz about the 2011 Quebec measles outbreak? PLoS One 2013;8:e64072.10.1371/journal.pone.0064072Search in Google Scholar PubMed PubMed Central

14. Henrich N, Holmes B. What the public was saying about the H1N1 vaccine: perceptions and issues discussed in on-line comments during the 2009 H1N1 pandemic. PLoS One 2011;6:e18479.10.1371/journal.pone.0018479Search in Google Scholar PubMed PubMed Central

15. Reader Comments to Online Opinion Journalism: A Space of Public Deliberation. 10th International Symposium on Online Journalism; Austin, TX, 2009.Search in Google Scholar

16. Singh H, Meyer AN, Thomas EJ. The frequency of diagnostic errors in outpatient care: estimations from three large observational studies involving US adult populations. BMJ Qual Saf 2014;23:727–31.10.1136/bmjqs-2013-002627Search in Google Scholar PubMed PubMed Central

17. Singh H. The battle against Misdiagnosis. The Wall Street Journal. 8-7-2014. http://www.wsj.com/articles/hardeep-singh-the-battle-against-misdiagnosis-1407453373. 8-30-2014.Search in Google Scholar

18. Aleccia J. Misdiagnosed: docs’ mistakes affect 12 million a year. NBC News. 4-16-2014. http://www.nbcnews.com/#/health/health-news/misdiagnosed-docs-mistakes-affect-12-million-year-n82256. 8-30-2014.Search in Google Scholar

19. Henderson D. Misdiagnoses all too common: 1 in 20 US adults patients. Medscape. 4-22-2014. http://www.medscape.com/viewarticle/823952. 8-31-2014.Search in Google Scholar

20. Spak K. Doctors Misdiagnose 1 in 20 Patients They See. Newser.com. 4-17-2014. http://www.newser.com/story/comments/185478/doctors-misdiagnose-1-in-20-patients-they-see.html. 8-31-2014.Search in Google Scholar

21. Firger J. 12 million American misdiagnosed each year. CBS News. 4-17-2014. http://www.cbsnews.com/news/12-million-americans-misdiagnosed-each-year-study-says/. 8-30-2014.Search in Google Scholar

22. Gorman R. Twelve million Americans receive the wrong medical diagnosis every year. DailyMail.com. 4-17-2014. http://www.dailymail.co.uk/news/article-2606925/As-12million-Americans-receive-wrong-medical-diagnosis-year.html. 8-31-2014.Search in Google Scholar

23. Woerner A. At least 1 in 20 outpatients mimsdiagnosed every year, study shows. Fox News. 4-17-2014. http://www.foxnews.com/health/2014/04/17/at-least-1-in-20-outpatients-misdiagnosed-every-year-study-shows/. 8-30-2014.Search in Google Scholar

24. Skinner C. About 12 million U.S. outpatients misdiagnosed annually: study. Reuters News Agency. 4-17-2014. http://www.reuters.com/article/2014/04/17/us-usa-health-misdiagnosis-idUSBREA3G1S820140417. 8-31-2014.Search in Google Scholar

25. Medical misdiagnosis affects 12 million Americans a year study. RT Networks. 4-17-2014. http://rt.com/usa/medical-exam-misdiagnosis-wrong-284/. 8-30-2014.Search in Google Scholar

26. Neuhauser N. Study: 1 in 20 Americans misdiagnosed. U.S.News & World Report. 4-16-2014. http://www.usnews.com/news/articles/2014/04/16/at-least-1-in-20-americans-misdiagnosed-by-their-doctors-study-finds.Search in Google Scholar

27. Whiteman H. 1 in 20 American adults ‘misdiagnosed in outpatient clinics each year’. Medical News Today. http://www.medicalnewstoday.com/articles/275565.php. 4-17-0014. 8-30-2014.Search in Google Scholar

28. Rettner R. 12 Million Misdiagnoses Occur Yearly in US, Study Finds. LiveScience.com. 4-16-2014. http://www.livescience.com/44888-misdiagnosis-doctors-visits.html. 8-31-2014.Search in Google Scholar

29. Rice S. Misdiagnosis could affect 12M U.S. adults annually, study finds. Modern Healthcare, 2014. http://www.modernhealthcare.com/article/20140416/NEWS/304169948?AllowView=VXQ0UnpwZTVEdldZL1IzSkUvSHRlRU90amtvZEErSlY%3D. 8-31-2014.Search in Google Scholar

30. Green J, Thorogood N. Qualitative methods for health research. Thousand Oaks, CA: Sage Publications, 2009.Search in Google Scholar

31. Henrich N, Holmes B. Web news reader’s comments: towards developing a methodology for using on-line comments in social inquiry. J Media Commun Stud 2013;5:1–4.Search in Google Scholar

32. Britt R. Live Blog: President annunces 7.1 million signsup for Obamacare. Market Watch. 2014. http://blogs.marketwatch.com/health-exchange/2014/04/01/live-blog-president-obama-on-affordable-care-act/.Search in Google Scholar

33. Bishop TF, Ryan AM, Casalino LP. Paid malpractice claims for adverse events in inpatient and outpatient settings. J Am Med Assoc 2011;305:2427–31.10.1001/jama.2011.813Search in Google Scholar PubMed

34. Berenson RA, Upadhyay DK, Kaye DR. Placing diagnosis errors on the policy agenda. RWJF timely analysis of immediate health policy issues. The Urban Institute, 2014. http://www.urban.org/UploadedPDF/413104-Placing-Diagnosis-Errors-on-the-Policy-Agenda.pdf. 10-9-2014.Search in Google Scholar

Received: 2015-7-13
Accepted: 2016-1-11
Published Online: 2016-2-19
Published in Print: 2016-3-1

©2016 by De Gruyter

Downloaded on 25.9.2025 from https://www.degruyterbrill.com/document/doi/10.1515/dx-2015-0022/html
Scroll to top button