Abstract
The patient safety literature is full of exhortations to approach medical error from a system perspective and seek multidisciplinary solutions from groups including clinicians, patients themselves, as well as experts outside the traditional medical domain. The 7th annual International Conference on Diagnostic Error in Medicine sought to attract a multispecialty audience, and attempted to capture some of the conversations by engaging participants in a World Café, a technique used to stimulate discussion and preserve insight gained during the conference. We present the ideas generated in this session, discuss them in the context of psychological safety, and demonstrate the application of this novel technique.
Introduction
The annual International Conference on Diagnostic Error in Medicine brings together experts and interested individuals to present leading ideas and challenges in diagnosis and diagnostic error. In 2014, the 7th International Diagnostic Error in Medicine Conference Merging Policy, Practice and Technology: Paths to Improve Diagnosis met over 3-1/2 days in Atlanta, Georgia and included three keynote speakers and 42 faculty. The conference concluded with a group discussion facilitated by a World Café method. Participants were given the opportunity to interact and engage in conversations to identify concepts they learned and new insights gained. In addition, they were challenged to create a call to action for the conference leaders as well as for themselves. This paper summarizes the major ideas revealed during the session and describes the use of a novel method to capture the collective experiences of conference attendees as well as generate additional insight from shared discussions.
Methods
At the concluding session of the conference participants were seated at tables of eight to 10 participants each. Groups were instructed to avoid sitting with people they knew, and table leaders were encouraged to assemble a group that had representatives from a variety of professional backgrounds.
The session was conducted using a World Café method [1] that is designed around the following core operating principles:
Create a safe, comfortable space
Explore questions that matter
Encourage contribution and participation from all
Build on the diversity of ideas and people in the group
Listen to surface insights, patterns and questions that probe further
Make the knowledge revealed explicit
Prior to the event, consultants (LZ, BB) and the leadership of the Society to Improve Diagnosis in Medicine (SIDM) worked together to determine the questions to anchor the conversation for the World Café. The intent of the session was to create opportunities for individuals in the multidisciplinary audience to be able to contribute equally to the conversation and encourage a broad set of ideas and perspectives.
Participants were given the following questions to discuss: “What actions as a community devoted to change can we/SIDM take to transform diagnostic outcomes in the next 24 months? Synthesis: What did we hear? What did we learn? How does it connect to your conversations?” Small groups assembled at tables met to discuss these questions and record their conversations in note cards or scribbled on paper tablecloths. After 15 min, participants changed tables and exchanged ideas with new groups of people at a different table. Note cards and conclusions of each table were then shared with the larger group. In the second half of the session, questions were given to the larger group and individuals were encouraged to give rapid spontaneous responses (“Popcorn Insight”) [2]. Popcorn questions included: “What inspired you (during the conference)”? “What can the SIDM board do next?,” and “What are YOU going to do next?”
Participants
The meeting brought together 234 attendees from 34 states and nine countries. A number of specialties and organizations were represented, including physicians, educators, students, administrators, researchers, patients, and health media (Table 1).
Diagnostic error conference participants’ self-identified professional roles (total 234 participants).
Professional title | Number |
---|---|
Physicians: | 92 |
Primary care (29) | |
Emergency medicine (14) | |
Pathology or radiology (10) | |
Behavioral health (1) | |
Undesignated specialty (38) | |
Speaker (not otherwise specified) | 43 |
Health services researcher | 19 |
Administrative professional in healthcare | 13 |
Healthcare student | 11 |
Patient or patient family | 10 |
Allied health professional | 8 |
Healthcare educator | 7 |
Sponsor | 4 |
Health media | 2 |
Other | 25 |
Results
Ideas and themes from the World Café notecards: small group discussions
The small group conversations centered around the questions, “What did we hear?” “What did we learn?” The World café notes generated a wide variety of responses (Table 2). The single most common response was culture and cultural change (14 responses). Three respondents stated that the “key” to improvement was culture (1), communication and feedback (1), and discussion (1). Leading terms and phrases included culture, change, feedback, communication, improving and measurement.
Word Café responses.
# Responses | Concepts/terms |
---|---|
14 | Culture or cultural |
9 | Change |
9 | Feedback |
7 | Communication |
6 | Diagnosis |
6 | Improving |
6 | Measure or measurement or metrics |
5 | IT or HIT or EMR |
5 | Education or learning or learn |
4 | Discuss or discussion or discussing |
4 | Uncertain or uncertainty |
4 | Important or importance |
4 each | Courage, humility |
3 each | Behavior, research, focus, problem, challenge, transparency, key, community |
2 each | Question, error, champions, grants, effectiveness, multidisciplinary, “tricky issues”, insight, resolving, process, solution, feel, standards, advocacy, policy, public |
1 each | Error reduction, behavior management, evidence based thinking, respect, listen, speak up, partnership, malpractice, blame-free, nonpunitive, institution, mental model, big ideas, definition, outreach, intuition, consultation, ethics, over-diagnosis, under-diagnosis, leadership, permission, role model, stop, fix, management, fund, anchoring, action, dissemination, patient stories, accountability, decision analysis, innovation, early adopters, tangible, tipping point, cost, awareness, acknowledging, team, collaboration, providers, specialists, professional organizations, individual, system |
IT, information technology; HIT, healthcare information technology; EMR, electronic medical record. Number of each response written on notecards or tablecloths.
Major topics that emerged centered around:
Difficulties with diagnosis
People, organizations, groups
Communication and feedback
Attitudes
Environment, and
Specific actions.
Difficulties with diagnosis were highlighted by terms such as challenge and “tricky issues”, uncertainty, and need for insight. Individuals needed to address diagnosis were described as champions and role models (3) with a need for courage (4) and leadership.
Participants discussed the need to engage both individuals (doctors, nurses, patients) and organizations, but also emphasized the need for partnership, collaboration, and a multidisciplinary approach to improving diagnosis (Table 3). Communication and feedback were mentioned several times and reinforced by terms such as “listen” and “speak-up”.
World Café responses: people and groups identified on notecards or tablecloths.
Individuals (19 responses) | |
8 | Physicians, MD, doctor, providers, practitioners, RN |
4 | Patients |
2 | Stakeholders |
2 | Champions |
1 | Colleagues |
1 | Role models |
1 | “Others” |
Organizations (20 responses) | |
6 | Society to Improve Diagnosis in Medicine or Diagnostic Error in Medicine group |
2 each | Vendors |
Professional organizations | |
Societies | |
Industries | |
1 each | Professional boards |
American Board of Internal Medicine | |
Center for Medicare Services | |
American College of Physician Executives | |
Institute of Medicine | |
Other | |
Groups or concepts of groups (13) | |
3 | Community |
2 each | Public, multidisciplinary |
1 each | Team, institution, partnership, collaboration, consultation, specialties |
Personal attitudes thought necessary to improve diagnosis include humility (3), willingness to question (2), awareness (1), accountability, and respect (1). Institutional and environmental characteristics judged as necessary to improve diagnosis included transparency (3), and blame-free (1), non-punitive (1) environments. Specific actions that were highlighted included research (grants and funding) (5), improvements in the electronic medical record and information technology (5), education and learning (5); eight responses indicated a need to improve definitions (1), measurements (6), or standards (2). Advocacy and policy were each listed by two respondents. Evidence based thinking and intuition were each listed by one response. Potential solutions included “big ideas”, improved grant funding, innovation, and partnership with the Center for Medicare Services (CMS), malpractice providers, information technology vendors, and industry.
Regarding the role of the Society, respondents wanted SIDM to leverage efforts through other organizations, link to other sectors and stakeholders, and have more aggressive outreach and communication. Comments about SIDM membership suggested that members “should give feedback, provide leadership, question others, and discuss uncertainty”.
Large group popcorn session
When asked, “What insight inspired you?”, three major themes evolved in the discussion.
Partnership: with each other, with patients, organizations, and agencies.
Culture: transparency, demystify diagnosis, challenge assumptions, culture of partnership with patients, humility and awareness of uncertainty, recognition of potential for error, recognize emotional impact of diagnostic error on patients as well as providers (the “second” victims).
Communication: change how information is shared; understand and evaluate how information technology changes our interactions; improve feedback; explore and understand how patients and providers interact.
When asked, “What can the SIDM board do next?”, respondents encouraged leaders to “spread the word”, provide resources (peer review kit), and partner with the Institute of Medicine (IOM) and other organizations. Leaders were asked to be role models for the major themes of partnership, culture, and communication.
The final question was: “What are YOU going to do next?” Participants emphasized a desire to create communication standards, talk more about personal errors, recognize second victims of errors, improve electronic medical records, and be active in organizational efforts to improve understanding about diagnosis.
Discussion
The three major themes of partnership, culture, and communication reflect characteristics of environments that nurture and sustain psychological safety. Psychological safety is a social construct that describes a work climate characterized by interpersonal trust and mutual respect [3]. Edgar Schein and Warren Bennis described psychological safety as early as 1965 [4]. Schein is well known for his extensive study of organizational culture and describes psychological safety as a climate where people feel confident in speaking up [5]. This is essential especially to signal when things may be going wrong or when there is a sense of lack of clarity. He also notes that additional outcomes of psychological safety are that people gain a sense of capability to change, increase engagement, and work in a climate of trust and respect. While many of the attributes of psychological safety speak to the work environment, clinicians will easily recognize it is equally vital for patients and families in care relationships – in their comfort in speaking up, questioning, and seeking to understand.
Relationships built on trust and respect are essential to a thriving safety culture. In healthcare, the fear of looking incompetent often silences voices and concerns that need to be heard to assure ongoing creation of safety. In her extensive work on Teaming, Amy Edmondson describes making it safe “to team” and lists the benefits of psychological safety as [3]:
Encourages speaking up
Enables clarity of thought – decreases what Schein describes as “learner anxiety”
Supports constructive conflict rather than avoiding differences
Mitigates failure – makes it easier to speak up, catch errors, and intervene to avoid harm
Stimulates innovation by removing fear of speaking up and appearing “dumb”
Frees up energy pursuing goals rather than self-protection
Increases accountability through holding ourselves and each other accountable for achieving intended goals
Leadership and courage are necessary to achieve an environment of psychological safety. Members of SIDM and the SIDM Board can actively promote and role model the essential leadership behaviors for psychological safety. The behaviors described by Edmondson for nurturing psychological safety include: [3]
Be accessible and approachable. The ability of colleagues and patients to ask questions without fear of rebuff or criticism keeps vital sources of information flowing. The ability to ask, “What else might this be?”, can avoid premature closure and cognitive biases from overtaking deliberate and thoughtful decision-making.
Acknowledge the limits of current knowledge. When leaders share that they do not know something and ask others for help they model humility, enhance team performance, and recognize that it takes a variety of skills to achieve safety as well as a commitment to learning rather than false bravado.
Be willing to acknowledge failure. Speaking up and learning from our failure is essential for leader credibility rather than maintaining a false facade of infallibility.
Invite the voices of others. Leaders who ask for, listen, and value the insights and wisdom of others promote psychological safety.
Use failures as learning opportunities. Leaders can make good use of failure by highlighting opportunities to learn rather than blame.
Use clear, direct language to stimulate learning; avoid confusing, “code words” that obfuscate the deep learning that comes from looking clearly at what works and does not work in our care.
Set boundaries. Psychological safety does not mean “I get to do what I like”; leaders are clear on behavioral expectation with clear boundaries between what is and is not acceptable; this clarity provides freedom for all involved once expectations are clear and explicit.
Be accountable. Individuals are held fairly and consistently accountable for boundary violations.
Conclusions
Diagnosis is considered to be a core skill of the physician, but increasingly we recognize that the diagnostic process, and diagnostic accuracy, are dependent upon more than any single provider’s influence. The patient, their medical team, the healthcare system itself, and broader community and societal factors all play a role in diagnosis. As in other areas of safety, multidisciplinary team approaches have been envisioned as a strategy for improvement, as well as institutional commitment to supporting the difficult work of diagnosis. In addition, expertise from safety experts in domains outside traditional healthcare can provide new perspectives and insight and much remains to fully integrate their lessons. However, bringing these views together to facilitate understanding and further current debate is sometimes difficult with each group often siloed in its own thinking. We sought to facilitate interaction and exchange of a multidisciplinary group to enhance understanding and generate deeper insights.
The Society to Improve Diagnosis in Medicine (SIDM) has been at the forefront of increasing awareness of problems in diagnosis, and striving to define and generate ideas for system level improvements to make diagnosis more “accurate, timely, efficient, and safe” [6]. Their commitment to engage a wide range of stakeholders is demonstrated by their attempts to recruit and encourage perspectives beyond physicians, including patients and their families, nurses, risk managers, librarians, policy makers, laboratorians and laboratory technicians, information technology experts, and researchers. The World Café, a method drawn from the system thinking community, provides one method to capture ideas and perspectives from a multidisciplinary group interested in and committed to improving diagnosis. The World Café process has been used to explore avenues for improvement in other complex challenges such as education reform, climate change, and public health initiates [7]. This is the first report of its application for discussing the complexity and difficulty with diagnostic error. We seek to address this gap and illustrate the value of a collaborative facilitation process to capture the collective wisdom in the room at a multidisciplinary conference to inform organizational and individual action for change in the distinct facet of patient safety: diagnostic error.
Author contributions: All the authors have accepted responsibility for the entire content of this submitted manuscript and approved submission.
Research funding: None declared.
Employment or leadership: None declared.
Honorarium: None declared.
Competing interests: The funding organization(s) played no role in the study design; in the collection, analysis, and interpretation of data; in the writing of the report; or in the decision to submit the report for publication.
References
1. Brown J, Issacs D. The World Café: shaping our future through conversations that matter. San Francisco, CA: Berrett-Koehler Publishers, 2005.Search in Google Scholar
2. Dixon N. A rant on report outs. March 2, 2009. Available from: http://www.nancydixonblog.com/2009/03/a-rant-on-report-outs.html. Accessed: 4 Apr 2015.Search in Google Scholar
3. Edmondson A. Teaming: how organizations learn, innovate, and compete in the knowledge economy. San Francisco: Jossey-Bass Publishers, 2012.Search in Google Scholar
4. Schein EH, Bennis WG. Personal and organizational change through group methods. New York: Wiley, 1965.Search in Google Scholar
5. Schein EH. Organizational culture and leadership. San Francisco: Jossey-Bass Publishers, 1985.Search in Google Scholar
6. Society to Improve Diagnosis in Medicine [Internet]. [cited 22 Mar 2015]. Available from: http://www.improvediagnosis.org.Search in Google Scholar
7. Stöckigt B, Teut M, Witt CM. CAM use and suggestions for medical care of senior citizens: a qualitative study using the World Café method. Evid Based Complement Alternat Med. 2013;2013:951245.10.1155/2013/951245Search in Google Scholar PubMed PubMed Central
©2015, Karen S. Cosby et al., published by De Gruyter
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.
Articles in the same Issue
- Frontmatter
- Review
- Non-invasive prenatal testing (NIPT): limitations on the way to become diagnosis
- Opinion Paper
- When less is more for the struggling clinical reasoner
- Original Articles
- Checklists to prevent diagnostic errors: a pilot randomized controlled trial
- The early detection of anaemia and aetiology prediction through the modelling of red cell distribution width (RDW) in cross-sectional community patient data
- Preanalytic errors in anatomic pathology: study of 10,574 cases from five Portuguese hospitals
- Tapping into the wisdom in the room: results from participant discussion at the 7th International Conference on Diagnostic Error in Medicine facilitated by a World Café technique
- Case Report
- Blindsided by the Monospot test
- Corrigendum
- Corrigendum to: Clinical benefit of measuring both haemoglobin and transferrin concentrations in faeces: demonstration during a large-scale colorectal cancer screening trial in Japan
Articles in the same Issue
- Frontmatter
- Review
- Non-invasive prenatal testing (NIPT): limitations on the way to become diagnosis
- Opinion Paper
- When less is more for the struggling clinical reasoner
- Original Articles
- Checklists to prevent diagnostic errors: a pilot randomized controlled trial
- The early detection of anaemia and aetiology prediction through the modelling of red cell distribution width (RDW) in cross-sectional community patient data
- Preanalytic errors in anatomic pathology: study of 10,574 cases from five Portuguese hospitals
- Tapping into the wisdom in the room: results from participant discussion at the 7th International Conference on Diagnostic Error in Medicine facilitated by a World Café technique
- Case Report
- Blindsided by the Monospot test
- Corrigendum
- Corrigendum to: Clinical benefit of measuring both haemoglobin and transferrin concentrations in faeces: demonstration during a large-scale colorectal cancer screening trial in Japan