Startseite A prospective study of patients’ pain intensity after cardiac surgery and a qualitative review: effects of examiners’ gender on patient reporting
Artikel Öffentlich zugänglich

A prospective study of patients’ pain intensity after cardiac surgery and a qualitative review: effects of examiners’ gender on patient reporting

  • Christine H. Meyer-Frießem ORCID logo EMAIL logo , Patrycja Szalaty , Peter K. Zahn und Esther M. Pogatzki-Zahn
Veröffentlicht/Copyright: 10. Oktober 2018
Veröffentlichen auch Sie bei De Gruyter Brill

Abstract

Background and aims

As indicated by experimental studies, reports of pain intensity may depend on the examiner’s gender. Until now, it is unclear whether this is relevant in clinical routine. This study investigated prospectively whether the gender of assessor plays a role in patients’ pain reports and whether this role differs in male and female patients.

Methods

165 patients (66.4 years±0.63; 118 males) scheduled for heart surgery were allocated consecutively to one examiner out of four students of both genders: two females and two males (aged 24.3 years±1.7). Therefore, the following study groups were defined: Group 1: female assessors-female patients, 2: female-male; 3: male-female, 4: male-male. Using a standardized analgesic scheme, patients were asked to rank their pain intensity on a numeric rating scale (NRS: 0–10), postoperatively. Statistics: Kruskal-Wallis, Mann-Whitney; p<0.05. Additionally, a qualitative literature review of the databases Medline and CENTRAL was performed focusing on experimental and clinical studies on experimenter gender bias. Due to the review, this prospective clinical study was designed to investigate whether patients after surgery report lower pain intensities when assessed by a female compared to a male assessor.

Results

Summarizing all patients, pain intensity on POD_1 was rated 4.0±2.4 on NRS and decreased on POD_2 to 3.0±2.1 [H(3)=37.941, p=0.000]. On average, pain intensity did not differ between males and females (NRS: 3.5 vs. 3.6). Only on the second postoperative day, more intense pain was reported in front of female assessors and less intense pain in front of male assessors (NRS: 3.4 vs. 2.4; p=0.000). A main effect for the four groups was seen (p=0.003): male patients reported higher pain scores to female assessors (NRS: 3.5 vs. 2.3; p=0.000).

Conclusions

Together, contrary to the expectations, patients after cardiac surgery reported a higher pain intensity in front of a female and a lower pain intensity in front of a male assessor. In particular, female caregivers may heighten the reported pain intensity up to 1.2 NRS-points; this bias seems to be more relevant for male patients.

Implications

Therefore, despite some methodological weakness, our data suggest that attention should be paid to a rather small, but somehow significant and consistent examiner gender bias after cardiac surgery especially in male patients. Further clinical studies are needed to show the true extent of clinical relevance and exact mechanisms underlying these gender reporting bias.

1 Introduction

For decades, sex and gender differences have been a major topic in pain research. In general, females are usually more susceptible to perceive more intense and prolonged pain than males and are overrepresented in many chronic pain conditions [1], [2], [3]. These differences apparently depend on multiple biopsychosocial issues and are not easy to explain [1], [4], [5].

Much less well studied is another gender aspect in the pain field. Eventually, the gender of the person involved in assessment of pain might play a role. For example, in some experimental studies, healthy volunteers were more likely to report a lower pain intensity in the presence of a female experimenter [6], [7], [8]; however, some other experimental studies found different and divergent results [9], [10], [11], [12], [13], [14], [15], [16]. As reported in a vignette study, physicians prescribed more opioid analgesics to patients of the same sex [17]. Therefore, pain intensities – differently rated due to the assessor’s gender – might lead to a different pain management postoperatively.

Interestingly, there is no single prospective study in patients investigating whether the gender of the person assessing pain in the clinical setting plays a role for pain intensity ratings given by patients. Furthermore, if any differences exist, the direction related to the gender of the patient is unknown.

First, to generate a hypothesis following the most common results of the existing literature, we performed a qualitative review. Subsequently, we formulated a study hypothesis and designed the first prospective clinical study to investigate whether patients after surgery report enhanced or reduced pain intensity in relation to the examiner gender.

2 Methods

2.1 Ethics and registration

This study was performed between 2012 and 2015 at the University Hospital Bergmannsheil in Bochum, Germany. The local Ethics Committee of the Ruhr University approved the study protocol (No. 4484-12), which was in accordance with the Declaration of Helsinki. Written informed consent was obtained from all patients before enrolment. The study was registered on German Clinical Trials Register (DRKS00011597).

2.2 Characteristics of participants

Female (f) and male (m) patients (40–90 years) scheduled for elective heart surgery via median sternotomy were included. Exclusion criteria were any psychiatric disorders [e.g. known depression or BDI-II score ≥29 (see below)], patients taking any pre-existent opioids (including e.g. codeine, tramadol, piritramide, tapentadol, oxycodone) indicating chronic pain due to a probable higher analgesic need postoperatively, missing language skills and dementia, as well as declination of participation. Postoperative exclusion criteria were ongoing analgosedation needed for mechanical ventilation, delirium or revocation of previous given consent. Participants were told that the aim of the study was to survey postoperative pain intensity in order to improve analgesic therapy. Patients and assessors (students) were blinded to the study hypothesis.

2.3 Characteristics of examiners and group affiliation

The assessors were four students of both genders: two females (F) and two males (M) (aged 24.3 years±1.7). All four shared an identical cultural background and ethnicity with hair ranging from blonde to dark blonde and wore doctors’ scrubs.

At the first postoperative assessment, patients were allocated consecutively to one of the four assessors (here called assessor or examiner). This group allocation stayed consistent until the end of the study. One at a time, each assessor collected the data of patients with the same and the opposite gender. Therefore, the following study groups were defined:

  1. Group “Ff”: female examiners – female patients;

  2. Group “Fm”: female examiners – male patients;

  3. Group “Mf”: male examiners – female patients;

  4. Group “Mm”: male examiners – male patients.

Each patient was only consulted by one assessor (male or female). This was done intentionally not to influence the reported pain intensity by being asked twice in quick succession or having any circumstances between the two assessments which could have caused different pain ratings (e.g. physiotherapy, redressing wounds or even coughing).

2.4 Study design

Included patients were visited on the evening before the elective surgery and were asked to answer standardized questions about their demographic factors and medical backgrounds and to complete two validated questionnaires to check for psychological variables like anxiety and depression: the “State and trait anxiety inventory” (STAI) and “Becks Depression Inventory” (BDI-II); assistance was offered at all stages by the examiners.

STAI lists 20 state-anxiety (STAI-S; feeling at the particular moment) and 20 trait-anxiety items (STAI-T; general feeling), each must be rated on a four-point intensity scale (from 1: “not at all”, to 4: “very much so”). The range of scores for each subtest is 20–80; higher scores indicate a tendency to suffer from anxiety when in an anxiety inducing environment (STAI-T) or more anxiety symptoms (STAI-S): scores on STAI-S and STAI-T ≥30 suggest moderate anxiety and scores ≥45 suggest severe anxiety [18].

BDI-II is a 21-question self-rating scale for measuring the severity of clinical depression experienced during the previous 2 weeks [19]. Each answer is scored on a scale value of 0–3. Higher total scores indicate more severe depressive symptoms. Patients with a score ≥29 preoperatively, indicating a severe depression, were excluded.

Both, anxiety and depression, were investigated as variables in the tested hypothesis for examiners’ gender influences.

During preoperative assessment, patients were coached to report their current postoperative pain intensity on a Numerical Rating Scale (NRS) (0: “no pain”, 10: “worst imaginable pain”) and to rate quality of pain using a German validated list of verbal descriptors (“Schmerzempfindungsskala”; SES) [20]. The SES is a standard instrument encompassing 10 descriptors on sensory and 14 descriptors on affective subscales. Patients rated every descriptor on a four-level categorical scale (1: “not appropriate”, 4: “fully appropriate”), and both, a sensory and an affective sum score were built. A numerically high value means a high level of pain on the respective scale (the higher the sum value, the more intense the perception or the higher the emotional burden due to the acute pain).

Additionally, a score for delirium was assessed on the five-item Nursing Delirium Screening Scale (NUDESC) [21]. Symptoms are rated from 0 to 2 based on the presence and intensity of each symptom (disorientation, inappropriate behavior, inappropriate communication, illusions/hallucinations, psychomotor retardation; maximal score of 10). Sums equal to, or ≥2, show an acute delirium.

Using a standardized study protocol, patients were asked for postoperative nausea and vomiting, their current pain intensity on NRS (“how is your current pain intensity while resting on ICU”), pain quality by SES and delirium by NUDESC, twice on the first and twice on the second postoperative day (POD, approx. 09:00: POD_1.1/POD_2.1 and approximately 17:00: POD_1.2/POD_2.2). In the standardized clinical routine, the current pain intensity while resting provides the fundament for further pain management if necessary. For all patients, according to the German Clinical Practice Guidelines, a standardized regime for analgesia (implemented for years) by means of metamizole (Novalgin® 1 g per os every 6 h) and oxycodone/naloxone (Targin® 20/10 mg every 12 h) on a fixed time pattern was used [22], [23]. In cases of severe acute pain states rescue medication could be requested on ICU via intravenous access (e.g. 3 mg piritramide intravenously). Besides, dipyrone is the most preferred and used nonopioid analgesic in Germany. Compared with NSAID, dipyrone does not heighten the risk for gastrointestinal bleeding, thrombosis or severe renal failure. Under regular blood analysis or short duration of use, the risk of agranulocytosis remains low. However, the debate has been controversial for over 30 years [22], [23].

2.5 Statistical analysis

Using G*power version 3.1.9.3 for Macintosh, a priori power analysis revealed a total size of at least 126 patients (p<0.05, NRS mean 3, SD±2) for the outcome pain rating on NRS (i.e. at least 63 patients per investigator gender). Data were analyzed with Statistical Package for Social Sciences Software (SPSS Version 22, IBM, Chicago, IL, USA) and are expressed as mean±standard deviation (SD) for quantitative variables, and as number (percent) for qualitative variables. As no normal distribution was given for pain parameters after performing Shapiro-Wilk-test, non-parametric tests were used. To compare the effects of assessor gender or patient gender on pain reporting, Mann-Whitney-U-tests were performed. To compare the four study groups, a Kruskal-Wallis-test with Bonferroni correction was used with a post hoc Mann-Whitney-U-test. Correlations between NRS pain intensity and scores of STAI-S or BDI-II were performed by two-tailed bivariate Spearman correlations. A priori planned subgroup analyses were performed for severe anxiety levels ≥45 on STAIT-S, moderate depression (BDI-II score of 20–28), any state of depression (BDI-II score of 9–28), different levels of pain intensity (low: NRS ≤3, moderate: NRS 4–6, severe: NRS ≥7), individual assessors and groups of assessment time points (POD_1 and _2). A significance level of p<0.05 was employed.

2.6 Qualitative review

The databases Medline (via pubmed) and Central were searched for appropriate articles (i.e. observational, retrospective or randomized controlled trials) in English or German until May 2018. A qualitative review of all publications was performed focusing on experimenter gender bias.

3 Results

3.1 Qualitative review

Results are depicted in Table 1. Whereas four experimental studies found increased pain ratings (or a reduced pain tolerance) in front of a female experimenter [10], [13], [15], [16], four other experimental studies reported the opposite [6], [7], [8], [12]. There are only three experimental studies which were designed specifically to investigate gender reporting bias [6], [7], [8]; all three resulting in the general conclusion that pain intensity might be lower when reported to a female examiner. Therefore, the following study hypothesis was formulated a priori.

Table 1:

Qualitative review of literature investigating gender bias of experimenter or examiner on pain.

Author Year of publication Numbers of subjects and experimenters Experimental design Special features Experimenter Pain intensity independent of patients’ gender Pain intensity due to patients’ gender
Male Female
Aslaksen et al. [6] 2007 Subjects: 16 females, 6 males (mean age 23.5 years) Heat pain (intensity to evoked pain) Male n.s. n.s.
Experimenters: 3 females, 3 males (mean age 27.65 years) Female (⇓)
Edwards et al. [9] 2017 Subjects: 3×48 dyads of a female and a male participant (mean age 24.7 years)

Experimenters: n.m.
Cold pressor and pressure pain tasks (pain tolerance) Gender of friends, strangers, sex friends, sex romantic partners MaleFemale an.s. (⇓a)n.s.
Gijsbers and Nicholson [8] 2005 Subjects: 2×16 males, 2×16 females; (mean age 22 years)

Experimenters: 1 male, 1 female (mean age 21 years)
Pressure algometer at sternum (pain threshold) Male

Female
n.s.

b
n.s.n.s.
Kállai et al. [16] 2004 Subjects: 80 females, 80 males, (mean years 23.9 years)

Experimenters: 2 high professional males, 2 high professional females, 2 low professional males, 2 low professional females
Cold pressor pain (pain tolerance, pain threshold, pain intensity) Gender and professional

Additionally, pain tolerance increased when opposite experimenter gender
Male

Female
n.s.

n.s.
Levine and De Simone [7] 1991 Subjects: 35 males, 33 females (mean age 19.1 years) Cold pressor pain (level of evoked pain) Male n.s. n.s.
Experimenters: 1 male, 1 female (mean age 25.5 years) Female n.s.
McClelland and McCubbin [10] 2008 Subjects: 34 females, 36 males (mean age 19.97 years)

Experimenters: Female experimenter plus an individual observer
Cold pressor task (pain intensity and Mc Gill Pain Questionnaire) Experiments alone or with same sex friend; no experimenter contact during experiment Male

Female
n.s.



e
Otto and Dougher [11] 1985 Subjects: 40 males, 40 females undergraduates (mean age 23.5 years)

Experimenters: 2 males, 2 females
Pressure focal pain stimulator (pain tolerance and pain threshold) Gender and masculinity-feminity score Male

Female
n.s.
Vigil and Coulombe [12] 2011 Subjects: 70 males, 137 females (mean age 22.1 years)

Experimenters: n.m.
Ischemic pain Gender and number of audience members Male

Female
n.s.

d
n.s.

(⇑)d
Vigil et al. [13] 2014 Subjects: 169 males, 184 females (mean age 19.8 years)

Experimenters: 7 females, 7 males, 1 transgender
Two types of old pressor task (discomfort threshold, pain threshold, pain tolerance, pain intensity) Transgender; experimenter contact only minimal prior to experiment; two types of old pressor task Male

Female


a (⇓)
Vigil et al. [14] 2015 Subjects: 94 naturally cycling and 38 women using hormonal contraceptives (mean age 19.8 years) Cold pressor task (pain tolerance) Menstrual cycle Male a,c
Experimenters: 12 males, 7 females Female n.s.
Weisse et al. [15] 2005 Subjects: 156 males, 187 females (mean age 20.3 years) immersion time in ice bath (pain tolerance) Gender and race Male n.s. n.s.
Experimenters: 2 white males, 3 black males, 4 white females, 2 black females Female (⇑) h h
Vigil and Alcock [24] 2014 Patients: 1) 66 (63 males, 3 females)

2) 140 (113 males, 27 females) (mean age 42.7 years)
Retrospective (two medical records of emergency department) 88% male patients, incomplete data set Male f (⇑f)
Examiner:

1) 61% males

2) 46% males
Female (⇑g) g
Current results

Meyer-Frießem
2018 Patients: 118 males, 47 females (mean age 66.4 years)

Examiner: 2 males, 2 females
Heart surgery patients on first two postoperative days Significance only on second postoperative day Male

Female
n.s.

n.s.

(⇑)
  1. Shown are increased or decreased pain intensities primarily compared between male and female examiner gender and secondarily compared between examiner and patients gender (four groups).

  2. aPain tolerance ⇑, bpain threshold ⇑, ( ) only main effect between examiner gender significant, subgroup failed significance, cwomen with high fertility under naturally cycling, din dependence of an increasing number of audience members, ein presence of a same sex friend, flow pain level (VAS 0–3), ghigh pain level (VAS 5–10), hblack subjects, n.m.=not mentioned; n.s.=not significant.

3.2 Study hypothesis

This prospective clinical study was designed to investigate whether patients after surgery report lower pain intensities when assessed by a female compared to a male assessor.

3.3 Patient characteristics

A total of 446 patients were assessed for eligibility; of these, 161 were excluded due to declined participation (39.1%), existing language barrier (20.5%), BDI-II score for severe depression (1.9%), or complaints of chronic pain (21.7%). One hundred and twenty were excluded secondarily (Fig. 1). Finally, data from 165 patients [66.39 years±9.63; male: 118 (m), female: 47 (f)] were analyzed. Of these, 53.9% (F, n=89) patients were interviewed by a female and 46.1% (M, n=76) by a male assessor. All patients underwent a sternotomy, due, e.g. to coronary artery bypass grafts (84.2%), aortic (14.5%) or mitral valve replacements (10.3%, Table 2). STAIT-S and STAIT-T did not differ between male and female patients (State z=–1.198, p=0.231; Trait z=–1.162, p=0.245); however, BDI-II indicated a more frequently minimal depressive mood in females than in males but without pathological significance (z=–2.802, p=0.005). Only 144 patients (87.3%) finished the assessment on POD 2.2 (Fig. 1).

Table 2:

Clinical data of all included patients divided into female and male patients.

Female patients (f) (n=47/28.5%) Male patients (m) (n=118/71.5%) Total (n=165)
Age (years, mean±SD) 67.6±9.9 66.0±9.2 66.4±9.4
Height (cm, mean±SD) 1.63/0.1 1.77/0.1 173.0±0.1
Weight (kg, mean±SD) 76.1/21.1 94.4/15.4 89.2±19.0
BMI (kg/m2, mean±SD) 28.7±7.7 30.1±4.78 29.7±5.8
ASA (physical status classification)
 II (n/%) 4/8.7 3/2.7 7/4.49
 III (n/%) 22/47.8 60/54.5 82/52.56
 IV (n/%) 20/43.5 47/42.7 67/42.95
Nicotine abuse (n/%) 7/14.89 25/21.19 32/19.4
Alcohol abuse (n/%) 16/34.04 77/65.81 93/56.71
Diagnosisa
 Coronary heart disease (n/%)a 37/68.5 102/80.3 139/54.9
 Valvular aortic stenosis (n/%)a 9/16.7 15/11.8 24/9.5
 Mitral valve insufficiency (n/%)a 8/14.8 10/7.9 18/7.1
Duration of surgery (h, mean±SD) 3.8±1.0 3.9±0.9 3.9±0.9
Number of patients POD_1.1 (n) 47 118 165
Number of patients POD_1.2 (n) 45 112 157
Number of patients POD_2.1 (n) 40 105 145
Number of patients POD_2.2 (n) 40 104 144
Postoperative nausea on POD_1.1 (n/%) 18/38.3 24/20.34 42/25.45
Postoperative vomiting on POD_1.1 (n/%) 12/25.53 17/14.41 29/17.58
Postoperative delirium (NUDESC≥2) on POD_1.1 (n/%) 2/1.2 5/4.2 7/4.2
Postoperative delirium (NUDESC≥2) on POD_2.1 (n/%) 1/2.1 1/0.8 2/1.4
BDI-II depression score (preoperative; median/IQR) 9/0–27 6/0–28 6/0–28
 BDI-II score 0–8 (no depression; n/%) 21/45 79/67 100/61
 BDI-II score 9–13 (minimal depression; n/%) 16/34 25/21 41/25
 BDI-II score 14–19 (mild depression; n/%) 7/15 10/8 17/10
 BDI-II score 20–28 (moderate depression; n/%) 3/6 4/3 7/4
NRS mean pain intensityb with BDI-II score 20–28 (mean/SD) 5.1/3.8 5.1/1.1 5.1/2.3
State and trait anxiety (STAI preoperative)
 STAI-S: State anxiety score (median/IQR) 46/39–55 45/40–50 45/40–50.5
 STAI-T: Trait anxiety score (median/IQR) 43/37–47 41/35–45.25 42/36–46
NRS mean pain intensityb with STAI-S score ≥45 (mean/SD) 4.0/2.1 3.1/1.8 3.6/2.0
  1. ASA=American Society of Anesthesiologists; BDI-II=Becks Depression Inventory (score from 0 to 63; patients with a score ≥29 were excluded a priori); BMI=body mass index; F=female experimenter; f=female patient; M=male experimenter; m=male patient; IQR=interquartile range; NUDESC=Nursing Delirium Screening Scale (score from 0 to 10; scores ≥2 show an acute delirium); POD=postoperative day (1.1=morning of day 1); SD=standard deviation; STAI=State-Trait Anxiety Inventory (each score with 20–80 points), amultiple diagnosis possible. bNRS mean for all days.

Fig. 1: 
            Flow diagram and study design. After inclusion criteria were met, all patients were given an initial assessment on the day before surgery. On the first two postoperative days, patients were asked to rate their pain intensity in the morning and in the evening. Exclusion based on acute delirium: Scores on “Nursing Delirium Screening Scale” (NUDESC) equal to, or greater than 2. Other reasons for secondary exclusion n=24: surgery was postponed (n=10), analgosedation needed (n=13), reoperation needed (n=1). POD=postoperative day (1.1=morning of first postoperative day, 1.2=evening of first postoperative day, 2.1=morning of second postoperative day, 2.2=evening of second postoperative day). F=female examiner; f=female patient; M=male examiner; m=male patient.
Fig. 1:

Flow diagram and study design. After inclusion criteria were met, all patients were given an initial assessment on the day before surgery. On the first two postoperative days, patients were asked to rate their pain intensity in the morning and in the evening. Exclusion based on acute delirium: Scores on “Nursing Delirium Screening Scale” (NUDESC) equal to, or greater than 2. Other reasons for secondary exclusion n=24: surgery was postponed (n=10), analgosedation needed (n=13), reoperation needed (n=1). POD=postoperative day (1.1=morning of first postoperative day, 1.2=evening of first postoperative day, 2.1=morning of second postoperative day, 2.2=evening of second postoperative day). F=female examiner; f=female patient; M=male examiner; m=male patient.

3.4 Pain reporting

Summarizing all patients, pain intensity on POD_1 was rated 4.0±2.4 on NRS and decreased on POD_2 to 3.0±2.1 [H(3)=37.941, p=0.000]. Pain scores of male and female patients (if male and female assessor was neglected) showed no differences at any time after surgery (z=–0.164, p=0.869; Fig. 2). This remains consistent in each subgroup analyses for low, moderate and severe pain. The same was true for SES descriptors of pain quality between female and male patients (Table 3 and Table Supplement).

Fig. 2: 
            Gender-specific reporting of postoperative pain intensity. Comparing pain scores of female and male patients within 2 days after heart surgery on a Numerical Rating Scale (NRS: 0=“no pain” to 10=“worst imaginable pain”). Data are presented as mean±SD. POD=postoperative day [1.1=morning of first postoperative day (n=165), 1.2=evening of first postoperative day (n=157), 2.1=morning of second postoperative day (n=145), 2.2=evening of second postoperative day (n=144)]. Kruskal-Wallis-test (3)=37.942, p=0.000.
Fig. 2:

Gender-specific reporting of postoperative pain intensity. Comparing pain scores of female and male patients within 2 days after heart surgery on a Numerical Rating Scale (NRS: 0=“no pain” to 10=“worst imaginable pain”). Data are presented as mean±SD. POD=postoperative day [1.1=morning of first postoperative day (n=165), 1.2=evening of first postoperative day (n=157), 2.1=morning of second postoperative day (n=145), 2.2=evening of second postoperative day (n=144)]. Kruskal-Wallis-test (3)=37.942, p=0.000.

Table 3:

Pain intensity and pain characteristics dependent on patients’ or examiners’ gender summarized on POD_1 and POD_2.

f (n=47) m (n=118) p (U-test)
NRS POD_1 (MW±SD) 4.2±3.0 3.9±2.6 0.572
NRS POD_2 (MW±SD) 2.9±2.61 2.9±2.3 0.830
SES affective POD_1 (MW±SD) 23.24±11.79 22.68±10.69 0.875
SES affective POD_2 (MW±SD) 21.69±11.24 20.47±8.93 0.988
SES sensory POD_1 (MW±SD) 14.12±5.24 14.9±5.74 0.250
SES sensory POD_2 (MW±SD) 13.6±5.27 13.97±5.82 0.498
F (n=89) M (n=76) p (U-test)

NRS POD_1 (MW±SD) 3.9±2.7 3.99±2.7 0.984
NRS POD_2 (MW±SD) 3.4±2.5 2.4±2.2 0.000b
SES affective POD_1 (MW±SD) 22.72±10.73 22.98±11.33 0.312
SES affective POD_2 (MW±SD) 21.88±9.69 19.75±9.46 0.006a
SES sensory POD_1 (MW±SD) 14.87±5.57 14.47±5.66 0.208
SES sensory POD_2 (MW±SD) 15.12±6.65 12.62±4.16 0.003a
Ff (n=27) Mf (n=20) Fm (n=62) Mm (n=56) ∑ (n=165) p (H-test)

NRS POD_1 (MW±SD) 4.2±3.0 4.1±3.12 3.8±2.6 3.96±2.54 3.97±2.7 0.864
NRS POD_2 (MW±SD) 3.2±2.5 2.7±2.69 3.5±2.49 2.3±2.03 2.9±2.42 0.003a
SES affective POD_1 (MW±SD) 22.24±11.1 24.53±12.63 22.93±10.6 22.42±10.83 22.8±11.0 0.844
SES affective POD_2 (MW±SD) 21.58±10.19 21.8±12.34 21.99±9.54 18.97±8.06 20.8±9.6 0.05a
SES sensory POD_1 (MW±SD) 13.76±5.18 14.58±5.36 15.35±5.69 14.43±5.78 14.7±5.6 0.108
SES sensory POD_2 (MW±SD) 14.35±6.12 12.85±4.19 15.42±6.84 12.54±4.16 13.9±5.7 0.00b
  1. F=female experimenter; f=female patient; M=male experimenter; m=male patient; H-test=Kruskal-Wallis-H-test with Bonferroni correction; NRS=Numerical Rating Scale (0=“no pain”; 10=“worst imaginable pain”); POD=postoperative day (POD_1 includes: 1.1=morning of day 1 and 1.2=evening of day 1; POD_2 includes: 2.1=morning of day 2 and 2.2=evening of day 2); MW=mean; SD=standard deviation; SES=Schmerzempfindlichkeits-Skala (“Scale for quality of perceived pain”); U-test=Mann-Whitney-U-test. ap<0.05, bp<0.001.

Female patients feeling anxious (STAI-S≥45) showed higher NRS scores (n=49; NRS mean 4.0±2.1,) than anxious males (n=44; 3.1±1.8; z=–2.183, p=0.029). In all patients, independent from gender, there was no correlation between pain intensity and preoperative anxiety (rs=0.095, p=0.364). A positive correlation was seen between all BDI-II scores and pain intensity, independent from gender (rs=0.156, p=0.045).

3.5 Effects of examiner gender on pain reporting

Regardless of the patients’ gender, more intense pain was reported in the presence of a female examiner (NRS 3.4±2.5) when compared to the pain reported to a male examiner on POD_2 (NRS 2.4±2.2; z=–3.673, p=0.000, Table 3). This difference remains for moderate (NRS difference 0.61; z=–2.35, p=0.019), but not for low or severe pain levels. No differences due to assessor gender were regarded on POD_1 (z=–0.02, p=0.984, Table 3). In front of a female assessor, the quality of pain was described with more intense affective (19.8% vs. 17.6%, p=0.008) and sensory components (16.6% vs. 11.9%, p=0.004) than in front of a male assessor on POD_ 2.1 (Table Supplementary).

Considering the four different study groups regarding gender of assessor and gender of patient, a significant difference was seen on POD_2 for pain intensity [H(3)=14.139, p=0.003] and SES (Table 3). In particular, male patients reported higher pain scores to a female assessor compared to a male assessor (NRS difference 1.2; z=–3.616, p=0.000; Fig. 3). This difference remains consistent for moderate (NRS difference 1.1; z=–3.06, p=0.002), but not for low or severe pain levels. In addition, female patients reported descriptively higher pain scores to a female examiner again on POD_2.1 but without reaching significance (NRS difference 1.1; z=–1.426, p=0.154).

Fig. 3: 
            Reporting of pain intensity on the second postoperative day depending on gender of examiners and patients. Scatter plot of NRS scores (NRS: 0=“no pain” to 10=“worst imaginable pain”) divided into gender of examiner and patients. Data are presented as mean values. Overall mean is displayed as dashed line. n=145. Comparison of the four groups revealed in Kruskal-Wallis-test [(3)=14.139, p=0.003] a main significant difference. Mann-Whitney-U-test revealed differences between Fm vs. Mf (NRS difference 0.88, z=–2.088, *p=0.037) and Fm vs. Mm (NRS difference 1.22, z=–3.616, **p=0.000). F=female examiner; f=female patient; M=male examiner; m=male patient.
Fig. 3:

Reporting of pain intensity on the second postoperative day depending on gender of examiners and patients. Scatter plot of NRS scores (NRS: 0=“no pain” to 10=“worst imaginable pain”) divided into gender of examiner and patients. Data are presented as mean values. Overall mean is displayed as dashed line. n=145. Comparison of the four groups revealed in Kruskal-Wallis-test [(3)=14.139, p=0.003] a main significant difference. Mann-Whitney-U-test revealed differences between Fm vs. Mf (NRS difference 0.88, z=–2.088, *p=0.037) and Fm vs. Mm (NRS difference 1.22, z=–3.616, **p=0.000). F=female examiner; f=female patient; M=male examiner; m=male patient.

Subgroup analyses investigating anxiety revealed no significant effects (Fig. 4). There were no significant effects on any measures due to individual assessors.

Fig. 4: 
            Heat map of pain intensity depending on gender of examiners and patients. Displayed is the percentage of patients with low or moderate (STAI-S≤44) vs. severe anxiety (STAI-S≥45) on the first and second postoperative day (POD). Each pain intensity on Numerical Rating Scale (NRS: 0=“no pain” to 10=“worst imaginable pain”) is plotted in columns. Color codes reflect low (white) and high (red) percentage (sum of frequencies on POD_1 and POD_2) of patients. n=165.
Fig. 4:

Heat map of pain intensity depending on gender of examiners and patients. Displayed is the percentage of patients with low or moderate (STAI-S≤44) vs. severe anxiety (STAI-S≥45) on the first and second postoperative day (POD). Each pain intensity on Numerical Rating Scale (NRS: 0=“no pain” to 10=“worst imaginable pain”) is plotted in columns. Color codes reflect low (white) and high (red) percentage (sum of frequencies on POD_1 and POD_2) of patients. n=165.

4 Discussion

Our data indicate that the gender of the assessor biases pain reporting of patients with acute postoperative pain, although they seem to document the opposite phenomenon as hypothesized from experimental studies that lower pain intensities are reported when assessed in front of a female compared to a male assessor.

In the whole population of 165 patients after elective heart surgery via sternotomy, average pain intensity did not differ between male and female patients if the gender of the examiner was ignored. However, patients reported higher pain intensities in front of a female compared to a male examiner and vice versa lower pain intensities in front of a male assessor. Therefore, although only significant in males, the general direction of the gender bias was similar in female and in male patients in the postoperative period. Both of these results are not consistent to the studies done under experimental conditions indicating that mechanisms of gender reporting bias under clinical conditions need to be studied in patients (only).

As this is the first clinical study on gender reporting bias, comparison to other studies on the same issue in clinical reality is not possible. Results from previous experimental studies indicate a gender experimenter bias but with contrasting and very heterogeneous results [6], [7], [8], [9], [10], [11], [12], [13], [14], [15], [16]. The differences between the experimental studies might result from the very different measures of pain and other methodological issues. Interestingly, there are only three experimental studies which were designed specifically to investigate gender reporting bias (Table 1) [6], [7], [8]; all three resulting in the general conclusion that pain intensity might be lower when reported to a female examiner. Our results are the opposite and an explanation for this clear difference seem to be unclear.

However, looking more specifically to the results in the experimental studies, there is an obvious but overlooked difference in male and female subjects related to a gender reporting bias, again in those studies designed to investigate a gender reporting bias [6], [7], [8]; only male but not female subjects show a gender reporting bias in these three studies [6], [7], [8], and only results in male patients in our study were significant (although, again, in the opposite direction). Therefore, we need to especially link the gender reporting bias to the male gender, e.g. by searching for explanations for the difference between the experimental and (our) clinical results. Under experimental conditions, male volunteers may report lower pain intensities in order to impress (most likely unconsciously) a female experimenter in a painful situation. An experimental pain stimulus can be terminated at any time, and there are no therapeutic consequences if pain rating is lower. In addition, the gender bias of male subjects under experimental conditions was reported if the investigator was a female assessor [7]; this might support the idea of “impressing” female experimenters with low pain reports under experimental conditions. In contrast, such a mechanism may be irrelevant under clinical conditions and is reversed by the desire to get an effective treatment. Furthermore, patients in our study had an average age of 66 years, an age in which to impress women becomes less relevant (compared to 22 year old subjects in the experimental studies [6], [7], [8]). Together, there seems to be a gender reporting bias for males under experimental and clinical conditions but the effect might be the opposite. Such a difference in gender reporting bias of male patients compared to male subjects under experimental conditions might be explainable.

In our female patients, gender reporting bias was only half as much as in male patients and not statistically significant indicating a much less (if any) gender bias for female patients in clinical situations. Similar, Levine and De Simone reported a nonsignificant gender bias in females but there was a trend towards a higher report to male experimenters [7], opposite to our clinical study. The two other studies designed specifically to investigate gender reporting bias under experimental conditions found no effect [6], [8], supporting that, for females, the gender reporting bias is much less important in general.

No previous study investigated the role of assessor gender on pain reports prospectively in a clinical population. The only study that dealt with gender reporting bias in patients was a retrospective analysis of records in an emergency department with basically no gender reporting bias except some when subgroups were analyzed [24]. However, subgroup analysis revealed higher pain intensity ratings of patients to male examiners when pain levels were initially relatively low; in contrast patients with initial higher pain intensity ratings reported (even) higher pain to female examiners [24]. In our prospective study, patients reported rather low pain ratings but males rated pain higher in front of a female examiner indicating the opposite direction of gender bias. However, methodological limitations are evident and limit the value of the retrospective analysis [24].

Interestingly, gender differences between pain reports of patients were not evident if gender of the examiner was ignored. Many previous postoperative pain studies reported higher pain scores in female patients compared to males, regardless of the type of surgery [25], [26]. According to our results, gender differences between male and female patients might be equalled when males are investigated by a female examiner suggesting that the gender reporting bias might be more relevant than the gender difference in pain experience. However, such a suggestion needs to be studied in the future.

Although we demonstrate a significant gender examiner bias, the clinical relevance of a difference of 1.2 NRS points needs to be discussed. For patients with a moderate pain intensity, a drop of 1.3 NRS points corresponded only to a minimal improvement [27], but when reflecting that a value of 3 on NRS for resting pain is considered to be the threshold for good quality pain management [28], a difference of 1.2 might be relevant when patients score a value of 4 on NRS: in this case male patients would get additional analgesics when examined by females rather than males.

Together, our results would generally imply that female examiners cause a higher analgesic consumption, whereas male examiners would cause a lower analgesic consumption probably due to their higher authority demonstrated towards patients.

4.1 Strength and limitations

Our study is limited by only including post-sternotomy patients with a mean age of 66 years. In addition, patients scheduled for heart surgery are frequently multimorbid and are at a higher risk for postoperative complications, both may explain a higher exclusion rate compared to a young and healthier population.

We investigated confounders like depression and anxiety. Both might be linked to pain intensity, but both independent from examiner gender. As the topic of gender influences on pain intensity seems to be even more complex in the clinical environment, there are probably further unrecognized confounders.

As an a priori power analysis revealed a total size of at least 126 for the outcome pain rating on NRS, we reached our suggested threshold. However, due to a generally smaller number of females undergoing heart surgery there was a smaller sample size in the female patient group.

In order to maintain the clinical routine dosages for analgesic management, a non-randomized study design was chosen and the analgesic regime was not adjusted to mg/kg or otherwise changed. Furthermore, a double-blinded, randomized cross-over design would have been preferable, but preliminary results indicated that patients would have been influenced, on the one hand, and exhausted, on the other, if asked to repeatedly rate their pain intensity.

The strength of our study was a standardized study protocol including a standardized analgesic regime investigating a homogenous sample of patients. Additionally, we chose four instead of just one male and one female examiner to exclude individual confounders such as sympathy or antipathy.

In our clinical study, gender bias was not observed until POD_2, consistently for both, pain intensity (NRS) and pain quality (SES). It is speculative, but this effect could be due to a hangover of anaesthetics on POD_1 and a routinely delayed extubation after surgery that might mask gender bias by suppressing the mechanisms that are causative for its occurrence. Another explanation might be the rather high pain ratings on POD_1 which might be less prone to gender bias. However, in general patients suffering from severe pain were rare [POD_1 n=18 (out of 165), POD_2 n=8 (out of 144)], but mild pain itself seems not be a sensitive enough factor for gender differences.

Because only post-sternotomy patients were included, we do not know if these results can be generalized to other patient groups; however, we tried to be consistent for the surgical procedure in this first prospective clinical study on the gender experimenter bias to exclude an additional confounder. Furthermore, we cannot exclude that our assessors’ inexperienced professional status might have influenced the results as seen in [16]. As the students looked very young, they may have possibly seemed inexperienced. Further studies need to address these limitations.

5 Conclusions and implications

Together, contrary to the expectations, patients after cardiac surgery reported a higher pain intensity in front of a female and a lower pain intensity in front of a male assessor. Despite some methodological weakness, our data suggest that attention should be paid to a rather small, but somehow significant and consistent examiner gender bias after surgery especially in male patients. Female caregivers may heighten the reported pain intensity up to 1.2 NRS-points. In this case male patients would need, respectively, get additional analgesics when examined by females rather than males. Further clinical studies are needed to show the true extent of clinical relevance on e.g. consumption of analgesics, time to mobilization or length of hospital stay and importance of these findings under clinical conditions, and exact mechanisms underlying these gender reporting bias.

  1. Authors’ statements

  2. Research funding: None.

  3. Conflict of interest: All authors declare that they have no conflicts of interest regarding this publication.

  4. Informed consent: Written informed consent was obtained from all patients before enrolment.

  5. Ethical approval: The local Ethics Committee of the Ruhr University Bochum, Germany approved the study protocol (No. 4484-12; DRKS00011597).

  6. Authors’ contributions

  7. All authors meet all four criteria for authorship recommended by ICMJE. All authors have seen and agree with the final contents of the manuscript. CMF: drafted ethical proposal and manuscript, performed statistics and interpreted data; PS: collected data, did statistical analyses, drafted manuscript; PZ: responsible for concept, participated in drafting the manuscript; EPZ: responsible for concept and study design, gave advice and made critical revisions during drafting process.

References

[1] Bartley EJ, Fillingim RB. Sex differences in pain: a brief review of clinical and experimental findings. Br J Anaesth 2013;111:52–8.10.1093/bja/aet127Suche in Google Scholar PubMed PubMed Central

[2] Mogil JS. Sex differences in pain and pain inhibition: multiple explanations of a controversial phenomenon. Nat Rev Neurosci 2012;13:859–66.10.1038/nrn3360Suche in Google Scholar PubMed

[3] Breivik H, Collett B, Ventafridda V, Cohen R, Gallacher D. Survey of chronic pain in Europe: prevalence, impact on daily life, and treatment. Eur J Pain 2006;10:287–333.10.1016/j.ejpain.2005.06.009Suche in Google Scholar PubMed

[4] Fillingim RB, King CD, Ribeiro-Dasilva MC, Rahim-Williams B, Riley JL. Sex, gender, and pain: a review of recent clinical and experimental findings. J Pain Off J Am Pain Soc 2009;10:447–85.10.1016/j.jpain.2008.12.001Suche in Google Scholar PubMed PubMed Central

[5] Racine M, Tousignant-Laflamme Y, Kloda LA, Dion D, Dupuis G, Choinière M. A systematic literature review of 10 years of research on sex/gender and experimental pain perception – part 1: are there really differences between women and men? Pain 2012;153:602–18.10.1016/j.pain.2011.11.025Suche in Google Scholar PubMed

[6] Aslaksen PM, Myrbakk IN, Høifødt RS, Flaten MA. The effect of experimenter gender on autonomic and subjective responses to pain stimuli. Pain 2007;129:260–8.10.1016/j.pain.2006.10.011Suche in Google Scholar PubMed

[7] Levine FM, De Simone LL. The effects of experimenter gender on pain report in male and female subjects. Pain 1991;44:69–72.10.1016/0304-3959(91)90149-RSuche in Google Scholar PubMed

[8] Gijsbers K, Nicholson F. Experimental pain thresholds influenced by sex of experimenter. Percept Mot Skills 2005;101:803–7.10.2466/pms.101.3.803-807Suche in Google Scholar PubMed

[9] Edwards R, Eccleston C, Keogh E. Observer influences on pain: an experimental series examining same-sex and opposite-sex friends, strangers, and romantic partners. Pain 2017;158:846–55.10.1097/j.pain.0000000000000840Suche in Google Scholar PubMed

[10] McClelland LE, McCubbin JA. Social influence and pain response in women and men. J Behav Med 2008;31:413–20.10.1007/s10865-008-9163-6Suche in Google Scholar PubMed

[11] Otto MW, Dougher MJ. Sex differences and personality factors in responsivity to pain. Percept Mot Skills 1985; 61:383–90.10.2466/pms.1985.61.2.383Suche in Google Scholar PubMed

[12] Vigil JM, Coulombe P. Biological sex and social setting affects pain intensity and observational coding of other people’s pain behaviors. Pain 2011;152:2125–30.10.1016/j.pain.2011.05.019Suche in Google Scholar PubMed

[13] Vigil JM, Rowell LN, Alcock J, Maestes R. Laboratory personnel gender and cold pressor apparatus affect subjective pain reports. Pain Res Manag 2014;19:e13–8.10.1155/2014/213950Suche in Google Scholar PubMed PubMed Central

[14] Vigil JM, DiDomenico J, Strenth C, Coulombe P, Kruger E, Mueller AA, Guevara Beltran D, Adams I. Experimenter effects on pain reporting in women vary across the menstrual cycle. Int J Endocrinol 2015;2015:520719.10.1155/2015/520719Suche in Google Scholar PubMed PubMed Central

[15] Weisse CS, Foster KK, Fisher EA. The influence of experimenter gender and race on pain reporting: does racial or gender concordance matter? Pain Med Malden Mass 2005;6:80–7.10.1111/j.1526-4637.2005.05004.xSuche in Google Scholar PubMed

[16] Kállai I, Barke A, Voss U. The effects of experimenter characteristics on pain reports in women and men. Pain 2004;112:142–7.10.1016/j.pain.2004.08.008Suche in Google Scholar PubMed

[17] Weisse CS, Sorum PC, Sanders KN, Syat BL. Do gender and race affect decisions about pain management? J Gen Intern Med 2001;16:211–7.10.1046/j.1525-1497.2001.016004211.xSuche in Google Scholar PubMed PubMed Central

[18] Spielberger CD. State-trait anxiety invetory STAI. Palo Alto (CA): Consulting Psychologists Press, 1983.10.1037/t06496-000Suche in Google Scholar

[19] Beck AT, Steer RA, Brown GK. Manual for the beck depression inventory (BDI-II), 2nd ed. San Antonio, TX: The Psychological Association, 1996.10.1037/t00742-000Suche in Google Scholar

[20] Geissner E. Die Schmerzempfindungs-Skala (SES) unter Mitarbeit von Andreas, Schulte. Göttingen, Germany: Handanweisung. Hogrefe, Verlag für Psychologie, 1996.Suche in Google Scholar

[21] Gaudreau J-D, Gagnon P, Harel F, Tremblay A, Roy M-A. Fast, systematic, and continuous delirium assessment in hospitalized patients: the nursing delirium screening scale. J Pain Symptom Manage 2005;29:368–75.10.1016/j.jpainsymman.2004.07.009Suche in Google Scholar PubMed

[22] Reist L, Erlenwein J, Meissner W, Stammschulte T, Stüber F, Stamer UM. Dipyrone is the preferred nonopioid analgesic for the treatment of acute and chronic pain. A survey of clinical practice in German-speaking countries. Eur J Pain Lond Engl 2018;22:1103–12.10.1002/ejp.1194Suche in Google Scholar PubMed

[23] AWMF – S3 Leitlinie Behandlung akuter perioperativer und posttraumatischer Schmerzen 2009.Suche in Google Scholar

[24] Vigil JM, Alcock J. Tough guys or sensitive guys? Disentangling the role of examiner sex on patient pain reports. Pain Res Manag 2014;19:e9–12.10.1155/2014/531396Suche in Google Scholar PubMed PubMed Central

[25] Gerbershagen HJ, Pogatzki-Zahn E, Aduckathil S, Peelen LM, Kappen TH, van Wijck AJM, Kalkman CJ, Meissner W. Procedure-specific risk factor analysis for the development of severe postoperative pain. Anesthesiology 2014;120:1237–45.10.1097/ALN.0000000000000108Suche in Google Scholar PubMed

[26] Tighe PJ, Riley JL, Fillingim RB. Sex differences in the incidence of severe pain events following surgery: a review of 333,000 pain scores. Pain Med Malden Mass 2014;15:1390–404.10.1111/pme.12498Suche in Google Scholar PubMed PubMed Central

[27] Cepeda MS, Africano JM, Polo R, Alcala R, Carr DB. What decline in pain intensity is meaningful to patients with acute pain? Pain 2003;105:151–7.10.1016/S0304-3959(03)00176-3Suche in Google Scholar

[28] Maier C, Nestler N, Richter H, Hardinghaus W, Pogatzki-Zahn E, Zenz M, Osterbrink J. The quality of pain management in German hospitals. Dtsch Ärztebl Int 2010;107:607–14.10.3238/arztebl.2010.0607Suche in Google Scholar PubMed PubMed Central


Supplementary Material

The online version of this article offers supplementary material (https://doi.org/10.1515/sjpain-2018-0111).



Article note

This work is part of the doctoral thesis of PS. Preliminary data for this study were presented as a poster presentation at the Congress of the German Society of Anaesthesiology and Intensive Care Medicine “DAC 2014”, 8–10 May, 2014, in Leipzig, Germany, and presented at the Congress of the German section of the International Association for the Study of Pain “Schmerzkongress 2016”, 19–22 October, 2016, in Mannheim, Germany.


Received: 2018-07-09
Revised: 2018-09-11
Published Online: 2018-10-10
Published in Print: 2019-01-28

©2018 Scandinavian Association for the Study of Pain. Published by Walter de Gruyter GmbH, Berlin/Boston. All rights reserved

Artikel in diesem Heft

  1. Frontmatter
  2. Editorial comment
  3. The Fear Avoidance Beliefs Questionnaire – the FABQ – for the benefit of another 70 million potential pain patients
  4. The Yaksh-model of intrathecal opioid-studies: still exciting four decades later
  5. Pain is common in chronic fatigue syndrome – current knowledge and future perspectives
  6. Systematic review
  7. Use of multidomain management strategies by community dwelling adults with chronic pain: evidence from a systematic review
  8. Clinical pain research
  9. Topographic mapping of pain sensitivity of the lower back – a comparison of healthy controls and patients with chronic non-specific low back pain
  10. A prospective study of patients’ pain intensity after cardiac surgery and a qualitative review: effects of examiners’ gender on patient reporting
  11. Correlations between the active straight leg raise, sleep and somatosensory sensitivity during pregnancy with post-partum lumbopelvic pain: an initial exploration
  12. Pain is associated with reduced quality of life and functional status in patients with Myalgic Encephalomyelitis/Chronic Fatigue Syndrome
  13. Does validation and alliance during the multimodal investigation affect patients’ acceptance of chronic pain? An experimental single case study
  14. Translation, cross-cultural adaptation, and psychometric properties of the Hausa version of the Fear-Avoidance Beliefs Questionnaire in patients with low back pain
  15. Observational study
  16. Cause-specific mortality of patients with severe chronic pain referred to a multidisciplinary pain clinic: a cohort register-linkage study
  17. Pain self-efficacy moderates the association between pain and somatization in a community sample
  18. Pediatric chronic pain and caregiver burden in a national survey
  19. Psychometric evaluation of the Danish version of a modified Revised American Pain Society Patient Outcome Questionnaire (APS-POQ-R-D) for patients hospitalized with acute abdominal pain
  20. Musculoskeletal pain in multiple body sites and work ability in the general working population: cross-sectional study among 10,000 wage earners
  21. Prediction of running-induced Achilles tendinopathy with pain sensitivity – a 1-year prospective study
  22. Original experimental
  23. Body image is more negative in patients with chronic low back pain than in patients with subacute low back pain and healthy controls
  24. Identifying pain in children with CHARGE syndrome
  25. Patients’ perspective of the effectiveness and acceptability of pharmacological and non-pharmacological treatments of fibromyalgia
  26. Exercise-induce hyperalgesia, complement system and elastase activation in Myalgic Encephalomyelitis/Chronic Fatigue Syndrome – a secondary analysis of experimental comparative studies
  27. Characterization of the antinociceptive effects of intrathecal DALDA peptides following bolus intrathecal delivery
  28. The effects of auditory background noise and virtual reality technology on video game distraction analgesia
  29. Book review
  30. Atlas of Common Pain Syndromes, 4th Edition
  31. Atlas of Ultrasound-Guided Regional Anesthesia, 3rd Edition
  32. Anaesthesia, Intensive Care and Perioperative Medicine A-Z, 6th Edition
Heruntergeladen am 20.9.2025 von https://www.degruyterbrill.com/document/doi/10.1515/sjpain-2018-0111/html
Button zum nach oben scrollen