Measuring Social Preferences on Amazon Mechanical Turk
-
Marc Höglinger
Abstract
Social preferences are receiving increased attention in the social sciences, especially in behavioral economics and social psychology. From this arises the need to measure individuals’ social preferences in both the laboratory and in surveys of the broader population. The recently proposed SVO slider measure (Murphy et al. 2011) is supposed to be feasible for laboratory as well as for survey research. Our aim is to evaluate this measure using an online survey distributed on AmazonMechanical Turk (MTurk). We compare the elicited social preferences on MTurk to those found in laboratory settings, look at sociodemographic variation in measured social preferences and evaluate the measure’s test-retest reliability. In addition, we investigate how the standard dictator game performs as an alternative (and shorter) measure of prosocial preferences. Finally, we explore the correlation of these two incentivized measures with established survey items on self-reported prosocial behavior. Results show that social preferences elicited with the SVO-Slider on MTurk have a similar distribution to those found in laboratory settings. Also, the SVO slider turns out to have a high test-retest reliability (Pearson’s r = 0.79). However, the SVO measure correlates only weakly with self-reported prosocial behavior items but, interestingly, considerably with the survey response time.
Abstract
Social preferences are receiving increased attention in the social sciences, especially in behavioral economics and social psychology. From this arises the need to measure individuals’ social preferences in both the laboratory and in surveys of the broader population. The recently proposed SVO slider measure (Murphy et al. 2011) is supposed to be feasible for laboratory as well as for survey research. Our aim is to evaluate this measure using an online survey distributed on AmazonMechanical Turk (MTurk). We compare the elicited social preferences on MTurk to those found in laboratory settings, look at sociodemographic variation in measured social preferences and evaluate the measure’s test-retest reliability. In addition, we investigate how the standard dictator game performs as an alternative (and shorter) measure of prosocial preferences. Finally, we explore the correlation of these two incentivized measures with established survey items on self-reported prosocial behavior. Results show that social preferences elicited with the SVO-Slider on MTurk have a similar distribution to those found in laboratory settings. Also, the SVO slider turns out to have a high test-retest reliability (Pearson’s r = 0.79). However, the SVO measure correlates only weakly with self-reported prosocial behavior items but, interestingly, considerably with the survey response time.
Kapitel in diesem Buch
- Frontmatter I
- Preface VII
- Contents IX
-
Part I: Foundations
- Introduction 3
- Micro-Macro Models in Sociology: Antecedents of Coleman’s Diagram 11
-
Part II: Institutions
- The Kula Ring of Bronislaw Malinowski: Simulating the Co-Evolution of an Economic and Ceremonial Exchange System 39
- From the Savannah to the Magistrate’s Court 61
- The Dependence of Human Cognitive and Motivational Processes on Institutional Systems 85
- Social Dilemmas and Solutions in Immunizations 107
-
Part III: Social Norms
- When Do People Follow Norms and When Do They Pursue Their Interests? 119
- Personal Exposure to Unfavorable Environmental Conditions: Does it Stimulate Environmental Activism? 143
- Cooperation and Career Chances in Science 165
- Social Dilemmas in Science: Detecting Misconduct and Finding Institutional Solutions 189
- The Interplay of Social Status and Reciprocity 215
-
Part IV: Peer-Sanctioning
- Types of Normative Conflicts and the Effectiveness of Punishment 239
- Social Status and Peer-Punishment: Findings from Two Road Traffic Field Experiments 259
- The Double Edge of Counter-Sanctions. Is Peer Sanctioning Robust to Counter-Punishment but Vulnerable to Counter-Reward? 279
- Diffusion of Responsibility in Norm Enforcement 303
- Endogenous Peer Punishment Institutions in Prisoner’s Dilemmas: The Role of Noise 327
-
Part V: Trust and Trustworthiness
- Cooperation and Distrust – a Contradiction? 357
- Signaling Theory Evolving: Signals and Signs of Trustworthiness in Social Exchange 373
- Trust and Promises as Friendly Advances 393
- Online Reputation in eBay Auctions: Damaging and Rebuilding Trustworthiness Through Feedback Comments from Buyers and Sellers 421
-
Part VI: Game Theory
- Nash Dynamics, Meritocratic Matching, and Cooperation 447
- A Note on the Strategic Determination of the Required Number of Volunteers 471
- Is No News Bad News? A Hostage Trust Game with Incomplete Information and Fairness Considerations of the Trustee 481
-
Part VII: Experimental Methods
- When Prediction Fails 505
- Measuring Social Preferences on Amazon Mechanical Turk 527
- Repetition Effects in Laboratory Experiments 547
- Notes on the Editors and Contributors 567
Kapitel in diesem Buch
- Frontmatter I
- Preface VII
- Contents IX
-
Part I: Foundations
- Introduction 3
- Micro-Macro Models in Sociology: Antecedents of Coleman’s Diagram 11
-
Part II: Institutions
- The Kula Ring of Bronislaw Malinowski: Simulating the Co-Evolution of an Economic and Ceremonial Exchange System 39
- From the Savannah to the Magistrate’s Court 61
- The Dependence of Human Cognitive and Motivational Processes on Institutional Systems 85
- Social Dilemmas and Solutions in Immunizations 107
-
Part III: Social Norms
- When Do People Follow Norms and When Do They Pursue Their Interests? 119
- Personal Exposure to Unfavorable Environmental Conditions: Does it Stimulate Environmental Activism? 143
- Cooperation and Career Chances in Science 165
- Social Dilemmas in Science: Detecting Misconduct and Finding Institutional Solutions 189
- The Interplay of Social Status and Reciprocity 215
-
Part IV: Peer-Sanctioning
- Types of Normative Conflicts and the Effectiveness of Punishment 239
- Social Status and Peer-Punishment: Findings from Two Road Traffic Field Experiments 259
- The Double Edge of Counter-Sanctions. Is Peer Sanctioning Robust to Counter-Punishment but Vulnerable to Counter-Reward? 279
- Diffusion of Responsibility in Norm Enforcement 303
- Endogenous Peer Punishment Institutions in Prisoner’s Dilemmas: The Role of Noise 327
-
Part V: Trust and Trustworthiness
- Cooperation and Distrust – a Contradiction? 357
- Signaling Theory Evolving: Signals and Signs of Trustworthiness in Social Exchange 373
- Trust and Promises as Friendly Advances 393
- Online Reputation in eBay Auctions: Damaging and Rebuilding Trustworthiness Through Feedback Comments from Buyers and Sellers 421
-
Part VI: Game Theory
- Nash Dynamics, Meritocratic Matching, and Cooperation 447
- A Note on the Strategic Determination of the Required Number of Volunteers 471
- Is No News Bad News? A Hostage Trust Game with Incomplete Information and Fairness Considerations of the Trustee 481
-
Part VII: Experimental Methods
- When Prediction Fails 505
- Measuring Social Preferences on Amazon Mechanical Turk 527
- Repetition Effects in Laboratory Experiments 547
- Notes on the Editors and Contributors 567