Repetition Effects in Laboratory Experiments
-
Roger Berger
and Bastian Baumeister
Abstract
Subjects of laboratory experiments are often recruited from a subject pool. Such experiments are typically similar in content and demand, and so learning processes can be assumed when the same subjects attend two subsequent experimental sessions. We label these “repetition effects”, because in these cases the learning processes differ from those where repeated decisions are made within a singular experiment. Such repetition effects endanger the validity of laboratory experiments. Repetition effects have a procedural component (subjects get to know procedures and equipment in the lab) and a social component (subjects learn how to interact within the special population of laboratory subjects). Furthermore, they can result from the self-selection of subjects in repeated experiments. Through two pilot studies,we show empirically how repetition effects can undermine the validity of experimental results. For this purpose, the same subjects repeated identical experiments (a cognitive reflection test, a hit game, and a dirty faces game in study 1; a prisoner’s dilemma in study 2) several months apart. The results indicate that there were substantial procedural and social learning effects, even when the repeated experiment occurred as much as six months after the initial experiment. Self-selection, however, did not play a major role.
Abstract
Subjects of laboratory experiments are often recruited from a subject pool. Such experiments are typically similar in content and demand, and so learning processes can be assumed when the same subjects attend two subsequent experimental sessions. We label these “repetition effects”, because in these cases the learning processes differ from those where repeated decisions are made within a singular experiment. Such repetition effects endanger the validity of laboratory experiments. Repetition effects have a procedural component (subjects get to know procedures and equipment in the lab) and a social component (subjects learn how to interact within the special population of laboratory subjects). Furthermore, they can result from the self-selection of subjects in repeated experiments. Through two pilot studies,we show empirically how repetition effects can undermine the validity of experimental results. For this purpose, the same subjects repeated identical experiments (a cognitive reflection test, a hit game, and a dirty faces game in study 1; a prisoner’s dilemma in study 2) several months apart. The results indicate that there were substantial procedural and social learning effects, even when the repeated experiment occurred as much as six months after the initial experiment. Self-selection, however, did not play a major role.
Chapters in this book
- Frontmatter I
- Preface VII
- Contents IX
-
Part I: Foundations
- Introduction 3
- Micro-Macro Models in Sociology: Antecedents of Coleman’s Diagram 11
-
Part II: Institutions
- The Kula Ring of Bronislaw Malinowski: Simulating the Co-Evolution of an Economic and Ceremonial Exchange System 39
- From the Savannah to the Magistrate’s Court 61
- The Dependence of Human Cognitive and Motivational Processes on Institutional Systems 85
- Social Dilemmas and Solutions in Immunizations 107
-
Part III: Social Norms
- When Do People Follow Norms and When Do They Pursue Their Interests? 119
- Personal Exposure to Unfavorable Environmental Conditions: Does it Stimulate Environmental Activism? 143
- Cooperation and Career Chances in Science 165
- Social Dilemmas in Science: Detecting Misconduct and Finding Institutional Solutions 189
- The Interplay of Social Status and Reciprocity 215
-
Part IV: Peer-Sanctioning
- Types of Normative Conflicts and the Effectiveness of Punishment 239
- Social Status and Peer-Punishment: Findings from Two Road Traffic Field Experiments 259
- The Double Edge of Counter-Sanctions. Is Peer Sanctioning Robust to Counter-Punishment but Vulnerable to Counter-Reward? 279
- Diffusion of Responsibility in Norm Enforcement 303
- Endogenous Peer Punishment Institutions in Prisoner’s Dilemmas: The Role of Noise 327
-
Part V: Trust and Trustworthiness
- Cooperation and Distrust – a Contradiction? 357
- Signaling Theory Evolving: Signals and Signs of Trustworthiness in Social Exchange 373
- Trust and Promises as Friendly Advances 393
- Online Reputation in eBay Auctions: Damaging and Rebuilding Trustworthiness Through Feedback Comments from Buyers and Sellers 421
-
Part VI: Game Theory
- Nash Dynamics, Meritocratic Matching, and Cooperation 447
- A Note on the Strategic Determination of the Required Number of Volunteers 471
- Is No News Bad News? A Hostage Trust Game with Incomplete Information and Fairness Considerations of the Trustee 481
-
Part VII: Experimental Methods
- When Prediction Fails 505
- Measuring Social Preferences on Amazon Mechanical Turk 527
- Repetition Effects in Laboratory Experiments 547
- Notes on the Editors and Contributors 567
Chapters in this book
- Frontmatter I
- Preface VII
- Contents IX
-
Part I: Foundations
- Introduction 3
- Micro-Macro Models in Sociology: Antecedents of Coleman’s Diagram 11
-
Part II: Institutions
- The Kula Ring of Bronislaw Malinowski: Simulating the Co-Evolution of an Economic and Ceremonial Exchange System 39
- From the Savannah to the Magistrate’s Court 61
- The Dependence of Human Cognitive and Motivational Processes on Institutional Systems 85
- Social Dilemmas and Solutions in Immunizations 107
-
Part III: Social Norms
- When Do People Follow Norms and When Do They Pursue Their Interests? 119
- Personal Exposure to Unfavorable Environmental Conditions: Does it Stimulate Environmental Activism? 143
- Cooperation and Career Chances in Science 165
- Social Dilemmas in Science: Detecting Misconduct and Finding Institutional Solutions 189
- The Interplay of Social Status and Reciprocity 215
-
Part IV: Peer-Sanctioning
- Types of Normative Conflicts and the Effectiveness of Punishment 239
- Social Status and Peer-Punishment: Findings from Two Road Traffic Field Experiments 259
- The Double Edge of Counter-Sanctions. Is Peer Sanctioning Robust to Counter-Punishment but Vulnerable to Counter-Reward? 279
- Diffusion of Responsibility in Norm Enforcement 303
- Endogenous Peer Punishment Institutions in Prisoner’s Dilemmas: The Role of Noise 327
-
Part V: Trust and Trustworthiness
- Cooperation and Distrust – a Contradiction? 357
- Signaling Theory Evolving: Signals and Signs of Trustworthiness in Social Exchange 373
- Trust and Promises as Friendly Advances 393
- Online Reputation in eBay Auctions: Damaging and Rebuilding Trustworthiness Through Feedback Comments from Buyers and Sellers 421
-
Part VI: Game Theory
- Nash Dynamics, Meritocratic Matching, and Cooperation 447
- A Note on the Strategic Determination of the Required Number of Volunteers 471
- Is No News Bad News? A Hostage Trust Game with Incomplete Information and Fairness Considerations of the Trustee 481
-
Part VII: Experimental Methods
- When Prediction Fails 505
- Measuring Social Preferences on Amazon Mechanical Turk 527
- Repetition Effects in Laboratory Experiments 547
- Notes on the Editors and Contributors 567