Social Dilemmas in Science: Detecting Misconduct and Finding Institutional Solutions
-
Katrin Auspurg
Abstract
Conditions for scientific fraud can be derived fromrational choice and game theories. Ethical norms andmoral pleas seem insufficient to prevent fraudulent behavior, as these measures can only be effective if deviations are detected and sanctioned. As a first step, effective interventions require the more frequent discovery of scientific misbehavior. To advance knowledge in this direction, we evaluate two different diagnosis tools (Benford’s lawand the caliper test), using a unique database combining 30 articles from authors in social psychology accused of committing scientific fraud, together with a control group of 30 articles published by authors who have not been the subject of suspicion.We employ Benford’s law, a common diagnosis tool for identifying fraud. The caliper test, which has commonly been used to diagnose publication bias but not outright fraud, is also used. Our results suggest that the caliper test might be a promising diagnosis tool, whereas for Benford’s law statistical preconditions are notmet. Prior applicationswithout a control group likely suffered froma too high risk of false positives. Finally, some policy recommendations are discussed.
Abstract
Conditions for scientific fraud can be derived fromrational choice and game theories. Ethical norms andmoral pleas seem insufficient to prevent fraudulent behavior, as these measures can only be effective if deviations are detected and sanctioned. As a first step, effective interventions require the more frequent discovery of scientific misbehavior. To advance knowledge in this direction, we evaluate two different diagnosis tools (Benford’s lawand the caliper test), using a unique database combining 30 articles from authors in social psychology accused of committing scientific fraud, together with a control group of 30 articles published by authors who have not been the subject of suspicion.We employ Benford’s law, a common diagnosis tool for identifying fraud. The caliper test, which has commonly been used to diagnose publication bias but not outright fraud, is also used. Our results suggest that the caliper test might be a promising diagnosis tool, whereas for Benford’s law statistical preconditions are notmet. Prior applicationswithout a control group likely suffered froma too high risk of false positives. Finally, some policy recommendations are discussed.
Kapitel in diesem Buch
- Frontmatter I
- Preface VII
- Contents IX
-
Part I: Foundations
- Introduction 3
- Micro-Macro Models in Sociology: Antecedents of Coleman’s Diagram 11
-
Part II: Institutions
- The Kula Ring of Bronislaw Malinowski: Simulating the Co-Evolution of an Economic and Ceremonial Exchange System 39
- From the Savannah to the Magistrate’s Court 61
- The Dependence of Human Cognitive and Motivational Processes on Institutional Systems 85
- Social Dilemmas and Solutions in Immunizations 107
-
Part III: Social Norms
- When Do People Follow Norms and When Do They Pursue Their Interests? 119
- Personal Exposure to Unfavorable Environmental Conditions: Does it Stimulate Environmental Activism? 143
- Cooperation and Career Chances in Science 165
- Social Dilemmas in Science: Detecting Misconduct and Finding Institutional Solutions 189
- The Interplay of Social Status and Reciprocity 215
-
Part IV: Peer-Sanctioning
- Types of Normative Conflicts and the Effectiveness of Punishment 239
- Social Status and Peer-Punishment: Findings from Two Road Traffic Field Experiments 259
- The Double Edge of Counter-Sanctions. Is Peer Sanctioning Robust to Counter-Punishment but Vulnerable to Counter-Reward? 279
- Diffusion of Responsibility in Norm Enforcement 303
- Endogenous Peer Punishment Institutions in Prisoner’s Dilemmas: The Role of Noise 327
-
Part V: Trust and Trustworthiness
- Cooperation and Distrust – a Contradiction? 357
- Signaling Theory Evolving: Signals and Signs of Trustworthiness in Social Exchange 373
- Trust and Promises as Friendly Advances 393
- Online Reputation in eBay Auctions: Damaging and Rebuilding Trustworthiness Through Feedback Comments from Buyers and Sellers 421
-
Part VI: Game Theory
- Nash Dynamics, Meritocratic Matching, and Cooperation 447
- A Note on the Strategic Determination of the Required Number of Volunteers 471
- Is No News Bad News? A Hostage Trust Game with Incomplete Information and Fairness Considerations of the Trustee 481
-
Part VII: Experimental Methods
- When Prediction Fails 505
- Measuring Social Preferences on Amazon Mechanical Turk 527
- Repetition Effects in Laboratory Experiments 547
- Notes on the Editors and Contributors 567
Kapitel in diesem Buch
- Frontmatter I
- Preface VII
- Contents IX
-
Part I: Foundations
- Introduction 3
- Micro-Macro Models in Sociology: Antecedents of Coleman’s Diagram 11
-
Part II: Institutions
- The Kula Ring of Bronislaw Malinowski: Simulating the Co-Evolution of an Economic and Ceremonial Exchange System 39
- From the Savannah to the Magistrate’s Court 61
- The Dependence of Human Cognitive and Motivational Processes on Institutional Systems 85
- Social Dilemmas and Solutions in Immunizations 107
-
Part III: Social Norms
- When Do People Follow Norms and When Do They Pursue Their Interests? 119
- Personal Exposure to Unfavorable Environmental Conditions: Does it Stimulate Environmental Activism? 143
- Cooperation and Career Chances in Science 165
- Social Dilemmas in Science: Detecting Misconduct and Finding Institutional Solutions 189
- The Interplay of Social Status and Reciprocity 215
-
Part IV: Peer-Sanctioning
- Types of Normative Conflicts and the Effectiveness of Punishment 239
- Social Status and Peer-Punishment: Findings from Two Road Traffic Field Experiments 259
- The Double Edge of Counter-Sanctions. Is Peer Sanctioning Robust to Counter-Punishment but Vulnerable to Counter-Reward? 279
- Diffusion of Responsibility in Norm Enforcement 303
- Endogenous Peer Punishment Institutions in Prisoner’s Dilemmas: The Role of Noise 327
-
Part V: Trust and Trustworthiness
- Cooperation and Distrust – a Contradiction? 357
- Signaling Theory Evolving: Signals and Signs of Trustworthiness in Social Exchange 373
- Trust and Promises as Friendly Advances 393
- Online Reputation in eBay Auctions: Damaging and Rebuilding Trustworthiness Through Feedback Comments from Buyers and Sellers 421
-
Part VI: Game Theory
- Nash Dynamics, Meritocratic Matching, and Cooperation 447
- A Note on the Strategic Determination of the Required Number of Volunteers 471
- Is No News Bad News? A Hostage Trust Game with Incomplete Information and Fairness Considerations of the Trustee 481
-
Part VII: Experimental Methods
- When Prediction Fails 505
- Measuring Social Preferences on Amazon Mechanical Turk 527
- Repetition Effects in Laboratory Experiments 547
- Notes on the Editors and Contributors 567