Article

Large-scale human predictions of the replicability of published social and behavioural science papers – a multi- study analysis

2026-04-01

Abstract excerpt

<p>This paper reports two approaches to forecasting replicability for a corpus of 3000 published social science papers, using large-scale human assessments. Replication Markets used incentivized surveys and prediction markets where participants traded assets linked to replication outcomes and market prices were interpreted as replication predictions. The repliCATS project used a structured group deliberation proto...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 11640245-ad33-5f3a-afd0-1d8e567abd81
DOI: 10.31222/osf.io/vgyed_v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Large-scale human predictions of the replicability of published social and behavioural science papers – a multi- study analysisDOI 10.31222/osf.io/vgyed_v1Read

Using model-based predictions to inform the mathematical aggregation of human-based predictions of replicabilitySemantic proximity Read

Automated reproducibility assessments in the social and behavioral sciences using large language modelsSemantic proximity Read

Seven Guiding Questions for Reproducible AI-Assisted Research in the Social and Behavioral SciencesSemantic proximity Read

External validity of social experimentsSemantic proximity Read

Encouraging vaccination using the creativity and wisdom of crowdsSemantic proximity Read

Designing, Evaluating, and Using Synthetic Participants in Behavioural Public Policy: The PATH ChecklistSemantic proximity Read

Gathering, Evaluating, and Aggregating Social Scientific ModelsSemantic proximity Read

What is replication?Semantic proximity Read

(Semi)automated approaches to data extraction for systematic reviews and meta-analyses in social sciences: A living review protocolSemantic proximity Read

Machine learning augmentation reduces prediction error in collective forecasting: development and validation across prediction marketsSemantic proximity Read

Replicating Health-Economic Simulation Models for Alzheimer’s Disease Using Artificial IntelligenceSemantic proximity Read