Article

Automated reproducibility assessments in the social and behavioral sciences using large language models

2026-08-05

Abstract excerpt

<title>Abstract</title> <p>Reproducibility in the social and behavioral sciences is typically evaluated by independent researchers who reanalyze the original data to assess whether the published findings can be recovered. However, such approaches are resource-intensive and difficult to scale. Here, we show that large language models (LLMs) can automate reproducibility assessments. Using N=180 published studies wi...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 6b832a06-4e12-5203-8c81-f5277f13643a
DOI: 10.21203/rs.3.rs-10313775/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Automated reproducibility assessments in the social and behavioral sciences using large language modelsDOI 10.21203/rs.3.rs-10313775/v1Read

Evaluating Large Language Models in Psychological Research: A Guide for ReviewersSemantic proximity Read

A Primer for Evaluating Large Language Models in Social Science ResearchSemantic proximity Read

A Primer for Evaluating Large Language Models in Social Science ResearchSemantic proximity Read

Human Researchers are Superior to Large Language Models in Writing a Systematic Review in a Comparative Multitask AssessmentSemantic proximity Read

Automation of Systematic Reviews with Large Language ModelsSemantic proximity Read

Large Language Models in Psychology: Application in the Context of a Systematic Literature Review.Semantic proximity Read

Large Language Models (LLMs) for Evidence Synthesis: An Exploratory Evaluation and A New Approach for Automated Data Extraction and ValidationSemantic proximity Read

(Semi)automated approaches to data extraction for systematic reviews and meta-analyses in social sciences: A living review protocolSemantic proximity Read

Beyond Metrics to Methods: A Scoping Review of Large Language Models for Detection of Social Drivers of Health in Clinical NotesSemantic proximity Read

Large Language Models for Large-Scale, Rigorous Qualitative Analysis in Applied Health Services ResearchSemantic proximity Read

Assessing the feasibility and acceptability of a bespoke large language model pipeline to extract data from different study designs for public health evidence reviewsSemantic proximity Read

Collaborative Large Language Models for Automated Data Extraction in Living Systematic ReviewsSemantic proximity Read