Article

A Primer for Evaluating Large Language Models in Social Science Research

2024-04-22

Abstract excerpt

<p>Autoregressive Large Language Models (LLMs) exhibit remarkable conversational and reasoning abilities, and exceptional flexibility across a wide range of tasks. Subsequently, LLMs are being increasingly used in scientific research, to analyze data, generate synthetic data, or even to write scientific papers. This trend necessitates that authors follow best practices for conducting and reporting LLM research and...

Topics

Open a Topic to create a Post that cites this publication.

Uncategorized literature

Identifiers and source

Literature Corpus work: 61332255-516a-52f2-8f35-d31a50cfa835
DOI: 10.31234/osf.io/ag7hy_v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

A Primer for Evaluating Large Language Models in Social Science ResearchDOI 10.31234/osf.io/ag7hy_v1Read

A Primer for Evaluating Large Language Models in Social Science ResearchSemantic proximity Read

Evaluating Large Language Models in Psychological Research: A Guide for ReviewersSemantic proximity Read

Automated reproducibility assessments in the social and behavioral sciences using large language modelsSemantic proximity Read

Perils and Opportunities in Using Large Language Models in Psychological ResearchSemantic proximity Read

One and a Half Year of ChatGPT: An Umbrella Review of Large Language Model (LLM) Perception Across Time and Research FieldsSemantic proximity Read

Assessing the research landscape and clinical utility of large language models: A scoping reviewSemantic proximity Read

Large language models as linguistic simulators and cognitive models in human researchSemantic proximity Read

Synthetic Participants Generated by Large Language Models: A Systematic Literature ReviewSemantic proximity Read

Integrating large language models into the psychological sciencesSemantic proximity Read

AI as a Research Proxy: Navigating the New Frontier of Social Science Inquiry through Language ModelsSemantic proximity Read

Human Researchers are Superior to Large Language Models in Writing a Systematic Review in a Comparative Multitask AssessmentSemantic proximity Read

Artificial intelligence in psychology researchSemantic proximity Read