Article

Evaluating Large Language Models in Psychological Research: A Guide for Reviewers

2024-04-22

Abstract excerpt

<p>Large Language Models (LLMs) are being increasingly used in scientific research, be it to analyze data, generate synthetic data, or even to write scientific papers. This trend necessitates that journal reviewers are able to evaluate the quality of works that utilize LLMs. We provide reviewers of psychological research with a comprehensive guide on evaluating research that uses LLMs, examining their dual roles o...

Topics

Open a Topic to create a Post that cites this publication.

Uncategorized literature

Identifiers and source

Literature Corpus work: 3a642329-a80a-511f-9774-5aaeb0c2e0ba
DOI: 10.31234/osf.io/ag7hy

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Evaluating Large Language Models in Psychological Research: A Guide for ReviewersDOI 10.31234/osf.io/ag7hyRead

A Primer for Evaluating Large Language Models in Social Science ResearchSemantic proximity Read

A Primer for Evaluating Large Language Models in Social Science ResearchSemantic proximity Read

Perils and Opportunities in Using Large Language Models in Psychological ResearchSemantic proximity Read

Automated reproducibility assessments in the social and behavioral sciences using large language modelsSemantic proximity Read

Large language models as linguistic simulators and cognitive models in human researchSemantic proximity Read

Integrating large language models into the psychological sciencesSemantic proximity Read

Synthetic Participants Generated by Large Language Models: A Systematic Literature ReviewSemantic proximity Read

Large Language Models in Psychology: Application in the Context of a Systematic Literature Review.Semantic proximity Read

One and a Half Year of ChatGPT: An Umbrella Review of Large Language Model (LLM) Perception Across Time and Research FieldsSemantic proximity Read

Human Researchers are Superior to Large Language Models in Writing a Systematic Review in a Comparative Multitask AssessmentSemantic proximity Read

Artificial intelligence in psychology researchSemantic proximity Read

LLMs in the Lab: Can AI Predict What Real Participants Do?Semantic proximity Read