Article

Evaluating Large Language Models for Psychometric Simulation Studies in R: Integrating Best Practices in Simulation and Prompt Design

2026-04-08

Abstract excerpt

<p>While large language model (LLM) capabilities have been widely investigated across various domains, limited research has examined their capability to generate end-to-end R code for conducting simulation studies in psychometrics. To address this gap, we evaluated four commonly used reasoning models: ChatGPT-5.1 (Thinking), Claude 4.5 Opus, DeepSeek-V3.2, and Gemini 3 Pro, in generating simulation code correspond...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: db68a766-73d2-51f8-8732-5179c97c7b3b
DOI: 10.31234/osf.io/9tfej_v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Evaluating Large Language Models for Psychometric Simulation Studies in R: Integrating Best Practices in Simulation and Prompt DesignDOI 10.31234/osf.io/9tfej_v1Read

Can Large Language Models Emulate Human Performance on Educational Assessments?Semantic proximity Read

Beyond Data: How Simulation Can Empower LLMs to Revolutionize ScienceSemantic proximity Read

LLMs in the Lab: Can AI Predict What Real Participants Do?Semantic proximity Read

A statistical framework for evaluating the repeatability and reproducibility of large language modelsSemantic proximity Read

Evaluating Large Language Models in Psychological Research: A Guide for ReviewersSemantic proximity Read

Large Language Models in Psychology: Application in the Context of a Systematic Literature Review.Semantic proximity Read

From Protocol to Analysis Plan: Development and Validation of a Large Language Model Pipeline for Statistical Analysis Plan Generation using Artificial Intelligence (SAPAI)Semantic proximity Read

Evaluating Large Language Models for Feature Extraction from Verbal Stimuli: A Simulation-Based WorkflowSemantic proximity Read

Large Language Models in Real-World Clinical Workflows: A Systematic Review of Applications and ImplementationSemantic proximity Read

Generating Better Items for Cognitive Assessments Using Large Language ModelsSemantic proximity Read

Large Language Models in Undergraduate Medical Education: A Scoping Review of Use Cases, Effectiveness, and LimitationsSemantic proximity Read