Article

Leveraging AI for Automatic Item Generation for Psychological Scales

2026-04-07

Abstract excerpt

<p>This study examined how large language models (LLMs) can be used for automated item generation (AIG) in psychological scale development, focusing on how prompting strategies and LLM brands and versions influence item quality for both an established and a novel construct. Using three prompting conditions across eight LLMs from four major providers, we generated AI items and evaluated them through expert review,...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 0c2724ff-0d9b-580e-81eb-8e04d68a3626
DOI: 10.31234/osf.io/xvzr9_v2

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Leveraging AI for Automatic Item Generation for Psychological ScalesDOI 10.31234/osf.io/xvzr9_v2Read

Leveraging AI for Automatic Item Generation for Psychological ScalesSemantic proximity Read

Leveraging AI for Automatic Item Generation for Psychological ScalesSemantic proximity Read

Generating Better Items for Cognitive Assessments Using Large Language ModelsSemantic proximity Read

Let the Algorithm Speak: How to Use Neural Networks for Automatic Item Generation in Psychological Scale DevelopmentSemantic proximity Read

Old Test, New Tricks: Using Large Language Models to Generate New Divergent Thinking Test ItemsSemantic proximity Read

Can Generative AI Craft Variable Questions? A Mixed-Method Study on AI’s Capability to Adopt, Adapt, and Create New ScalesSemantic proximity Read

Transformer-Based Deep Neural Language Modeling for Construct-Specific Automatic Item GenerationSemantic proximity Read

ChatGPTest: A Mixed-Methods Study on AI-Generated Questionnaires Based on Theoretical ModelsSemantic proximity Read

Evaluating Large Language Models for Feature Extraction from Verbal Stimuli: A Simulation-Based WorkflowSemantic proximity Read

Estimating Dimensional Structure in Generative Psychometrics: Comparing PCA and Network Methods Using Large Language Model Item EmbeddingsSemantic proximity Read

Using a hybrid of artificial intelligence and template-based method in automatic item generation to create multiple-choice questions in medical education: Hybrid AIGSemantic proximity Read

Are LLMs better expert judges? Rethinking content validity assessment in the age of AISemantic proximity Read