Article

Generating Better Items for Cognitive Assessments Using Large Language Models

2023-06-09

Abstract excerpt

<p>Writing high-quality test questions (items) is critical to building educational measures but has traditionally also been a time-consuming process. One promising avenue for alleviating this is automated item generation, whereby methods from artificial intelligence (AI) are used to generate new items with minimal human intervention. Researchers have explored using large language models (LLMs) to generate new item...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 70911d32-88c7-5c31-8874-1964b7909d07
DOI: 10.31234/osf.io/rqa9m

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Generating Better Items for Cognitive Assessments Using Large Language ModelsDOI 10.31234/osf.io/rqa9mRead

Leveraging AI for Automatic Item Generation for Psychological ScalesSemantic proximity Read

Can Large Language Models Emulate Human Performance on Educational Assessments?Semantic proximity Read

Field-testing multiple-choice questions with AI examinees: English grammar itemsSemantic proximity Read

Looks good on paper: LLM-generated exams are face-valid but psychometrically weaker than human assessmentsSemantic proximity Read

Transformer-Based Deep Neural Language Modeling for Construct-Specific Automatic Item GenerationSemantic proximity Read

Predicting Item-Level Characteristics of Knowledge Tests Using Large-Language ModelsSemantic proximity Read

Old Test, New Tricks: Using Large Language Models to Generate New Divergent Thinking Test ItemsSemantic proximity Read

GPT-4 versus human authors in clinically complex MCQ creation: a blinded analysis of item qualitySemantic proximity Read

Let the Algorithm Speak: How to Use Neural Networks for Automatic Item Generation in Psychological Scale DevelopmentSemantic proximity Read