Article

Field-testing multiple-choice questions with AI examinees: English grammar items

2024-07-29

Abstract excerpt

<title>Abstract</title> <p> Field-testing is a necessary but resource-intensive step in the development of high-quality educational assessments. I present an innovative method for field-testing newly written exam items by replacing human examinees with artificially intelligent (AI) examinees. The proposed approach is demonstrated using 466 four-option multiple-choice English grammar questions. Pre-trained transf...

Topics

Open a Topic to create a Post that cites this publication.

Uncategorized literature

Identifiers and source

Literature Corpus work: ddde4c5f-212d-5b64-a3aa-bfcb8fe5596c
DOI: 10.21203/rs.3.rs-3858355/v2

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Field-testing multiple-choice questions with AI examinees: English grammar itemsDOI 10.21203/rs.3.rs-3858355/v2Read

Generating Better Items for Cognitive Assessments Using Large Language ModelsSemantic proximity Read

Psychometric Performance and Student Perceptions of AI- versus Human-Generated Multiple-Choice Questions: The AHEAD Randomized Controlled TrialSemantic proximity Read

Looks good on paper: LLM-generated exams are face-valid but psychometrically weaker than human assessmentsSemantic proximity Read

Psychometric Alignment Between Human and Artificial Intelligence Performance in Cardiology Residency In-Service ExaminationsSemantic proximity Read

Predicting Item-Level Characteristics of Knowledge Tests Using Large-Language ModelsSemantic proximity Read

Can Large Language Models Emulate Human Performance on Educational Assessments?Semantic proximity Read

Can Large Language Models Emulate Human Performance on Educational Assessments?Semantic proximity Read

Beyond Human Boundaries: Exploring the Proficiency of AI Technology and its Potential in Psychometric Test ConstructionSemantic proximity Read

Quality assurance and validity of AI-generated Single Best Answer questionsSemantic proximity Read

Optimizing GPT-Based Distractor Generation for the Korean CSAT English ExamSemantic proximity Read

Expert validation of AI-generated clinical assessment items for physician assistant certification: a multi-dimensional rubric and dual- reliability methodSemantic proximity Read

QUEST-AI: A System for Question Generation, Verification, and Refinement using AI for USMLE-Style ExamsSemantic proximity Read