Article

Expert validation of AI-generated clinical assessment items for physician assistant certification: a multi-dimensional rubric and dual- reliability method

2026-08-14

Abstract excerpt

<title>Abstract</title> <p>Creating high-quality clinical questions for certification exam preparation takes substantial expert time and does not scale to meet learner demand. Generative AI could produce such content at scale, but in high-stakes certification contexts AI-generated content must be checked against the same quality standard as expert-written material, and no established method exists for validating...

Topics

Open a Topic to create a Post that cites this publication.

Uncategorized literature

Identifiers and source

Literature Corpus work: 0b84c7a9-b5d4-5c56-874b-654a48e777e6
DOI: 10.21203/rs.3.rs-10475937/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Expert validation of AI-generated clinical assessment items for physician assistant certification: a multi-dimensional rubric and dual- reliability methodDOI 10.21203/rs.3.rs-10475937/v1Read

GPT-4 versus human authors in clinically complex MCQ creation: a blinded analysis of item qualitySemantic proximity Read

Psychometric Performance and Student Perceptions of AI- versus Human-Generated Multiple-Choice Questions: The AHEAD Randomized Controlled TrialSemantic proximity Read

Looks good on paper: LLM-generated exams are face-valid but psychometrically weaker than human assessmentsSemantic proximity Read

Ten Tips for AI‑Assisted Key Feature Problems: A Validity‑Informed Guide for Medical EducationSemantic proximity Read

Using a hybrid of artificial intelligence and template-based method in automatic item generation to create multiple-choice questions in medical education: Hybrid AIGSemantic proximity Read

Quality assurance and validity of AI-generated Single Best Answer questionsSemantic proximity Read

Evaluation of AI-Generated Multiple-Choice Questions for Periodontology Exams: A Quality Assessment StudySemantic proximity Read

Psychometric Alignment Between Human and Artificial Intelligence Performance in Cardiology Residency In-Service ExaminationsSemantic proximity Read

QUEST-AI: A System for Question Generation, Verification, and Refinement using AI for USMLE-Style ExamsSemantic proximity Read

A Performance-Based Rubric for Generative AI Use in Medical Students’ Research Tasks: Development and Initial Psychometric EvaluationSemantic proximity Read

GPT-5 versus Senior Anesthesiology-Intensive Care Residents on Sequential Clinical Cases: A Pilot Study of Documented Clinical ReasoningSemantic proximity Read

Generating Testlets to Measure Clinical Reasoning Skills in MedicineSemantic proximity Read