Article

Generating Testlets to Measure Clinical Reasoning Skills in Medicine

2025-03-25

Abstract excerpt

<p>Clinical reasoning is a core competency required by all medical professionals. A testlet is group of two or more items based on the same clinical scenario. A testlet can be used to measure clinical reasoning skills because each scenario is evaluated with two or more items. Unfortunately, testlets are challenging and time consuming to create. The purpose of our study is to address the item writing challenge by d...

Topics

Open a Topic to create a Post that cites this publication.

Genomics and Rare Diseases

Identifiers and source

Literature Corpus work: 26486062-853d-5f4b-9f0e-a78d4db335ae
DOI: 10.31234/osf.io/2dmj3_v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Generating Testlets to Measure Clinical Reasoning Skills in MedicineDOI 10.31234/osf.io/2dmj3_v1Read

Using a hybrid of artificial intelligence and template-based method in automatic item generation to create multiple-choice questions in medical education: Hybrid AIGSemantic proximity Read

GPT-4 versus human authors in clinically complex MCQ creation: a blinded analysis of item qualitySemantic proximity Read

Automated Item Generation: – Impact of item variants on performance and standard settingSemantic proximity Read

Expert validation of AI-generated clinical assessment items for physician assistant certification: a multi-dimensional rubric and dual- reliability methodSemantic proximity Read

Utilizing Artificial Intelligence for Crafting Medical Examinations: A Medical Education Study with GPT-4Semantic proximity Read

GPT-5 versus Senior Anesthesiology-Intensive Care Residents on Sequential Clinical Cases: A Pilot Study of Documented Clinical ReasoningSemantic proximity Read

Looks good on paper: LLM-generated exams are face-valid but psychometrically weaker than human assessmentsSemantic proximity Read

Ten Tips for AI‑Assisted Key Feature Problems: A Validity‑Informed Guide for Medical EducationSemantic proximity Read

RAGCare-QA: A Benchmark Dataset for Evaluating Retrieval-Augmented Generation Pipelines in Theoretical Medical KnowledgeSemantic proximity Read

Psychometric Performance and Student Perceptions of AI- versus Human-Generated Multiple-Choice Questions: The AHEAD Randomized Controlled TrialSemantic proximity Read

Evaluating the Efficacy of ChatGPT in Generating Assessment and Plans for Medical Notes in UrologySemantic proximity Read

Generative AI-Assisted Construction of a PBL Case Library for Acute and Critical Care in the Emergency Department and Its Evaluation in Clinical TeachingSemantic proximity Read