Article

GPT-4 versus human authors in clinically complex MCQ creation: a blinded analysis of item quality

2024-08-21

Abstract excerpt

<title>Abstract</title> <p>MCQs are a popular assessment format in medical education. Creating clinically complex MCQs can be a time-consuming task for subject matter experts. Large language models such as GPT-4, a type of generative artificial intelligence (AI), are a potential tool for MCQ design. Clinically complex human-generated MCQs, at both novice and expert level, were compared with AI MCQs. A generic pro...

Topics

Open a Topic to create a Post that cites this publication.

Genomics and Rare Diseases

Identifiers and source

Literature Corpus work: 4db24a04-26e6-5d8f-8eaa-8b147638604d
DOI: 10.21203/rs.3.rs-4831476/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

GPT-4 versus human authors in clinically complex MCQ creation: a blinded analysis of item qualityDOI 10.21203/rs.3.rs-4831476/v1Read

Expert validation of AI-generated clinical assessment items for physician assistant certification: a multi-dimensional rubric and dual- reliability methodSemantic proximity Read

Psychometric Performance and Student Perceptions of AI- versus Human-Generated Multiple-Choice Questions: The AHEAD Randomized Controlled TrialSemantic proximity Read

Quality assurance and validity of AI-generated Single Best Answer questionsSemantic proximity Read

Using a hybrid of artificial intelligence and template-based method in automatic item generation to create multiple-choice questions in medical education: Hybrid AIGSemantic proximity Read

Ten Tips for AI‑Assisted Key Feature Problems: A Validity‑Informed Guide for Medical EducationSemantic proximity Read

Characterizing large language model generative artificial intelligence variability in the production of objective structured clinical examination stationsSemantic proximity Read

Utilizing Artificial Intelligence for Crafting Medical Examinations: A Medical Education Study with GPT-4Semantic proximity Read

Generating Testlets to Measure Clinical Reasoning Skills in MedicineSemantic proximity Read

ChatGPT versus human in generating medical graduate exam questions – An international prospective studySemantic proximity Read

Psychometric Alignment Between Human and Artificial Intelligence Performance in Cardiology Residency In-Service ExaminationsSemantic proximity Read

Comparative Evaluation of Large Language Models for Medical Education: Performance Analysis in Urinary System Histology.Semantic proximity Read

ACCORD-AI: an exploratory evaluation of large language models for drafting consensus voting itemsSemantic proximity Read