Article

Performance of GPT-4 on the American College of Radiology In-Service Examination

2024-02-20

Abstract excerpt

<h4>ABSTRACT</h4> <h4>Objectives</h4> No study has evaluated the ability of ChatGPT-4 to answer image-rich diagnostic radiology board exam questions or assessed for model drift in GPT-4’s image interpretation abilities. In our study we evaluate GPT-4’s performance on the American College of Radiology (ACR) 2022 Diagnostic Radiology In-Training Examination (DXIT). <h4>Methods</h4> Questions were sequentially inp...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 0275347c-ebf1-5f90-88ee-863423687ad3
DOI: 10.1101/2024.02.15.580546

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Performance of GPT-4 on the American College of Radiology In-Service ExaminationDOI 10.1101/2024.02.15.580546Read

General purpose large language models match human performance on gastroenterology board exam self-assessmentsSemantic proximity Read

Performance of ChatGPT and Bard in Self-Assessment Questions for Nephrology Board RenewalSemantic proximity Read

Performance of Advanced Large Language Models (GPT-4o, GPT-4, Gemini 1.5 Pro, Claude 3 Opus) on Japanese Medical Licensing Examination: A Comparative StudySemantic proximity Read

Board-Level Performance of Leading Open-Weight Vision-Language Models on the Japanese Diagnostic Radiology Board Examination: Reasoning, Image-Input, and Language EffectsSemantic proximity Read

Multimodal Large Language Model Passes Specialty Board Examination and Surpasses Human Test-Taker Scores: A Comparative Analysis Examining the Stepwise Impact of Model Prompting Strategies on PerformanceSemantic proximity Read

Assessing the Performance of Plugin-Integrated ChatGPT-4 in the German Medical Board Examination: An Experimental Study on the Advancements and Limitations of Modern AI Modelling ApproachesSemantic proximity Read

Performance of Multimodal GPT-4V on USMLE with Image: Potential for Imaging Diagnostic Support with ExplanationsSemantic proximity Read

Performance of o1 pro and GPT-4 in self-assessment questions for nephrology board renewalSemantic proximity Read

Comparative Analysis of Multimodal Large Language Models GPT-4o and o1 vs Clinicians in Clinical Case Challenge QuestionsSemantic proximity Read

Evaluating GPT-4-based ChatGPT’s Clinical Potential on the NEJM QuizSemantic proximity Read

Retrieval-Augmented Claude Opus 4.7 and GPT-5.5 Surpass Human Performance on the Nuclear Cardiology Board Preparation Exam (and Claude Drafts a Paper About it)Semantic proximity Read

Prompt Engineering Strategies Improve the Diagnostic Accuracy of GPT-4 Turbo in Neuroradiology CasesSemantic proximity Read