Article

Evaluating the Performance of ChatGPT-4o Vision Capabilities on Image-Based USMLE Step 1, Step 2, and Step 3 Examination Questions

2024-06-19

Abstract excerpt

<h4>ABSTRACT</h4> <h4>Introduction</h4> Artificial intelligence (AI) has significant potential in medicine, especially in diagnostics and education. ChatGPT has achieved levels comparable to medical students on text-based USMLE questions, yet there’s a gap in its evaluation on image-based questions. <h4>Methods</h4> This study evaluated ChatGPT-4’s performance on image-based questions from USMLE Step 1, Step 2, an...

Topics

Open a Topic to create a Post that cites this publication.

Genomics and Rare Diseases

Identifiers and source

Literature Corpus work: 391bbfe5-aebc-5cbe-b032-e17055909209
DOI: 10.1101/2024.06.18.24309092

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Evaluating the Performance of ChatGPT-4o Vision Capabilities on Image-Based USMLE Step 1, Step 2, and Step 3 Examination QuestionsDOI 10.1101/2024.06.18.24309092Read

Evaluating Chat GPT-4o’s Comparative Performance Over GPT-4 in Japanese Medical Licensing Examination and Its Clinical Partnership PotentialSemantic proximity Read

Performance of Multimodal GPT-4V on USMLE with Image: Potential for Imaging Diagnostic Support with ExplanationsSemantic proximity Read

Can ChatGPT Pass the 2023 Japanese National Medical Licensing Examination?Semantic proximity Read

Evaluating the Performance of ChatGPT in Ophthalmology: An Analysis of its Successes and ShortcomingsSemantic proximity Read

Evaluating GPT-4-based ChatGPT’s Clinical Potential on the NEJM QuizSemantic proximity Read

ChatGPT takes the FCPS exam in Internal MedicineSemantic proximity Read

Performance of Advanced Large Language Models (GPT-4o, GPT-4, Gemini 1.5 Pro, Claude 3 Opus) on Japanese Medical Licensing Examination: A Comparative StudySemantic proximity Read

Performance of ChatGPT on Clinical Medicine Entrance Examination for Chinese Postgraduate in ChineseSemantic proximity Read

Comparative Performance of Large Language Model-Based Chatbots, Dental Students, and Postgraduate Specialty Students in Text-Based Oral and Maxillofacial Radiology QuestionsSemantic proximity Read

ChatGPT Goes to The Radiology Department: A Pictorial ReviewSemantic proximity Read

Human versus Artificial Intelligence: ChatGPT-4 Outperforming Bing, Bard, ChatGPT-3.5, and Humans in Clinical Chemistry Multiple-Choice QuestionsSemantic proximity Read

ChatGPT versus human in generating medical graduate exam questions – An international prospective studySemantic proximity Read