Article

Multimodal Large Language Model Passes Specialty Board Examination and Surpasses Human Test-Taker Scores: A Comparative Analysis Examining the Stepwise Impact of Model Prompting Strategies on Performance

2024-07-29

Abstract excerpt

<h4>ABSTRACT</h4> <h4>Background</h4> Large language models (LLMs) have shown promise in answering medical licensing examination-style questions. However, there is limited research on the performance of multimodal LLMs on subspecialty medical examinations. Our study benchmarks the performance of multimodal LLM’s enhanced by model prompting strategies on gastroenterology subspeciality examination-style questions an...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: e7afa353-2daf-531c-a9a5-2d37992a13d7
DOI: 10.1101/2024.07.27.24310809

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Multimodal Large Language Model Passes Specialty Board Examination and Surpasses Human Test-Taker Scores: A Comparative Analysis Examining the Stepwise Impact of Model Prompting Strategies on PerformanceDOI 10.1101/2024.07.27.24310809Read

General purpose large language models match human performance on gastroenterology board exam self-assessmentsSemantic proximity Read

Performance of Advanced Large Language Models (GPT-4o, GPT-4, Gemini 1.5 Pro, Claude 3 Opus) on Japanese Medical Licensing Examination: A Comparative StudySemantic proximity Read

Retrieval-Augmented Claude Opus 4.7 and GPT-5.5 Surpass Human Performance on the Nuclear Cardiology Board Preparation Exam (and Claude Drafts a Paper About it)Semantic proximity Read

Cardiology Knowledge Assessment of Retrieval-Augmented Open versus Proprietary Large Language ModelsSemantic proximity Read

Evaluating the Performance of Large Language Models on a Neurology Board-Style ExaminationSemantic proximity Read

Comparison of Large Language Models’ Performance on Neurosurgical Board Examination QuestionsSemantic proximity Read

Retrieval‑Augmented Clinical Question‑Answering System for Bariatric Surgery Built on the ASMBS Textbook: From Good to GreatSemantic proximity Read

Large language models for generating medical examinations: systematic reviewSemantic proximity Read

Board-Level Performance of Leading Open-Weight Vision-Language Models on the Japanese Diagnostic Radiology Board Examination: Reasoning, Image-Input, and Language EffectsSemantic proximity Read

Comparative Performance of General-Purpose Large Language Models and a Specialized Clinical AI Tool on OKAP-Style Ophthalmology QuestionsSemantic proximity Read

Textbook-Level Medical Knowledge in Large Language Models: A Comparative Evaluation Using the Japanese National Medical ExaminationSemantic proximity Read