Article

Comparative Analysis of GPT-4Vision, GPT-4 and Open Source LLMs in Clinical Diagnostic Accuracy: A Benchmark Against Human Expertise

2023-11-05

Abstract excerpt

<h4>Importance</h4> Medicine is poised for transformation with artificial general intelligence becoming integral to almost all clinical environments. Currently, the performance of multimodal AI, specifically one powered by GPT-4, in real clinical cases remains uncharted. <h4>Objective</h4> To ascertain whether GPT-4V can consistently comprehend complex diagnostic scenarios through both imagery and textual data....

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 6bb3d635-69f7-5880-83f7-f906977412e3
DOI: 10.1101/2023.11.03.23297957

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Comparative Analysis of GPT-4Vision, GPT-4 and Open Source LLMs in Clinical Diagnostic Accuracy: A Benchmark Against Human ExpertiseDOI 10.1101/2023.11.03.23297957Read

GPT-4V(ision) Unsuitable for Clinical Care and Education: A Clinician-Evaluated AssessmentSemantic proximity Read

Impact of Multimodal Prompt Elements on Diagnostic Performance of GPT-4(V) in Challenging Brain MRI CasesSemantic proximity Read

Comparative Analysis of Multimodal Large Language Models GPT-4o and o1 vs Clinicians in Clinical Case Challenge QuestionsSemantic proximity Read

Assessing GPT-4 Multimodal Performance in Radiological Image AnalysisSemantic proximity Read

Performance of Multimodal GPT-4V on USMLE with Image: Potential for Imaging Diagnostic Support with ExplanationsSemantic proximity Read

A Multimodal Vision-text AI Copilot for Brain Disease Diagnosis and Medical ImagingSemantic proximity Read

Evaluating the Multimodal Capabilities of Generative AI in Complex Clinical DiagnosticsSemantic proximity Read

Development of a RAG-based Expert LLM for Clinical Support in Radiation OncologySemantic proximity Read

Diagnostic Performance of Large Language Models and Radiologists in Case-Based Radiology QuestionsSemantic proximity Read

AI Performance on Image-based Medical Case Scenarios: A Cross-Sectional Comparative StudySemantic proximity Read

Prompt Engineering Strategies Improve the Diagnostic Accuracy of GPT-4 Turbo in Neuroradiology CasesSemantic proximity Read

Performance of Advanced Large Language Models (GPT-4o, GPT-4, Gemini 1.5 Pro, Claude 3 Opus) on Japanese Medical Licensing Examination: A Comparative StudySemantic proximity Read