Article

Evaluating General Vision-Language Models for Clinical Medicine

2024-04-14

Abstract excerpt

Recently emerging large multimodal models (LMMs) utilize various types of data modalities, including text and visual inputs to generate outputs. The incorporation of LMMs into clinical medicine presents unique challenges, including accuracy, reliability, and clinical relevance. Here, we explore clinical applications of GPT-4V, an LMM that has been proposed for use in medicine, in gastroenterology, radiology, derma...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: be587f8e-ffc6-56a6-9ce2-b91c0783922d
DOI: 10.1101/2024.04.12.24305744

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Evaluating General Vision-Language Models for Clinical MedicineDOI 10.1101/2024.04.12.24305744Read

Comparative Analysis of Multimodal Large Language Models GPT-4o and o1 vs Clinicians in Clinical Case Challenge QuestionsSemantic proximity Read

Evaluating the performance of large language & visual-language models in cervical cytology screeningSemantic proximity Read

Comparative Analysis of GPT-4Vision, GPT-4 and Open Source LLMs in Clinical Diagnostic Accuracy: A Benchmark Against Human ExpertiseSemantic proximity Read

Performance of GPT-4V(ision) in Ophthalmology: Use of Images in Clinical QuestionsSemantic proximity Read

An Adaptive Foundation Model with Evidence-based Clinical Reasoning for GastroenterologySemantic proximity Read

Performance of Multimodal GPT-4V on USMLE with Image: Potential for Imaging Diagnostic Support with ExplanationsSemantic proximity Read

Multimodal Large Language Models are Generalist Medical Image InterpretersSemantic proximity Read

Evaluating Conversational Image Segmentation for Medicine: Performance, Failure Modes, and a Fairness Audit Across Seven ModalitiesSemantic proximity Read

Benchmark Evaluation of Multi-Modal Large Language Models for Ophthalmic DiagnosisSemantic proximity Read

GPT-4V(ision) Unsuitable for Clinical Care and Education: A Clinician-Evaluated AssessmentSemantic proximity Read

Assessing GPT-4’s Diagnostic Accuracy with Darker Skin Tones: Underperformance and ImplicationsSemantic proximity Read

A Retrospective Analysis of a Dermatology-Trained Multimodal Large Language Model's Diagnostic Accuracy in Pigmented Skin LesionsSemantic proximity Read