Article

Performance of Open-Source LLMs in Challenging Radiological Cases – A Benchmark Study on 1,933 Eurorad Case Reports

2024-09-06

Abstract excerpt

Recent advancements in large language models (LLMs) have created new ways to support radiological diagnostics. While both open-source and proprietary LLMs can address privacy concerns through local or cloud deployment, open-source models provide advantages in continuity of access, and potentially lower costs. In this study, we evaluated the diagnostic performance of eleven state-of-the-art open-source LLMs using c...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 8284be19-e5e7-541c-9c52-5ebcff41d0b6
DOI: 10.1101/2024.09.04.24313026

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Performance of Open-Source LLMs in Challenging Radiological Cases – A Benchmark Study on 1,933 Eurorad Case ReportsDOI 10.1101/2024.09.04.24313026Read

Diagnostic Performance of Large Language Models and Radiologists in Case-Based Radiology QuestionsSemantic proximity Read

Data Extraction from Oncology Imaging Reports by Large Language Models: A Comparative Accuracy StudySemantic proximity Read

More Harm than Help? Evaluating the Capabilities of Vision-Language Models in Neurological Image AnalysisSemantic proximity Read

Diagnostic Performances of GPT-4o, Claude 3 Opus, and Gemini 1.5 Pro in “Diagnosis Please” CasesSemantic proximity Read

Comparative Analysis of ChatGPT’s Diagnostic Performance with Radiologists Using Real-World Radiology Reports of Brain TumorsSemantic proximity Read

The Expertise Paradox: Who Benefits from LLM-Assisted Brain MRI Differential Diagnosis?Semantic proximity Read

Impact of Multimodal Prompt Elements on Diagnostic Performance of GPT-4(V) in Challenging Brain MRI CasesSemantic proximity Read

Large Language Models in Radiology Reporting—A Systematic Review of Performance, Limitations, and Clinical ImplicationsSemantic proximity Read

Automated ICD-O-3 Coding of Real-World Pathology Reports Using Self-Hosted Large Language ModelsSemantic proximity Read

Assessing AI and Neurologist Diagnostic Reasoning Against Neuropathological Ground TruthSemantic proximity Read

Learning neuroimaging models from health system-scale dataSemantic proximity Read

Prompt Engineering Enables Open-Source LLMs to Match Proprietary Models in Diagnostic Accuracy for Annotation of Radiology ReportsSemantic proximity Read