Article

Cardiology Knowledge Assessment of Retrieval-Augmented Open versus Proprietary Large Language Models

2025-09-12

Abstract excerpt

<h4>Objectives</h4> To evaluate the performance of open and proprietary LLMs, with and without Retrieval-Augmented Generation (RAG), on cardiology board-style questions and benchmark them against the human average. <h4>Materials and Methods</h4> We tested 14 LLMs (6 open-weight, 8 proprietary) on 449 multiple-choice questions from the American College of Cardiology Self-Assessment Program (ACCSAP). Accuracy was...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 225d3f3b-16c7-5ee0-9eaa-07e44701c87d
DOI: 10.1101/2025.09.11.25335607

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Cardiology Knowledge Assessment of Retrieval-Augmented Open versus Proprietary Large Language ModelsDOI 10.1101/2025.09.11.25335607Read

Retrieval-Augmented Claude Opus 4.7 and GPT-5.5 Surpass Human Performance on the Nuclear Cardiology Board Preparation Exam (and Claude Drafts a Paper About it)Semantic proximity Read

GlaucoRAG: A Retrieval-Augmented Large Language Model for Expert-Level Glaucoma AssessmentSemantic proximity Read

Retrieval‑Augmented Clinical Question‑Answering System for Bariatric Surgery Built on the ASMBS Textbook: From Good to GreatSemantic proximity Read

Retrieval Augmented Generation for 10 Large Language Models and its Generalizability in Assessing Medical FitnessSemantic proximity Read

RAGCare-QA: A Benchmark Dataset for Evaluating Retrieval-Augmented Generation Pipelines in Theoretical Medical KnowledgeSemantic proximity Read

Evaluating Eight Retrieval-Augmented Generation (RAG) Large Language Models’ Responses to Clinical Questions: A Comparative StudySemantic proximity Read

Multimodal Large Language Model Passes Specialty Board Examination and Surpasses Human Test-Taker Scores: A Comparative Analysis Examining the Stepwise Impact of Model Prompting Strategies on PerformanceSemantic proximity Read

Psychometric Alignment Between Human and Artificial Intelligence Performance in Cardiology Residency In-Service ExaminationsSemantic proximity Read

Performance of Advanced Large Language Models (GPT-4o, GPT-4, Gemini 1.5 Pro, Claude 3 Opus) on Japanese Medical Licensing Examination: A Comparative StudySemantic proximity Read

Benchmarking the Confidence of Large Language Models in Clinical QuestionsSemantic proximity Read

High Consistency, Limited Accuracy: Evaluating Large Language Models for Binary Medical DiagnosisSemantic proximity Read

Open-source DeepSeek-R1 Outperforms Proprietary Non-Reasoning Large Language Models With and Without Retrieval-Augmented GenerationSemantic proximity Read