Article

CARDBiomedBench: A Benchmark for Evaluating Large Language Model Performance in Biomedical Research

2025-01-19

Abstract excerpt

<h4>Backgrounds</h4> Biomedical research requires sophisticated understanding and reasoning across multiple specializations. While large language models (LLMs) show promise in scientific applications, their capability to safely and accurately support complex biomedical research remains uncertain. <h4>Methods</h4> We present CARDBiomedBench , a novel question-and-answer benchmark for evaluating LLMs in biomedica...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 0178bdb8-46cf-5431-b81a-269965e7a9b0
DOI: 10.1101/2025.01.15.633272

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

CARDBiomedBench: A Benchmark for Evaluating Large Language Model Performance in Biomedical ResearchDOI 10.1101/2025.01.15.633272Read

MARRVEL-MCP: A Context-Engineered Natural-Language Query-to-Response Interface for Mendelian Disease DiscoverySemantic proximity Read

Queryome: Orchestrating Retrieval, Reasoning, and Synthesis across Biomedical LiteratureSemantic proximity Read

Evaluating a Large Reasoning Model’s Performance on Open-Ended Medical ScenariosSemantic proximity Read

An Empirical Analysis of Fine-Tuning Large Language Models on Bioinformatics Literature: PRSGPT and BioStarsGPTSemantic proximity Read

CLEVER: Clinical Large Language Model Evaluationby Expert ReviewSemantic proximity Read

Performance Characteristics of Reasoning Large Language Models for Evidence Extraction from Clinical Genomics LiteratureSemantic proximity Read

Large Language Models Facilitate the Generation of Electronic Health Record Phenotyping AlgorithmsSemantic proximity Read

Revolutionizing Disease Diagnosis with Large Language Models: A Systematic ReviewSemantic proximity Read

Entity-centric evaluation of large language model responses for medical question-answering tasksSemantic proximity Read

Evaluation of Large Language Model Performance on the Biomedical Language Understanding and Reasoning Benchmark: Comparative StudySemantic proximity Read

Out-of-the-box bioinformatics capabilities of large language models (LLMs)Semantic proximity Read

Auditing frontier general-purpose large language models in biomedical tasks: reasoning gains, extraction limits, and benchmark reliabilitySemantic proximity Read