Article

CLEVER: Clinical Large Language Model Evaluationby Expert Review

2025-07-23

Abstract excerpt

<title>Abstract</title> <p>The proliferation of both general-purpose and healthcare-specific Large Language Models (LLMs) has intensified the challenge of rigorous benchmarking. Existing evaluation methods face critical limitations: data contamination undermines the validity of public benchmarks, self-preference biases LLM-as-a-judge approaches, and current tasks do not fully reflect real-world clinical applicati...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 8d8fe722-89e3-5af2-a4b0-ee653c160c74
DOI: 10.21203/rs.3.rs-6883531/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

CLEVER: Clinical Large Language Model Evaluationby Expert ReviewDOI 10.21203/rs.3.rs-6883531/v1Read

Auditing frontier general-purpose large language models in biomedical tasks: reasoning gains, extraction limits, and benchmark reliabilitySemantic proximity Read

Evaluation of Large Language Model Performance on the Biomedical Language Understanding and Reasoning Benchmark: Comparative StudySemantic proximity Read

Entity-centric evaluation of large language model responses for medical question-answering tasksSemantic proximity Read

MulMed: Addressing Multiple Medical Tasks Utilizing Large Language ModelsSemantic proximity Read

Improving clinical expertise in large language models using electronic medical recordsSemantic proximity Read

Systematic Review of Large Language Models for Patient Care: Current Applications and ChallengesSemantic proximity Read

MedScope: A Lightweight Benchmark of Open-Source Large Language Models for Medical Question AnsweringSemantic proximity Read

Almanac: Retrieval-Augmented Language Models for Clinical MedicineSemantic proximity Read

A Systematic Review of Testing and Evaluation of Healthcare Applications of Large Language Models (LLMs)Semantic proximity Read

MRQC-LLM: A Novel Large Language Model Framework for Enhancing Medical Record Quality ControlSemantic proximity Read

Expert-level validation of AI-generated medical text with scalable language modelsSemantic proximity Read

Generalist Foundation Models Are Not Clinical Enough for Hospital OperationsSemantic proximity Read