Article

Large Language Models Are Poor Clinical Decision-Makers: A Comprehensive Benchmark

2024-04-25

Abstract excerpt

The adoption of large language models (LLMs) to assist clinicians has attracted remarkable attention. Existing works mainly adopt the closeended question-answering (QA) task with answer options for evaluation. However, many clinical decisions involve answering open-ended questions without pre-set options. To better understand LLMs in the clinic, we construct a benchmark ClinicBench . We first collect eleven exist...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 24f394de-f4a5-5442-abc4-59672db9d94f
DOI: 10.1101/2024.04.24.24306315

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Large Language Models Are Poor Clinical Decision-Makers: A Comprehensive BenchmarkDOI 10.1101/2024.04.24.24306315Read

Revolutionizing Disease Diagnosis with Large Language Models: A Systematic ReviewSemantic proximity Read

Almanac: Retrieval-Augmented Language Models for Clinical MedicineSemantic proximity Read

Evaluating approaches of training a generative large language model for multi-label classification of unstructured electronic health recordsSemantic proximity Read

Evaluating a Large Reasoning Model’s Performance on Open-Ended Medical ScenariosSemantic proximity Read

CLEVER: Clinical Large Language Model Evaluationby Expert ReviewSemantic proximity Read

Rx-LLM: a benchmarking suite to evaluate safe large language model performance for medication-related tasksSemantic proximity Read

Me-LLaMA: Medical Foundation Large Language Models for Comprehensive Text Analysis and BeyondSemantic proximity Read

Me-LLaMA: Foundation Large Language Models for Medical ApplicationsSemantic proximity Read

MulMed: Addressing Multiple Medical Tasks Utilizing Large Language ModelsSemantic proximity Read

Medical Large Language Models: Methods and ApplicationsSemantic proximity Read

CARDBiomedBench: A Benchmark for Evaluating Large Language Model Performance in Biomedical ResearchSemantic proximity Read

Evaluating Large Language Models on Medical Evidence SummarizationSemantic proximity Read