Article

Automated Evaluation of Large Language Model Response Concordance with Human Specialist Responses on Physician-to-Physician eConsult Cases

2025-08-16

Abstract excerpt

Specialist consults in primary care and inpatient settings typically address complex clinical questions beyond standard guidelines. eConsults have been developed as a way for specialist physicians to review cases asynchronously and provide clinical answers without a formal patient encounter. Meanwhile, large language models (LLMs) have approached human-level performance on structured clinical tasks, but their real...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 942f3bd6-74b2-56b6-862d-62d87a210fc5
DOI: 10.1101/2025.08.14.25332839

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Automated Evaluation of Large Language Model Response Concordance with Human Specialist Responses on Physician-to-Physician eConsult CasesDOI 10.1101/2025.08.14.25332839Read

Physician Evaluations of Large Language Model-Generated Responses to Medical Questions by Region and Years in Practice: A preliminary studySemantic proximity Read

Comparing Human and Large Language Model Responses to Patients’ Online Questions: Towards Multi-dimensional Patient-centered SupportSemantic proximity Read

CLEVER: Clinical Large Language Model Evaluationby Expert ReviewSemantic proximity Read

Evaluating Eight Retrieval-Augmented Generation (RAG) Large Language Models’ Responses to Clinical Questions: A Comparative StudySemantic proximity Read

Systematic Literature Review of LLM-Large Language Model in Medical: Digital Health, Technology and ApplicationsSemantic proximity Read

Systematic Review of Large Language Models for Patient Care: Current Applications and ChallengesSemantic proximity Read

MRQC-LLM: A Novel Large Language Model Framework for Enhancing Medical Record Quality ControlSemantic proximity Read

Entity-centric evaluation of large language model responses for medical question-answering tasksSemantic proximity Read

High Consistency, Limited Accuracy: Evaluating Large Language Models for Binary Medical DiagnosisSemantic proximity Read

Enhancing Doctor-Patient Communication Using Large Language Models for Pathology Report InterpretationSemantic proximity Read

Expert-level validation of AI-generated medical text with scalable language modelsSemantic proximity Read

Automating Evaluation of AI Text Generation in Healthcare with a Large Language Model (LLM)-as-a-JudgeSemantic proximity Read