Article

Evaluating Methods for Assessing LLM-Translated Clinical Discharge Instructions: A Comparison of Automated Metrics, MQM-Based Evaluation, and Clinician Review

2026-08-22

Abstract excerpt

<title>Abstract</title> <p>Background Large language models (LLMs) have emerged as promising tools for translating patient-facing clinical communication, yet robust methods for evaluating translation quality remain lacking. Existing evaluation approaches, including automated metrics, structured quality frameworks, and clinician review, capture different aspects of translation quality, but their agreement and com...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: f34d3fb4-bd84-5b3d-987f-63e50ba4b0e9
DOI: 10.21203/rs.3.rs-10631294/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Evaluating Methods for Assessing LLM-Translated Clinical Discharge Instructions: A Comparison of Automated Metrics, MQM-Based Evaluation, and Clinician ReviewDOI 10.21203/rs.3.rs-10631294/v1Read

Systematic Literature Review of LLM-Large Language Model in Medical: Digital Health, Technology and ApplicationsSemantic proximity Read

Expert-level validation of AI-generated medical text with scalable language modelsSemantic proximity Read

A Systematic Review of Testing and Evaluation of Healthcare Applications of Large Language Models (LLMs)Semantic proximity Read

Clinician-Centered Evaluation of Large Language Model-Generated Discharge Summaries for Longer Hospitalizations: Insights from Hospitalists and Primary Care PhysiciansSemantic proximity Read

Clinical Safety of Large Language Models in Oral Cancer–Related Patient Communication: A Longitudinal StudySemantic proximity Read

Research through Evaluation for Large Language Model in Patient-Clinician CommunicationsSemantic proximity Read

Physician- and Large Language Model-Generated Hospital Discharge Summaries: A Blinded, Comparative Quality and Safety StudySemantic proximity Read

Retrieval Augmented Generation for 10 Large Language Models and its Generalizability in Assessing Medical FitnessSemantic proximity Read

Automated Evaluation of Large Language Model Response Concordance with Human Specialist Responses on Physician-to-Physician eConsult CasesSemantic proximity Read

HumanELY: Human evaluation of LLM yield, using a novel web-based evaluation toolSemantic proximity Read

The TRIPOD-LLM Statement: A Targeted Guideline For Reporting Large Language Models UseSemantic proximity Read

Large Language Models in Clinical Neurology: A Systematic ReviewSemantic proximity Read