Article

A Framework to Assess Clinical Safety and Hallucination Rates of LLMs for Medical Text Summarisation

2024-09-13

Abstract excerpt

Integrating large language models (LLMs) into healthcare settings can improve workflow efficiency and patient care by automating tasks such as summarising consultations. However, ensuring the fidelity between LLM outputs and ground truth information is crucial, as errors can lead to miscommunication between patients and clinicians, resulting in incorrect diagnoses, treatment decisions and compromised patient safet...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 0b8bc6de-cc9d-5f06-924d-bd919ad9a5c5
DOI: 10.1101/2024.09.12.24313556

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

A Framework to Assess Clinical Safety and Hallucination Rates of LLMs for Medical Text SummarisationDOI 10.1101/2024.09.12.24313556Read

Evaluating Large Language Models for Drafting Emergency Department Discharge SummariesSemantic proximity Read

Towards Inpatient Discharge Summary Automation via Large Language Models: A Multidimensional Evaluation with a HIPAA-Compliant Instance of GPT-4o and Clinical Expert AssessmentSemantic proximity Read

Decoding Clinician Authorial Style: A Style-Informed Pipeline for Clinical Document Summary Generation with Large Language ModelsSemantic proximity Read

Measuring the Quality of AI-Generated Clinical Notes: A Systematic Review and Experimental Benchmark of Evaluation MethodsSemantic proximity Read

Rethinking Medical LLM Hallucinations: A System-Level SurveySemantic proximity Read

Accuracy and Safety of an AI Ambient Scribe Compared with Handwritten Clinical NotesSemantic proximity Read

Large Language Model-Powered Administrative AI Agents for Healthcare Documentation Automation: A GPT-4 Framework for Clinical WorkflowsSemantic proximity Read

A Review of Large Language Models in Medical Education, Clinical Decision Support, and Healthcare AdministrationSemantic proximity Read

Automating Evaluation of AI Text Generation in Healthcare with a Large Language Model (LLM)-as-a-JudgeSemantic proximity Read

Benchmarking And Datasets For Ambient Clinical Documentation: A Scoping Review Of Existing Frameworks And Metrics For AI-Assisted Medical Note GenerationSemantic proximity Read

Confidence Is Not Probability: Verification-Based Confidence Prediction for LLM-Generated Clinical SummariesSemantic proximity Read

Physician- and Large Language Model-Generated Hospital Discharge Summaries: A Blinded, Comparative Quality and Safety StudySemantic proximity Read