Article

Medical errors in large language models revealed using 1,000 synthetic clinical transcripts

2026-03-25

Abstract excerpt

<h4>ABSTRACT</h4> Current clinical evaluations of large language models (LLMs) rely on datasets which fail to reflect real-world medical complexity. We developed a high-throughput simulation of patients presenting with headache and generated 1,000 doctor-patient transcripts, enabling an unprecedented mapping of clinical reasoning failures across a vast spectrum of demographic and clinical phenotypes. While GPT-5....

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: f33d50c5-67fe-500d-96b7-2cc4c099104f
DOI: 10.64898/2026.03.23.26349082

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Medical errors in large language models revealed using 1,000 synthetic clinical transcriptsDOI 10.64898/2026.03.23.26349082Read

The Inefficacy of Artificial Intelligence Large Language Models in Healthcare: A Clinical and Statistical PerspectiveSemantic proximity Read

Evaluating the AI Potential as a Safety Net for Diagnosis: A Novel Benchmark of Large Language Models in Correcting Diagnostic ErrorsSemantic proximity Read

The Inefficacy of Artificial Intelligence Large Language Models in Healthcare: A Clinical and Statistical PerspectiveSemantic proximity Read

Large Language Models Are Highly Vulnerable to Adversarial Hallucination Attacks in Clinical Decision Support: A Multi-Model Assurance AnalysisSemantic proximity Read

Zero-shot Interpretable Phenotyping of Postpartum Hemorrhage Using Large Language ModelsSemantic proximity Read

Understanding the Inner Workings of Large Language Models in MedicineSemantic proximity Read

Language-dependent diagnostic safety of medical AI systems: a cross-lingual benchmarking and prospective clinical studySemantic proximity Read

An interdisciplinary, randomized, single-blind evaluation of state-of-the-art large language models for their implications and risks in medical diagnosis and managementSemantic proximity Read

Rethinking Medical LLM Hallucinations: A System-Level SurveySemantic proximity Read

Evaluation of ChatGPT-5 Responses in Obstetric and Gynecological Emergencies: Concordance, Readability, and Clinical ReliabilitySemantic proximity Read

Understanding the Inner Workings of Large Language Models in MedicineSemantic proximity Read

Understanding the Inner Workings of Large Language Models in MedicineSemantic proximity Read