Article

From Output Errors to Workflow Harm: A Practitioner-Audit Method for LLM-Mediated Research

2026-08-17

Abstract excerpt

<h4>Objective</h4> Formal large language model (LLM) evaluations score isolated prompts, but clinicians and health-informatics researchers meet model failures inside multi-step workflows where erroneous output can alter procedures or contaminate documents. We present TRACE (Tracking Reliability of AI-generated Conversational Evidence), a practitioner-audit framework for evaluating the downstream workflow reliabil...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: fe91538f-6ea7-54f3-8e5e-8a768a01e57d
DOI: 10.64898/2026.08.13.26360414

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

From Output Errors to Workflow Harm: A Practitioner-Audit Method for LLM-Mediated ResearchDOI 10.64898/2026.08.13.26360414Read

Clinicians’ Rationale for Editing Ambient AI–Drafted Clinical Notes: Persistent Challenges and Implications for ImprovementSemantic proximity Read

Quality, consistency, and clinical safety of AI-generated versus clinician-written clinical notes: a multi-country paired simulation studySemantic proximity Read

What Do Clinicians Edit in Ambient AI-Drafted Clinical Documentation? A Qualitative Content AnalysisSemantic proximity Read

Can AI Match Human Experts? Evaluating LLM-Generated Feedback on Resident Scholarly ProjectsSemantic proximity Read

Linguistic Effects of Ambient AI on Clinical Documentation: A Matched Pre-Post StudySemantic proximity Read

Structured Clinical Documentation as Upstream Data Engineering: A Systematic Review of Ambient-AI and LLM-Driven Inputs for Predictive Modeling in HealthcareSemantic proximity Read

Responsible Adoption of Generative AI in Health Care Work Systems: A Sociotechnical Document AnalysisSemantic proximity Read

A Novel Playbook for Pragmatic Trial Operations to Monitor and Evaluate Ambient Artificial Intelligence in Clinical PracticeSemantic proximity Read

From Conversation to Chart: An Analysis of Clinician Edits to Ambient AI Draft NotesSemantic proximity Read

Understanding Clinician Edits to Ambient AI Draft Notes: A Feasibility Analysis Using Large Language ModelsSemantic proximity Read

Clinician Experiences with Ambient AI Scribe Technology in Singapore: A Qualitative StudySemantic proximity Read

Utilization of Generative AI-drafted Responses for Managing Patient-Provider CommunicationSemantic proximity Read