Article

Reproducible Generative AI Evaluation for Healthcare: A Clinician-in-the-Loop Approach

2025-03-07

Abstract excerpt

<h4>ABSTRACT</h4> <h4>Objective</h4> To develop and apply a reproducible methodology for evaluating generative artificial intelligence powered systems in healthcare, addressing the gap between theoretical evaluation frameworks and practical implementation guidance. <h4>Materials and Methods</h4> A five dimension evaluation framework was developed to assess query comprehension and response helpfulness, correctness,...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: b5b20136-5b89-53e5-9b03-480e2e8d0772
DOI: 10.1101/2025.03.04.25323131

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Reproducible Generative AI Evaluation for Healthcare: A Clinician-in-the-Loop ApproachDOI 10.1101/2025.03.04.25323131Read

Clinician Perceptions of Generative Artificial Intelligence Tools and Clinical Workflows: Potential Uses, Motivations for Adoption, and Sentiments on ImpactSemantic proximity Read

Development of research ethics guidelines for healthcare generative artificial intelligence: deriving expert consensus through a Delphi studySemantic proximity Read

Bridging AI and Healthcare: A Scoping Review of Retrieval-Augmented Generation—Ethics, Bias, Transparency, Improvements, and ApplicationsSemantic proximity Read

Healthcare Providers' Perspectives on Generative Artificial Intelligence (GenAI) Adoption, Adaptation, Assimilation, and Use in the United StatesSemantic proximity Read

AI-Generated Responses to Patient's Messages: Effectiveness, Feasibility and ImplementationSemantic proximity Read

Proposed Context-of-Use Evaluation Framework for Medication Management Tasks Completed by Generative Artificial IntelligenceSemantic proximity Read

Clinical Usability of Generative Artificial Intelligence for MR Safety AdviceSemantic proximity Read

Generative AI-powered simulated patients in medical and healthcare education: A scoping review and meta analysisSemantic proximity Read

Evidence Synthesis of the Ethical and Legal Challenges of Generative Artificial Intelligence in the Provision of Patient Health InformationSemantic proximity Read

Human Evaluators vs. LLM-as-a-Judge: Toward Scalable, Real-Time Evaluation of GenAI in Global HealthSemantic proximity Read

Evaluating the Ethical and Clinical Implications of Generative AI in Patient-Centric Medical ApplicationsSemantic proximity Read

Protocol For Human Evaluation of Artificial Intelligence Chatbots in Clinical ConsultationsSemantic proximity Read