Article

Leveraging simulation to provide a practical framework for assessing the novel scope of risk of LLMs in healthcare

2025-11-13

Abstract excerpt

<h4>Structured Abstract</h4> <h4>Background</h4> Large language models (LLMs) are rapidly entering clinical care, yet their definitionally probabilistic outputs have delivered a variety of grossly unsafe responses to users. The difficulty in quantifying and mitigating the novel risks posed by LLMs threatens to stall the regulatory evaluation and clinical deployment of LLM-based software as a medical device (LLM-...

Topics

Open a Topic to create a Post that cites this publication.

Genomics and Rare Diseases

Identifiers and source

Literature Corpus work: 6f5baf34-291c-577f-9be7-001756cea169
DOI: 10.1101/2025.11.10.25339903

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Leveraging simulation to provide a practical framework for assessing the novel scope of risk of LLMs in healthcareDOI 10.1101/2025.11.10.25339903Read

Conversational trajectory degrades large language model detection of suicidal ideation relative to clinicians: a preregistered studySemantic proximity Read

Suicide- and crisis-risk detection using large language models in mental-health chatbotsSemantic proximity Read

mpathic Psychologist-led AI Clinical Tests Suicide Benchmark (mPACT-S-v1.0)Semantic proximity Read

Safety Mechanisms and Risk Mitigation in Generative AI Mental Health Chatbots: A Systematic Scoping ReviewSemantic proximity Read

Rethinking Medical LLM Hallucinations: A System-Level SurveySemantic proximity Read

Evaluation of large language model chatbot responses to psychotic promptsSemantic proximity Read

Risk Governance for Generative AI Mental Health Support: A Multi-Turn Safety ArchitectureSemantic proximity Read

Large Language Models Are Highly Vulnerable to Adversarial Hallucination Attacks in Clinical Decision Support: A Multi-Model Assurance AnalysisSemantic proximity Read

Safety Evaluation of a Generative AI Agent for Anxiety and Depression SymptomsSemantic proximity Read

Benchmarking Language Models for Clinical Safety: A Primer for Mental Health ProfessionalsSemantic proximity Read

Can LLMs Get High? A Dual-Metric Framework for Evaluating Psychedelic Simulation and Safety in Large Language ModelsSemantic proximity Read

Beyond Benchmarks: Dynamic, Automatic And Systematic Red-Teaming Agents For Trustworthy Medical Language ModelsSemantic proximity Read