Article

AI safety evaluation in an underrepresented population: real-world performance of clinical decision support and frontier language models on Medicaid patient messaging triage

2026-06-11

Abstract excerpt

<title>Abstract</title> <p>Background. Studies of artificial intelligence tools used in patient triage have largely involved academic medical center cohorts, scripted patient-actor scenarios, or knowledge benchmarks. Populations that may rely on such tools due to constrained access to in-person care, including Medicaid patients, have been less fully evaluated. Objective. To compare combinations of safety guardr...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: bb7dfccc-a83c-5ca8-9afd-fb69c7a07799
DOI: 10.21203/rs.3.rs-9796014/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

AI safety evaluation in an underrepresented population: real-world performance of clinical decision support and frontier language models on Medicaid patient messaging triageDOI 10.21203/rs.3.rs-9796014/v1Read

MTS-Bench: A Manchester Triage System Benchmark for Language Model Triage SafetySemantic proximity Read

Artificial Intelligence - Large Language Models (LLMs) and Agentic AI in Clinical Decision Support in Outpatient, General Practice and Acute Settings: A Systematic Review of Diagnostic Accuracy, Comparative Efficacy, Clinical Outcomes and Implementation FactorsSemantic proximity Read

Bridging AI and Healthcare: A Scoping Review of Retrieval-Augmented Generation—Ethics, Bias, Transparency, Improvements, and ApplicationsSemantic proximity Read

Evaluating the AI Potential as a Safety Net for Diagnosis: A Novel Benchmark of Large Language Models in Correcting Diagnostic ErrorsSemantic proximity Read

Aggregate benchmark scores obscure patient safety implications of errors across frontier language modelsSemantic proximity Read

Needs and Expectations for Artificial Intelligence in Emergency Medicine According to Canadian PhysiciansSemantic proximity Read

Red-Teaming Medical AI: Systematic Adversarial Evaluation of LLM Safety Guardrails in Clinical ContextsSemantic proximity Read

The Diagnostic and Triage Accuracy of the GPT-3 Artificial Intelligence ModelSemantic proximity Read

AM-RAF: An Agentic, Retrieval-Augmented, Uncertainty-Gated Framework for Trustworthy Clinical Decision Support in Resource-Constrained Health SystemsSemantic proximity Read

Comparative Performance of agentic AI and Physicians in Taking Clinical History across Leading Large Language Models (LLMs)Semantic proximity Read

Medical errors in large language models revealed using 1,000 synthetic clinical transcriptsSemantic proximity Read

Evaluating Large Language Model Diagnostic Performance on JAMA Clinical Challenges via a Multi-Agent Conversational FrameworkSemantic proximity Read