Article

A Three-Tier Operational Benchmark for Evaluating Large Language Models on Hospital Medication Safety

2026-06-10

Abstract excerpt

<h4>Objective</h4> To introduce PsiBench, a clinically validated medication-safety benchmark for evaluating large language models (LLMs) against the standards used to certify hospital computerized provider order entry (CPOE) and electronic health record (EHR) systems, and a non-overlapping three-tier evaluation framework separating highest-stakes discrimination, the operational CDS regime, and category-correct al...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: ccf224b1-a2b0-545b-bf0c-4095a2a468a1
DOI: 10.64898/2026.06.05.26354271

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

A Three-Tier Operational Benchmark for Evaluating Large Language Models on Hospital Medication SafetyDOI 10.64898/2026.06.05.26354271Read

Development and Testing of a Novel Large Language Model-Based Clinical Decision Support Systems for Medication Safety in 12 Clinical SpecialtiesSemantic proximity Read

Beyond Benchmarks: Dynamic, Automatic And Systematic Red-Teaming Agents For Trustworthy Medical Language ModelsSemantic proximity Read

Rx-LLM: a benchmarking suite to evaluate safe large language model performance for medication-related tasksSemantic proximity Read

Large language models management of complex medication regimens: a case-based evaluationSemantic proximity Read

A Systematic Review of Testing and Evaluation of Healthcare Applications of Large Language Models (LLMs)Semantic proximity Read

Large Language Models Are Highly Vulnerable to Adversarial Hallucination Attacks in Clinical Decision Support: A Multi-Model Assurance AnalysisSemantic proximity Read

Beyond Accuracy: An Efficiency- and Safety-Aware Framework for Evaluating Clinical AI with Large Language ModelsSemantic proximity Read

Evaluation of four large language models on complex, infectious disease case scenariosSemantic proximity Read

An interdisciplinary, randomized, single-blind evaluation of state-of-the-art large language models for their implications and risks in medical diagnosis and managementSemantic proximity Read

Evaluating Large Language Models’ Performance in FDA Regulatory ScienceSemantic proximity Read

Drug or Pokémon? Large language model performance in identification of fabricated medicationsSemantic proximity Read

Evaluating a Customised Large Language Model (DELSTAR) and its Ability to Address Medication-Related Questions Associated with Delirium: A Quantitative Exploratory StudySemantic proximity Read