Article

Algorithmic Versus Expert Rankings of Large Language Models in Peritoneal Dialysis Prescription Review: A Trap-Embedded Synthetic Benchmark

2026-06-01

Abstract excerpt

<h4>Background</h4> Clinical LLM benchmarks rarely test whether algorithmic rankings agree with expert clinical judgment. We developed a trap-embedded peritoneal dialysis (PD) benchmark comparing multiple scoring constructs with blinded nephrologist ratings. <h4>Methods</h4> We generated 125 synthetic PD cases containing 13 ISPD-aligned trap types. Five LLMs (Claude Sonnet 4.5, GPT-5.4, Gemini 3.1 Pro, DeepSeek-...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 31ccea61-f464-5ea2-b984-f78650079f97
DOI: 10.64898/2026.05.28.26354383

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Algorithmic Versus Expert Rankings of Large Language Models in Peritoneal Dialysis Prescription Review: A Trap-Embedded Synthetic BenchmarkDOI 10.64898/2026.05.28.26354383Read

Frontier Large Language Models for Comprehensive Medication Review in CKD Patients with Polypharmacy: A Trap-Embedded Synthetic BenchmarkSemantic proximity Read

Large language models for automatable real-world performance monitoring of diagnostic decision support systems: a comparison to manual doctor panel review in a prospective clinical studySemantic proximity Read

High Consistency, Limited Accuracy: Evaluating Large Language Models for Binary Medical DiagnosisSemantic proximity Read

Multidimensional Evaluation of Large Language Models on the AAP In-Service Examination: Assessing Accuracy, Calibration, and Citation ReliabilitySemantic proximity Read

Developing an open-source framework for LLM evaluation of patients using EHR clinical documentation; performance of LLMs relative to medical professionalsSemantic proximity Read

Assessing the Limitations of Large Language Models in Clinical Practice Guideline-concordant Treatment Decision-making on Real-world DataSemantic proximity Read

The TRIPOD-LLM Statement: A Targeted Guideline For Reporting Large Language Models UseSemantic proximity Read

Large Language Models Facilitate the Generation of Electronic Health Record Phenotyping AlgorithmsSemantic proximity Read

Beyond Accuracy: An Efficiency- and Safety-Aware Framework for Evaluating Clinical AI with Large Language ModelsSemantic proximity Read

Performance of reasoning large language models on nephrology multiple-choice questionsSemantic proximity Read

A Novel Framework for Evaluating the Clinical Reasoning Process of Large Language Models: A Comparative Study in NephrologySemantic proximity Read