Article

End-to-End Reliability of Automated Systems for Diagnostic Data Extraction: A Benchmark Study in Uro-Oncologic Evidence Synthesis

2025-12-31

Abstract excerpt

<h4>Background</h4> Automated systems, including large language models, are increasingly used to support data extraction in diagnostic systematic reviews. However, their reliability, safety, and repeatability under realistic extraction conditions remain insufficiently characterized. <h4>Objective</h4> To benchmark the end-to-end reliability of automated systems for extracting diagnostic accuracy data from publis...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 32e2f6ba-7c06-5204-927e-8f64c09b5420
DOI: 10.64898/2025.12.24.25342959

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

End-to-End Reliability of Automated Systems for Diagnostic Data Extraction: A Benchmark Study in Uro-Oncologic Evidence SynthesisDOI 10.64898/2025.12.24.25342959Read

Will generative AI help solve systematic literature reviews? Evidence from a 2-year research programmeSemantic proximity Read

Bridging AI and Healthcare: A Scoping Review of Retrieval-Augmented Generation—Ethics, Bias, Transparency, Improvements, and ApplicationsSemantic proximity Read

When AI Meets the FDA: An Evaluation of Large Language Models Performance in Regulatory and Clinical Trial Data Extraction, Synthesis, and AnalysisSemantic proximity Read

Fully Automated Systematic Review Generation via Large Language Models: Quality Assessment and Implications for Scientific PublishingSemantic proximity Read

General-purpose large language models can achieve physician-level accuracy in complex medical data extractionSemantic proximity Read

Evaluating Large Language Models’ Performance in FDA Regulatory ScienceSemantic proximity Read

Retrieval-Augmented Generation Enhanced GPT-4.1 to Support Clinical Trial Informed Consent Review for Data ReuseSemantic proximity Read

Data Extraction from Oncology Imaging Reports by Large Language Models: A Comparative Accuracy StudySemantic proximity Read

A statistical framework for evaluating the repeatability and reproducibility of large language modelsSemantic proximity Read

Assessing the feasibility and acceptability of a bespoke large language model pipeline to extract data from different study designs for public health evidence reviewsSemantic proximity Read

Development of meta-prompts for Large Language Models to screen titles and abstracts for diagnostic test accuracy reviewsSemantic proximity Read

Artificial Intelligence in Relation to Accurate Information and Tasks in Gynecologic Oncology and Clinical Medicine – Dunning-Kruger Effects and UltracrepidarianismSemantic proximity Read