Article

Can Large Language Models Detect Contradicted Biomedical Evidence? A Dual-Annotator Benchmark Audit

2026-07-06

Abstract excerpt

<title>Abstract</title> <p>Background: Biomedical question answering systems increasingly use retrieval-augmented generation, yet generated answers may be unsupported by, or actively contradict, retrieved evidence. In the configurations tested in this study, all LLM verifiers substantially under-detected gold contradictions, with the best automated recall only 5/23 (21.7%). We audited this failure mode and tested...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: e6bb362c-5bf7-5e12-9d17-8a4d629e1d5f
DOI: 10.21203/rs.3.rs-10064275/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Can Large Language Models Detect Contradicted Biomedical Evidence? A Dual-Annotator Benchmark AuditDOI 10.21203/rs.3.rs-10064275/v1Read

Queryome: Orchestrating Retrieval, Reasoning, and Synthesis across Biomedical LiteratureSemantic proximity Read

Creating a biomedical knowledge base by addressing GPT inaccurate responses and benchmarking contextSemantic proximity Read

Enhancing LLM Accuracy and Reducing Hallucinations using Query Refinement Technique and Knowledge GraphsSemantic proximity Read

Investigations on using Evidence-Based GraphRag Pipeline using LLM Tailored for USMLE Style QuestionsSemantic proximity Read

Auditing frontier general-purpose large language models in biomedical tasks: reasoning gains, extraction limits, and benchmark reliabilitySemantic proximity Read

A Multi-Agent RAG Framework for Biomedical Literature AnalysisSemantic proximity Read

A Hybrid Retrieval-Augmented Generation and Language Model Framework for Evidence-Grounded Review SystemsSemantic proximity Read

BM25 and Dense Retrieval Are Complementary for Portuguese Clinical Text: An Empirical Study of Hybrid RAG Across 500 Clinical QueriesSemantic proximity Read

Creating a biomedical knowledge base by addressing GPT inaccurate responses and benchmarking contextSemantic proximity Read

Entity-centric evaluation of large language model responses for medical question-answering tasksSemantic proximity Read

Development and validation of Retrieval Augmented Generation (RAG) and GraphRAG for complex clinical casesSemantic proximity Read

Representation Before Retrieval: Structured Patient Artifacts Reduce Hallucination in Clinical AI SystemsSemantic proximity Read