Back to search

Article

ClaroAI-Bench: Evaluating Agentic Scientific Reproducibility on Real Biomedical Papers

2026-05-12

Abstract excerpt

We introduce ClaroAI-Bench , an evaluation suite for measuring AI agents’ ability to reproduce computational findings from published biomedical research. The benchmark comprises 35 real NIH-funded papers spanning five modalities (genomics, imaging, clinical/EHR, epidemiology, wet-lab) scored on a five-dimension rubric: data findability (D1), data accessibility (D2), code availability (D3), environment reconstruct...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work
16b1a3c3-4c1a-552e-987b-a16879ec2847
DOI
10.64898/2026.05.08.723611
Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest
Interactive article relationship graphSelect a related publication card to move it into the centre and load its closest explainable connections. Solid lines are source-backed structured connections. Dashed lines are semantic discovery signals and are not scientific evidence.
ClaroAI-Bench: Evaluating Agentic Scientific Reproducibility on Real Biomedical PapersDOI 10.64898/2026.05.08.723611
BiomniBench: Process-level Evaluation of LLM Agents for Real-world Biomedical ResearchSemantic proximity
Citation Hallucination Determines Success: An Empirical Comparison of Six Medical AI Research SystemsSemantic proximity
DOME Copilot: A resource to automate transparent reporting of artificial intelligence methodsSemantic proximity
AtlasAI: Multi-Agent Reasoning for Knowledge Discovery in the Human Protein AtlasSemantic proximity
GeneKnow: An auditable AI framework for source-grounded biological evidence synthesisSemantic proximity
The FAIRSCAPE AI-readiness Framework for Biomedical ResearchSemantic proximity
A Persistent Fleet of AI Scientists Exhibits Cooperative and Autopoietic BehaviorSemantic proximity
Representation Before Retrieval: Structured Patient Artifacts Reduce Hallucination in Clinical AI SystemsSemantic proximity
Orion: Towards Lab Automation with Computer-Using AgentsSemantic proximity
Biomni: A General-Purpose Biomedical AI AgentSemantic proximity
Agentic systems are adept at solving well-scoped, verifiable problems in computational biologySemantic proximity
A framework for human-artificial intelligence co-learning for disease activity labeling using electronic health recordsSemantic proximity
Select a neighboring publication to make it the new centre.