Article

Evaluating a Large Reasoning Model’s Performance on Open-Ended Medical Scenarios

2025-04-30

Abstract excerpt

Large language models (LLMs) have emerged as a dominant form of generative artificial intelligence (GenAI) in multiple domains. In early 2025, DeepSeek R1 was released, which is a new large reasoning model (LRM) that includes CoT (CoT) reasoning, Mixture of Experts (MoE), and reinforcement learning. As these technologies continue to improve, evaluating the accuracy and reliability of LLMs and LRMs in medicine rema...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: af6e78c5-0fc2-5ab7-a6cd-65900ac729ed
DOI: 10.1101/2025.04.29.25326666

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Evaluating a Large Reasoning Model’s Performance on Open-Ended Medical ScenariosDOI 10.1101/2025.04.29.25326666Read

MedClarify: An information-seeking AI agent for medical diagnosis with case-specific follow-up questionsSemantic proximity Read

Evaluating Large Language Model Diagnostic Performance on JAMA Clinical Challenges via a Multi-Agent Conversational FrameworkSemantic proximity Read

Comparative Analysis of Multimodal Large Language Models GPT-4o and o1 vs Clinicians in Clinical Case Challenge QuestionsSemantic proximity Read

RiskAgent: Autonomous Medical AI Copilot for Generalist Risk PredictionSemantic proximity Read

Evaluating the AI Potential as a Safety Net for Diagnosis: A Novel Benchmark of Large Language Models in Correcting Diagnostic ErrorsSemantic proximity Read

CARDBiomedBench: A Benchmark for Evaluating Large Language Model Performance in Biomedical ResearchSemantic proximity Read

Revolutionizing Disease Diagnosis with Large Language Models: A Systematic ReviewSemantic proximity Read

Med-AgentX: Multimodal Large Language Model Agents with Explainable Reinforcement Learning for Trustworthy Biomedical Decision SupportSemantic proximity Read

Understanding Clinical Reasoning Variability in Medical Large Language Models: A Mechanistic Interpretability StudySemantic proximity Read

Large Language Models Are Poor Clinical Decision-Makers: A Comprehensive BenchmarkSemantic proximity Read

A Novel Framework for Evaluating the Clinical Reasoning Process of Large Language Models: A Comparative Study in NephrologySemantic proximity Read

A Comprehensive Review of DeepSeek: Performance, Architecture and CapabilitiesSemantic proximity Read