Article

Performance of reasoning large language models on nephrology multiple-choice questions

2025-12-08

Abstract excerpt

<h4>Aim</h4> Performance of large language models in medicine is improving, yet it remains unclear how the advantage of reasoning models depends on task characteristics in nephrology. <h4>Methods</h4> We evaluated four large language models in two families—OpenAI (GPT-5 reasoning, GPT-4o baseline) and Google (Gemini 2.5 Pro reasoning, Gemini 2.0 Flash baseline)—on 209 self-assessment questions for nephrology boa...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 7f210e7c-eea1-5542-b48f-2003b2c47302
DOI: 10.64898/2025.12.03.25341427

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Performance of reasoning large language models on nephrology multiple-choice questionsDOI 10.64898/2025.12.03.25341427Read

Performance of o1 pro and GPT-4 in self-assessment questions for nephrology board renewalSemantic proximity Read

Comparative Performance of General-Purpose Large Language Models and a Specialized Clinical AI Tool on OKAP-Style Ophthalmology QuestionsSemantic proximity Read

Performance of ChatGPT and Bard in Self-Assessment Questions for Nephrology Board RenewalSemantic proximity Read

A Novel Framework for Evaluating the Clinical Reasoning Process of Large Language Models: A Comparative Study in NephrologySemantic proximity Read

Benchmarking the Confidence of Large Language Models in Clinical QuestionsSemantic proximity Read

Textbook-Level Medical Knowledge in Large Language Models: A Comparative Evaluation Using the Japanese National Medical ExaminationSemantic proximity Read

Evaluation of ChatGPT-4o’s and DeepSeek R1’s responses to urological problems: A comparative studySemantic proximity Read

Performance of Advanced Large Language Models (GPT-4o, GPT-4, Gemini 1.5 Pro, Claude 3 Opus) on Japanese Medical Licensing Examination: A Comparative StudySemantic proximity Read

Comparative accuracy of ChatGPT-o1, DeepSeek R1, and Gemini 2.0 in answering general primary care questionsSemantic proximity Read

Frontier Large Language Models for Comprehensive Medication Review in CKD Patients with Polypharmacy: A Trap-Embedded Synthetic BenchmarkSemantic proximity Read

Comparative Analysis of Multimodal Large Language Models GPT-4o and o1 vs Clinicians in Clinical Case Challenge QuestionsSemantic proximity Read

Comparison of Large Language Models’ Performance on Neurosurgical Board Examination QuestionsSemantic proximity Read