Article

Performance of o1 pro and GPT-4 in self-assessment questions for nephrology board renewal

2025-01-15

Abstract excerpt

<h4>ABSTRACT</h4> <h4>Background</h4> Large language models (LLMs) are increasingly evaluated in medical education and clinical decision support, but their performance in highly specialized fields, such as nephrology, is not well established. We compared two advanced LLMs, GPT-4 and the newly released o1 pro, on comprehensive nephrology board renewal examinations. <h4>Methods</h4> We administered 209 Japanese S...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: cb480ec5-b49f-5bb1-91e3-b57cf18fce83
DOI: 10.1101/2025.01.14.25320525

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Performance of o1 pro and GPT-4 in self-assessment questions for nephrology board renewalDOI 10.1101/2025.01.14.25320525Read

Performance of ChatGPT and Bard in Self-Assessment Questions for Nephrology Board RenewalSemantic proximity Read

Performance of reasoning large language models on nephrology multiple-choice questionsSemantic proximity Read

Comparative Performance of General-Purpose Large Language Models and a Specialized Clinical AI Tool on OKAP-Style Ophthalmology QuestionsSemantic proximity Read

Performance of Advanced Large Language Models (GPT-4o, GPT-4, Gemini 1.5 Pro, Claude 3 Opus) on Japanese Medical Licensing Examination: A Comparative StudySemantic proximity Read

Benchmarking the Confidence of Large Language Models in Clinical QuestionsSemantic proximity Read

Evaluating the Performance of Large Language Models on a Neurology Board-Style ExaminationSemantic proximity Read

Textbook-Level Medical Knowledge in Large Language Models: A Comparative Evaluation Using the Japanese National Medical ExaminationSemantic proximity Read

Comparative accuracy of ChatGPT-o1, DeepSeek R1, and Gemini 2.0 in answering general primary care questionsSemantic proximity Read

Multidimensional Evaluation of Large Language Models on the AAP In-Service Examination: Assessing Accuracy, Calibration, and Citation ReliabilitySemantic proximity Read

Evaluation of ChatGPT-4o’s and DeepSeek R1’s responses to urological problems: A comparative studySemantic proximity Read

Comparison of Large Language Models’ Performance on Neurosurgical Board Examination QuestionsSemantic proximity Read

Multimodal Large Language Model Passes Specialty Board Examination and Surpasses Human Test-Taker Scores: A Comparative Analysis Examining the Stepwise Impact of Model Prompting Strategies on PerformanceSemantic proximity Read