Article

Comparative Performance of General-Purpose Large Language Models and a Specialized Clinical AI Tool on OKAP-Style Ophthalmology Questions

2026-07-08

Abstract excerpt

<title>Abstract</title> <p> <bold>Purpose</bold> To evaluate the performance, discrimination, and calibration of five contemporary large language models (LLMs), including OpenEvidence, on OKAP-style ophthalmology multiple-choice questions. <bold>Methods</bold> Five LLM-based systems were assessed: OpenEvidence, a specialized clinical AI platform, and four general-purpose LLMs: ChatGPT-5.4-Pro, Gemini-Pro-3, C...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 387d10d4-f413-5e2b-b48c-2045daee9ab7
DOI: 10.21203/rs.3.rs-10067407/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Comparative Performance of General-Purpose Large Language Models and a Specialized Clinical AI Tool on OKAP-Style Ophthalmology QuestionsDOI 10.21203/rs.3.rs-10067407/v1Read

Benchmarking the Confidence of Large Language Models in Clinical QuestionsSemantic proximity Read

Performance of reasoning large language models on nephrology multiple-choice questionsSemantic proximity Read

Evaluating the Performance of ChatGPT in Ophthalmology: An Analysis of its Successes and ShortcomingsSemantic proximity Read

Performance of Advanced Large Language Models (GPT-4o, GPT-4, Gemini 1.5 Pro, Claude 3 Opus) on Japanese Medical Licensing Examination: A Comparative StudySemantic proximity Read

Large Language Models as Ophthalmic Patient Educators: A Comparative Evaluation of Readability, Understandability, and ActionabilitySemantic proximity Read

Comparison of Large Language Models’ Performance on Neurosurgical Board Examination QuestionsSemantic proximity Read

Performance of o1 pro and GPT-4 in self-assessment questions for nephrology board renewalSemantic proximity Read

Evaluating the Performance of Large Language Models on a Neurology Board-Style ExaminationSemantic proximity Read

Multidimensional Evaluation of Large Language Models on the AAP In-Service Examination: Assessing Accuracy, Calibration, and Citation ReliabilitySemantic proximity Read

Comparative Performance of Large Language Model-Based Chatbots, Dental Students, and Postgraduate Specialty Students in Text-Based Oral and Maxillofacial Radiology QuestionsSemantic proximity Read

Comparative accuracy of ChatGPT-o1, DeepSeek R1, and Gemini 2.0 in answering general primary care questionsSemantic proximity Read

Evaluating Capabilities of Large Language Models: Performance of GPT4 on Surgical Knowledge AssessmentsSemantic proximity Read