Article

Evaluating the Performance of ChatGPT in Ophthalmology: An Analysis of its Successes and Shortcomings

2023-01-24

Abstract excerpt

<h4>ABSTRACT</h4> We tested the accuracy of ChatGPT, a large language model (LLM), in the ophthalmology question-answering space using two popular multiple choice question banks used for the high-stakes Ophthalmic Knowledge Assessment Program (OKAP) exam. The testing sets were of easy-to-moderate difficulty and were diversified, including recall, interpretation, practical and clinical decision-making problems. Ch...

Topics

Open a Topic to create a Post that cites this publication.

Genomics and Rare Diseases

Identifiers and source

Literature Corpus work: c6957f56-959b-565e-8350-6c80738fec07
DOI: 10.1101/2023.01.22.23284882

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Evaluating the Performance of ChatGPT in Ophthalmology: An Analysis of its Successes and ShortcomingsDOI 10.1101/2023.01.22.23284882Read

Evaluating Chat GPT-4o’s Comparative Performance Over GPT-4 in Japanese Medical Licensing Examination and Its Clinical Partnership PotentialSemantic proximity Read

Comparative Performance of General-Purpose Large Language Models and a Specialized Clinical AI Tool on OKAP-Style Ophthalmology QuestionsSemantic proximity Read

Comparative Performance of Large Language Model-Based Chatbots, Dental Students, and Postgraduate Specialty Students in Text-Based Oral and Maxillofacial Radiology QuestionsSemantic proximity Read

Evaluating Capabilities of Large Language Models: Performance of GPT4 on Surgical Knowledge AssessmentsSemantic proximity Read

ChatGPT Goes to Operating Room: Evaluating GPT-4 Performance and Its Potential in Surgical Education and Training in the Era of Large Language ModelsSemantic proximity Read

ChatGPT takes the FCPS exam in Internal MedicineSemantic proximity Read

Can ChatGPT Pass the 2023 Japanese National Medical Licensing Examination?Semantic proximity Read

Assessing ChatGPT's Performance in Delineating Uveitis: An analysis of responses to real-world case presentationsSemantic proximity Read

Performance of ChatGPT on Clinical Medicine Entrance Examination for Chinese Postgraduate in ChineseSemantic proximity Read

Chat-WanJuan: A Fine-Tuned Compact Language Model for Multiple- Choice Question Generation in Medical EducationSemantic proximity Read

ChatENT: Augmented Large Language Model for Expert Knowledge Retrieval in Otolaryngology - Head and Neck SurgerySemantic proximity Read

Human versus Artificial Intelligence: ChatGPT-4 Outperforming Bing, Bard, ChatGPT-3.5, and Humans in Clinical Chemistry Multiple-Choice QuestionsSemantic proximity Read