Article

Evaluating the Performance of Large Language Models on a Neurology Board-Style Examination

2023-07-14

Abstract excerpt

<h4>Summary</h4> <h4>Background and Objectives</h4> Recent advancements in large language models (LLMs) such as GPT-3.5 and GPT-4 have shown impressive potential in a wide array of applications, including healthcare. While GPT-3.5 and GPT-4 showed heterogeneous results across specialized medical board examinations, the performance of these models in neurology board exams remains unexplored. <h4>Methods</h4> An exp...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 2206fb49-c4d6-5dcc-9e0c-ca2fbcc26ea4
DOI: 10.1101/2023.07.13.23292598

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Evaluating the Performance of Large Language Models on a Neurology Board-Style ExaminationDOI 10.1101/2023.07.13.23292598Read

Performance of Advanced Large Language Models (GPT-4o, GPT-4, Gemini 1.5 Pro, Claude 3 Opus) on Japanese Medical Licensing Examination: A Comparative StudySemantic proximity Read

Comparative Performance of General-Purpose Large Language Models and a Specialized Clinical AI Tool on OKAP-Style Ophthalmology QuestionsSemantic proximity Read

Comparison of Large Language Models’ Performance on Neurosurgical Board Examination QuestionsSemantic proximity Read

Multimodal Large Language Model Passes Specialty Board Examination and Surpasses Human Test-Taker Scores: A Comparative Analysis Examining the Stepwise Impact of Model Prompting Strategies on PerformanceSemantic proximity Read

Textbook-Level Medical Knowledge in Large Language Models: A Comparative Evaluation Using the Japanese National Medical ExaminationSemantic proximity Read

Multidimensional Evaluation of Large Language Models on the AAP In-Service Examination: Assessing Accuracy, Calibration, and Citation ReliabilitySemantic proximity Read

Performance of ChatGPT on Chinese National Medical Licensing Examinations: A Five-Year Examination Evaluation Study for Physicians, Pharmacists and NursesSemantic proximity Read

Assessing the Performance of Plugin-Integrated ChatGPT-4 in the German Medical Board Examination: An Experimental Study on the Advancements and Limitations of Modern AI Modelling ApproachesSemantic proximity Read

Performance of o1 pro and GPT-4 in self-assessment questions for nephrology board renewalSemantic proximity Read

Harnessing ChatGPT and GPT-4 for Evaluating the Rheumatology Questions of the Spanish Access Exam to Specialized Medical TrainingSemantic proximity Read

General purpose large language models match human performance on gastroenterology board exam self-assessmentsSemantic proximity Read

Comparative Analysis of Multimodal Large Language Models GPT-4o and o1 vs Clinicians in Clinical Case Challenge QuestionsSemantic proximity Read