Article

Multidimensional Evaluation of Large Language Models on the AAP In-Service Examination: Assessing Accuracy, Calibration, and Citation Reliability

2025-10-17

Abstract excerpt

<h4>Background</h4> Large language models (LLMs) have demonstrated rapid advancements in natural language understanding and generation, prompting their integration into biomedical research, clinical practice, and professional education. However, systematic evaluation of LLMs in specialty-specific domains such as dentistry and periodontology remain limited, particularly regarding multidimensional performance metri...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 5c8ae831-764a-5013-9a0e-378730109190
DOI: 10.1101/2025.10.14.25338040

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Multidimensional Evaluation of Large Language Models on the AAP In-Service Examination: Assessing Accuracy, Calibration, and Citation ReliabilityDOI 10.1101/2025.10.14.25338040Read

Comparative Performance of General-Purpose Large Language Models and a Specialized Clinical AI Tool on OKAP-Style Ophthalmology QuestionsSemantic proximity Read

Performance of Advanced Large Language Models (GPT-4o, GPT-4, Gemini 1.5 Pro, Claude 3 Opus) on Japanese Medical Licensing Examination: A Comparative StudySemantic proximity Read

Benchmarking the Confidence of Large Language Models in Clinical QuestionsSemantic proximity Read

Evaluating the Performance of Large Language Models on a Neurology Board-Style ExaminationSemantic proximity Read

Large Language Models for Pulmonary Embolism Health Education: A Four- Model Comparison of Reliability, Quality, and ReadabilitySemantic proximity Read

Performance of o1 pro and GPT-4 in self-assessment questions for nephrology board renewalSemantic proximity Read

A statistical framework for evaluating the repeatability and reproducibility of large language modelsSemantic proximity Read

A Blinded Comparative Evaluation of Clinical and AI-Generated Responses to Otologic Patient QueriesSemantic proximity Read

Understanding the Inner Workings of Large Language Models in MedicineSemantic proximity Read

Benchmarking the Performance of Large Language Models in Uveitis: A Comparative Analysis of ChatGPT-3.5, ChatGPT-4.0, Google Gemini, and Anthropic Claude3Semantic proximity Read