Article

Proprietary and Open-Source Large Language Models on the Korean Pharmacist Licensing Examination: A Comparative Benchmarking Study

2025-04-19

Abstract excerpt

<h4>Background</h4> Large language models (LLMs) have shown remarkable advancements in natural language processing, with increasing interest in their ability to handle tasks requiring expert-level knowledge. While previous studies have evaluated specific LLM models on pharmacist licensing ex-aminations, comprehensive benchmarking across diverse model architectures, sizes, and generations remains limited. This stu...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 09ac8cfa-cbc9-50e4-8c3c-ac23d0e4a9eb
DOI: 10.1101/2025.04.15.25325584

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Proprietary and Open-Source Large Language Models on the Korean Pharmacist Licensing Examination: A Comparative Benchmarking StudyDOI 10.1101/2025.04.15.25325584Read

Language-dependent variability in large language model performance on pharmaceutical knowledge tasksSemantic proximity Read

A Systematic Review of Testing and Evaluation of Healthcare Applications of Large Language Models (LLMs)Semantic proximity Read

Evaluation of DeepSeek-R1 and ChatGPT on the Chinese National Medical Licensing Examination: A Multi-Year Comparative StudySemantic proximity Read

Performance of Advanced Large Language Models (GPT-4o, GPT-4, Gemini 1.5 Pro, Claude 3 Opus) on Japanese Medical Licensing Examination: A Comparative StudySemantic proximity Read

Comparison of Large Language Models’ Performance on Neurosurgical Board Examination QuestionsSemantic proximity Read

A Systematic Review of Large Language Models in Medical Specialties: Applications, Challenges and Future DirectionsSemantic proximity Read

The TRIPOD-LLM Statement: A Targeted Guideline For Reporting Large Language Models UseSemantic proximity Read

Generalist Large Language Models in a Specialized World: Evidence from the Italian National Medical Education PathwaySemantic proximity Read

Evaluating the Performance of Large Language Models on a Neurology Board-Style ExaminationSemantic proximity Read

Multidimensional Evaluation of Large Language Models on the AAP In-Service Examination: Assessing Accuracy, Calibration, and Citation ReliabilitySemantic proximity Read

Evaluation of Large Language Models in Thailand’s National Medical Licensing ExaminationSemantic proximity Read

Textbook-Level Medical Knowledge in Large Language Models: A Comparative Evaluation Using the Japanese National Medical ExaminationSemantic proximity Read