Article

MedScope: A Lightweight Benchmark of Open-Source Large Language Models for Medical Question Answering

2026-04-01

Abstract excerpt

The rapid development of large language models (LLMs) has stimulated growing interest in their use for medical question answering and clinical decision support. However, compared with frontier proprietary systems, the empirical understanding of lightweight open-source LLMs in medical settings remains limited, particularly under resource-constrained experimental conditions. To address this gap, we introduce MedScop...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 46f84981-443a-5524-885c-07e963347cf4
DOI: 10.64898/2026.03.31.26349827

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

MedScope: A Lightweight Benchmark of Open-Source Large Language Models for Medical Question AnsweringDOI 10.64898/2026.03.31.26349827Read

CLEVER: Clinical Large Language Model Evaluationby Expert ReviewSemantic proximity Read

Comparative Performance of General-Purpose Large Language Models and a Specialized Clinical AI Tool on OKAP-Style Ophthalmology QuestionsSemantic proximity Read

ARE LLMS READY FOR PEDIATRICS? A COMPARATIVE EVALUATION OF MODEL ACCURACY ACROSS CLINICAL DOMAINSSemantic proximity Read

Evaluating On-Device Gemma 3 and GPT-OSS as Practical Alternatives to Cloud-Based Language Models on a National Medical Board ExaminationSemantic proximity Read

Assessing and optimizing large language models on spondyloarthritis multi-choice question answering (SpAMCQA): study protocol for a bilingual evaluation benchmarkSemantic proximity Read

CARDBiomedBench: A Benchmark for Evaluating Large Language Model Performance in Biomedical ResearchSemantic proximity Read

Comparative Performance of Large Language Model-Based Chatbots, Dental Students, and Postgraduate Specialty Students in Text-Based Oral and Maxillofacial Radiology QuestionsSemantic proximity Read

NigBench: A multilingual point-of-care medical query benchmarking study of large language models in NigeriaSemantic proximity Read

The Unreliable Judges: Assessing Reproducibility and Self-Preference Bias of LLMs as Free-Text EvaluatorsSemantic proximity Read

An Empirical Analysis of Fine-Tuning Large Language Models on Bioinformatics Literature: PRSGPT and BioStarsGPTSemantic proximity Read

Auditing frontier general-purpose large language models in biomedical tasks: reasoning gains, extraction limits, and benchmark reliabilitySemantic proximity Read

Entity-centric evaluation of large language model responses for medical question-answering tasksSemantic proximity Read