Article

NigBench: A multilingual point-of-care medical query benchmarking study of large language models in Nigeria

2026-07-10

Abstract excerpt

In this study, we introduce a novel benchmark comprising over 9,000 real-world, point-of-care, multilingual, and multimodal clinical question-answer pairs sourced from frontline health workers in Nigeria. Using the dataset, we compare local general practitioners to multiple leading open and closed LLMs. Our results reveal several critical insights into the suitability of LLMs as clinical decision support systems i...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 61e0e9ad-85c1-50de-b689-b63df6ddc1a8
DOI: 10.64898/2026.07.05.26356776

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

NigBench: A multilingual point-of-care medical query benchmarking study of large language models in NigeriaDOI 10.64898/2026.07.05.26356776Read

How Good Are Large Language Models at Supporting Frontline Healthcare Workers in Low-Resource Settings – A Benchmarking Study & DatasetSemantic proximity Read

All You Need Is Context: Clinician Evaluations of various iterations of a Large Language Model-Based First Aid Decision Support Tool in GhanaSemantic proximity Read

Systematic Review of Large Language Models for Patient Care: Current Applications and ChallengesSemantic proximity Read

Evaluating large language model workflows in clinical decision support: referral, triage, and diagnosisSemantic proximity Read

MedScope: A Lightweight Benchmark of Open-Source Large Language Models for Medical Question AnsweringSemantic proximity Read

A Systematic Review of Testing and Evaluation of Healthcare Applications of Large Language Models (LLMs)Semantic proximity Read

Performance of Large Language Models as a Tool for Primary Care Consultations: Evaluation StudySemantic proximity Read

TurkishMedLLM: A Source-Grounded and Safety-Aware Turkish Medical LLM for Clinical Decision Support and Digital Health ApplicationsSemantic proximity Read

Automated Evaluation of Large Language Model Response Concordance with Human Specialist Responses on Physician-to-Physician eConsult CasesSemantic proximity Read

CLEVER: Clinical Large Language Model Evaluationby Expert ReviewSemantic proximity Read

Assessing and optimizing large language models on spondyloarthritis multi-choice question answering (SpAMCQA): study protocol for a bilingual evaluation benchmarkSemantic proximity Read

Auditing frontier general-purpose large language models in biomedical tasks: reasoning gains, extraction limits, and benchmark reliabilitySemantic proximity Read