Article

How Good Are Large Language Models at Supporting Frontline Healthcare Workers in Low-Resource Settings – A Benchmarking Study & Dataset

2025-08-28

Abstract excerpt

Large language models (LLMs) have demonstrated strong performance in medical contexts; however, existing benchmarks often fail to reflect the real-world complexity of low-resource health systems accurately. This study developed a dataset of 5,609 clinical questions contributed by 101 community health workers (CHWs) across four Rwandan districts and compared responses generated by five large language models (LLMs)...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 038a9a89-72d4-571e-95ff-fae2aa5daf61
DOI: 10.1101/2025.08.26.25333975

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

How Good Are Large Language Models at Supporting Frontline Healthcare Workers in Low-Resource Settings – A Benchmarking Study & DatasetDOI 10.1101/2025.08.26.25333975Read

A ‘Silent Trial’ Assessing the Accuracy of Large Language Models for Assisting Community Health Workers in Low-Resource SettingsSemantic proximity Read

NigBench: A multilingual point-of-care medical query benchmarking study of large language models in NigeriaSemantic proximity Read

A Systematic Review of Testing and Evaluation of Healthcare Applications of Large Language Models (LLMs)Semantic proximity Read

Assessing the research landscape and clinical utility of large language models: A scoping reviewSemantic proximity Read

The TRIPOD-LLM Statement: A Targeted Guideline For Reporting Large Language Models UseSemantic proximity Read

Systematic Literature Review of LLM-Large Language Model in Medical: Digital Health, Technology and ApplicationsSemantic proximity Read

Large Language Models in Healthcare Current Development and Future DirectionsSemantic proximity Read

Systematic Review of Large Language Models for Patient Care: Current Applications and ChallengesSemantic proximity Read

All You Need Is Context: Clinician Evaluations of various iterations of a Large Language Model-Based First Aid Decision Support Tool in GhanaSemantic proximity Read

Benchmarking Large Language Models and Clinicians Using Locally Generated Primary Healthcare Vignettes in KenyaSemantic proximity Read

A Systematic Review of Large Language Models in Medical Specialties: Applications, Challenges and Future DirectionsSemantic proximity Read

Can Large Language Models Provide High-Quality Information for Patients with Multidrug-Resistant Organism Infections: A Multidimensional Comparative Analysis of DeepSeek-V3, ChatGPT-5.2, Gemini-3, and Grok-4Semantic proximity Read