Article

Open-source solution for evaluation and benchmarking of large language models for public health

2025-03-21

Abstract excerpt

Large language models (LLMs) have demonstrated remarkable capabilities in various natural language processing tasks, including text classification, information extraction, and sentiment analysis. However, most existing benchmarks are general-purpose and lack relevance for domain-specific applications such as public health. To address this gap, the objective of this study is to develop and test an open-source solut...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: bd0282d6-acd8-56aa-86e4-5d83587dc677
DOI: 10.1101/2025.03.20.25324040

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Open-source solution for evaluation and benchmarking of large language models for public healthDOI 10.1101/2025.03.20.25324040Read

Using Large Language Models for sentiment analysis of health-related social media data: empirical evaluation and practical tipsSemantic proximity Read

How Good Are Large Language Models at Supporting Frontline Healthcare Workers in Low-Resource Settings – A Benchmarking Study & DatasetSemantic proximity Read

Evaluating large language models for natural-language-to-code generation on aggregate Czech public health data analysisSemantic proximity Read

Large Language Models at Population Scale: A Survey and Taxonomy of Public Health ApplicationsSemantic proximity Read

From Rule-Based to DeepSeek R1 – A Robust Comparative Evaluation of Fifty Years of Natural Language Processing (NLP) Models To Identify Inflammatory Bowel Disease CohortsSemantic proximity Read

VaxLLM: Leveraging Fine-tuned Large Language Model for automated annotation of <i>Brucella</i> VaccinesSemantic proximity Read

Advancing Real-time Pandemic Forecasting Using Large Language Models: A COVID-19 Case StudySemantic proximity Read

Comparison of local large language models for extraction of signs and symptoms data from electronic health recordsSemantic proximity Read

Natural language processing to evaluate texting conversations between patients and healthcare providers during COVID-19 Home-Based Care in Rwanda at scaleSemantic proximity Read

Comparison of Large Language Models in Answering Immuno-Oncology Questions: A Cross-Sectional StudySemantic proximity Read

Beyond Raw Performance: Neural Machine Translation Based Multi-lingual Classification of Tweets for Automated Disease SurveillanceSemantic proximity Read

Improving the Robustness of Large Language Models in Extracting Social Determinants of HealthSemantic proximity Read