Article

Reasoning Over Pre-training: Evaluating LLM Performance and Augmentation in Women’s Health

2025-05-23

Abstract excerpt

Recent advances in large language models (LLMs) show promise in clinical applications, but their performance in women’s health remains underexamined 1 . We evaluated LLMs on 2,337 questions from obstetrics and gynaecology, including 1,392 from the Royal College of Obstetricians and Gynaecologists Part 2 examination (MRCOG Part 2) 2 , a UK-based test of advanced clinical decision-making, and 945 from MedQA 3 , a da...

Topics

Open a Topic to create a Post that cites this publication.

Genomics and Rare Diseases

Identifiers and source

Literature Corpus work: f22a0a78-bee5-5ca7-88af-a2b54160fbfe
DOI: 10.1101/2025.05.22.25328162

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Reasoning Over Pre-training: Evaluating LLM Performance and Augmentation in Women’s HealthDOI 10.1101/2025.05.22.25328162Read

Exploring the Capabilities of ChatGPT in Women’s HealthSemantic proximity Read

MenstLLaMA: A Specialized Large Language Model for Menstrual Health Education in IndiaSemantic proximity Read

Small but Specialized: A Domain-Adapted Retrieval-Augmented LLM Outperforms Frontier Generalists in Pediatric and Adolescent GynecologySemantic proximity Read

A Comparative Performance Study of Retrieval-Augmented Generation Systems in Gynecologic OncologySemantic proximity Read

Development of a RAG-based Expert LLM for Clinical Support in Radiation OncologySemantic proximity Read

The Economics of Accuracy for Medical Reasoning with Large Language ModelsSemantic proximity Read

Retrieval-Augmented Medical Large Language ModelsSemantic proximity Read

Evaluating the performance of large language & visual-language models in cervical cytology screeningSemantic proximity Read

An Enhanced Lightweight Clinical Decision Support System via Refined Fine-Tuning and Intelligent Retrieval-Augmented GenerationSemantic proximity Read

Domain-Specific Fine-Tuning in a Retrieval-Augmented Generation Framework for Precision Geriatric Medical QASemantic proximity Read

MedScope: A Lightweight Benchmark of Open-Source Large Language Models for Medical Question AnsweringSemantic proximity Read

Evaluating a Large Reasoning Model’s Performance on Open-Ended Medical ScenariosSemantic proximity Read