Article

Enhancing Medical Knowledge in Large Language Models via Supervised Continued Pretraining on Clinical Notes

2026-04-04

Abstract excerpt

<h4>Background</h4> Large language models (LLMs) contain limited professional medical knowledge, as large-scale training on clinical text has not yet been possible due to restricted access. <h4>Objectives</h4> To continue pre-training an open-access instruct LLM on de-identified medical notes and evaluate the resulting impact on real-world clinical decision-making tasks and standard benchmarks. <h4>Methods</h4>...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 640d54c2-e33a-582d-8cd1-c29d438c7f0c
DOI: 10.64898/2026.04.02.26350065

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Enhancing Medical Knowledge in Large Language Models via Supervised Continued Pretraining on Clinical NotesDOI 10.64898/2026.04.02.26350065Read

Me-LLaMA: Medical Foundation Large Language Models for Comprehensive Text Analysis and BeyondSemantic proximity Read

Improving clinical expertise in large language models using electronic medical recordsSemantic proximity Read

Generalist Foundation Models Are Not Clinical Enough for Hospital OperationsSemantic proximity Read

Leveraging Large Language Models for Knowledge-free Weak Supervision in Clinical Natural Language ProcessingSemantic proximity Read

LCD Benchmark: Long Clinical Document Benchmark on Mortality Prediction for Language ModelsSemantic proximity Read

Me-LLaMA: Foundation Large Language Models for Medical ApplicationsSemantic proximity Read

Assessing the Impact of Pretraining Domain Relevance on Large Language Models Across Various Pathology Reporting TasksSemantic proximity Read

Understanding Clinical Reasoning Variability in Medical Large Language Models: A Mechanistic Interpretability StudySemantic proximity Read

Evaluation of Large Language Model Performance on the Biomedical Language Understanding and Reasoning Benchmark: Comparative StudySemantic proximity Read

CLEVER: Clinical Large Language Model Evaluationby Expert ReviewSemantic proximity Read

The Word and the Way: Strategies for Domain-Specific BERT Pre-Training in German Medical NLPSemantic proximity Read

Expert-level validation of AI-generated medical text with scalable language modelsSemantic proximity Read