Article

The Word and the Way: Strategies for Domain-Specific BERT Pre-Training in German Medical NLP

2025-09-18

Abstract excerpt

<title>Abstract</title> <p>Background: Digital healthcare generates vast amounts of clinical texts thathold potential for AI-assisted applications. However, existing German biomedicallanguage models either rely on older architectures or are trained on limited data,which may hinder their performance in real-world settings. <h4>Methods:</h4> To explore the impact of domain adaptation strategies in Germanclinical NL...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 3e5e09fe-b308-5430-84fc-75cedea9d83e
DOI: 10.21203/rs.3.rs-7332811/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

The Word and the Way: Strategies for Domain-Specific BERT Pre-Training in German Medical NLPDOI 10.21203/rs.3.rs-7332811/v1Read

DrBERT: A Robust Pre-trained Model in French for Biomedical and Clinical domainsSemantic proximity Read

Generalist Foundation Models Are Not Clinical Enough for Hospital OperationsSemantic proximity Read

Adapting LLMs for Biomedical Natural Language Processing: A Comprehensive Benchmark Study on Fine-Tuning MethodsSemantic proximity Read

CLEVER: Clinical Large Language Model Evaluationby Expert ReviewSemantic proximity Read

GatorTron: A Large Language Model for Clinical Natural Language ProcessingSemantic proximity Read

Large Language Models in Portuguese for Healthcare: A Systematic ReviewSemantic proximity Read

Me-LLaMA: Medical Foundation Large Language Models for Comprehensive Text Analysis and BeyondSemantic proximity Read

Evaluation of Large Language Model Performance on the Biomedical Language Understanding and Reasoning Benchmark: Comparative StudySemantic proximity Read

Bioberturk: Exploring Turkish Biomedical Language Model Development Strategies in Low Resource SettingSemantic proximity Read

Doc Bot: The Medical LLM Fine-tuned on LLaMA 3 8B Using LoRA and Insights from the Medical FieldSemantic proximity Read

Predicting Rectal Cancer Patient Survival with Dutch Radiology Reports using Natural Language Processing (NLP): The Role of Pretrained Language ModelsSemantic proximity Read

Enhancing Medical Knowledge in Large Language Models via Supervised Continued Pretraining on Clinical NotesSemantic proximity Read