Article

DrBERT: A Robust Pre-trained Model in French for Biomedical and Clinical domains

2023-04-05

Abstract excerpt

In recent years, pre-trained language models (PLMs) achieve the best performance on a wide range of natural language processing (NLP) tasks. While the first models were trained on general domain data, specialized ones have emerged to more effectively treat specific domains. In this paper, we propose an original study of PLMs in the medical domain on French language. We compare, for the first time, the performance...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: f4099c9c-8567-55a7-872f-c2d18a60242d
DOI: 10.1101/2023.04.03.535368

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

DrBERT: A Robust Pre-trained Model in French for Biomedical and Clinical domainsDOI 10.1101/2023.04.03.535368Read

The Word and the Way: Strategies for Domain-Specific BERT Pre-Training in German Medical NLPSemantic proximity Read

Large Language Models in Portuguese for Healthcare: A Systematic ReviewSemantic proximity Read

Bioberturk: Exploring Turkish Biomedical Language Model Development Strategies in Low Resource SettingSemantic proximity Read

Generalist Foundation Models Are Not Clinical Enough for Hospital OperationsSemantic proximity Read

Predicting Rectal Cancer Patient Survival with Dutch Radiology Reports using Natural Language Processing (NLP): The Role of Pretrained Language ModelsSemantic proximity Read

Adapting LLMs for Biomedical Natural Language Processing: A Comprehensive Benchmark Study on Fine-Tuning MethodsSemantic proximity Read

CLEVER: Clinical Large Language Model Evaluationby Expert ReviewSemantic proximity Read

Domain-specific LLM Development and Evaluation – A Case-study for Prostate CancerSemantic proximity Read

Evaluation of Large Language Model Performance on the Biomedical Language Understanding and Reasoning Benchmark: Comparative StudySemantic proximity Read

Leveraging Large Language Models for Knowledge-free Weak Supervision in Clinical Natural Language ProcessingSemantic proximity Read

Me-LLaMA: Medical Foundation Large Language Models for Comprehensive Text Analysis and BeyondSemantic proximity Read

Medical Large Language Models: Methods and ApplicationsSemantic proximity Read