Article

Bioberturk: Exploring Turkish Biomedical Language Model Development Strategies in Low Resource Setting

2022-10-21

Abstract excerpt

Pretrained language models elevated with in-domain corpora show impressive results in biomedicine and clinical NLP tasks in English. However, there is minimal work in low resource languages. Although some pioneering works show promising results, many scenarios still need to be explored to engineer effective pretrained language models in biomedicine for low resource settings. This work introduces the BioBERTurk fam...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: adc342fc-b5e3-5389-a8c0-f22b6e825e21
DOI: 10.21203/rs.3.rs-2165226/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Bioberturk: Exploring Turkish Biomedical Language Model Development Strategies in Low Resource SettingDOI 10.21203/rs.3.rs-2165226/v1Read

Assessing the Impact of Pretraining Domain Relevance on Large Language Models Across Various Pathology Reporting TasksSemantic proximity Read

Predicting Rectal Cancer Patient Survival with Dutch Radiology Reports using Natural Language Processing (NLP): The Role of Pretrained Language ModelsSemantic proximity Read

DrBERT: A Robust Pre-trained Model in French for Biomedical and Clinical domainsSemantic proximity Read

Me-LLaMA: Medical Foundation Large Language Models for Comprehensive Text Analysis and BeyondSemantic proximity Read

Transfer learning with BERT and ClinicalBERT models for multiclass classification of radiology imaging reportsSemantic proximity Read

The Word and the Way: Strategies for Domain-Specific BERT Pre-Training in German Medical NLPSemantic proximity Read

Generalist Large Language Models in a Specialized World: Evidence from the Italian National Medical Education PathwaySemantic proximity Read

Me-LLaMA: Foundation Large Language Models for Medical ApplicationsSemantic proximity Read

Generalist Foundation Models Are Not Clinical Enough for Hospital OperationsSemantic proximity Read

Leveraging Large Language Models for Knowledge-free Weak Supervision in Clinical Natural Language ProcessingSemantic proximity Read

Large Language Models in Portuguese for Healthcare: A Systematic ReviewSemantic proximity Read

A clinical specific BERT developed with huge size of Japanese clinical narrativeSemantic proximity Read