Article

A clinical specific BERT developed with huge size of Japanese clinical narrative

2020-07-09

Abstract excerpt

Generalized language models that pre-trained with a large corpus have achieved great performance on natural language tasks. While many pre-trained transformers for English are published, few models are available for Japanese text, especially in clinical medicine. In this work, we demonstrate a development of a clinical specific BERT model with a huge size of Japanese clinical narrative and evaluated it on the NTCI...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 9e094437-9d98-5e8f-b0ce-26a0cad0d659
DOI: 10.1101/2020.07.07.20148585

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

A clinical specific BERT developed with huge size of Japanese clinical narrativeDOI 10.1101/2020.07.07.20148585Read

Me-LLaMA: Medical Foundation Large Language Models for Comprehensive Text Analysis and BeyondSemantic proximity Read

MulMed: Addressing Multiple Medical Tasks Utilizing Large Language ModelsSemantic proximity Read

Me-LLaMA: Foundation Large Language Models for Medical ApplicationsSemantic proximity Read

Bioberturk: Exploring Turkish Biomedical Language Model Development Strategies in Low Resource SettingSemantic proximity Read

Large Language Models in Healthcare Current Development and Future DirectionsSemantic proximity Read

Leveraging Large Language Models for Knowledge-free Weak Supervision in Clinical Natural Language ProcessingSemantic proximity Read

The Word and the Way: Strategies for Domain-Specific BERT Pre-Training in German Medical NLPSemantic proximity Read

Enhancing Medical Knowledge in Large Language Models via Supervised Continued Pretraining on Clinical NotesSemantic proximity Read

Towards More Generalizable and Accurate Sentence Classification in Medical Abstracts with Less DataSemantic proximity Read

Large Language Models Are Poor Clinical Decision-Makers: A Comprehensive BenchmarkSemantic proximity Read

Improving clinical expertise in large language models using electronic medical recordsSemantic proximity Read

GatorTron: A Large Language Model for Clinical Natural Language ProcessingSemantic proximity Read