Article

GatorTron: A Large Language Model for Clinical Natural Language Processing

2022-02-28

Abstract excerpt

<h4>ABSTRACT</h4> <h4>Objective</h4> To develop a large pretrained clinical language model from scratch using transformer architecture; systematically examine how transformer models of different sizes could help 5 clinical natural language processing (NLP) tasks at different linguistic levels. <h4>Methods</h4> We created a large corpus with >90 billion words from clinical narratives (>82 billion words), scienti...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 51962d8b-6f89-548c-a533-306fb7927b29
DOI: 10.1101/2022.02.27.22271257

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

GatorTron: A Large Language Model for Clinical Natural Language ProcessingDOI 10.1101/2022.02.27.22271257Read

Evaluation of Large Language Model Performance on the Biomedical Language Understanding and Reasoning Benchmark: Comparative StudySemantic proximity Read

Developing a natural language processing system using transformer-based models for adverse drug event detection in electronic health recordsSemantic proximity Read

Generalist Foundation Models Are Not Clinical Enough for Hospital OperationsSemantic proximity Read

Large-Scale Psychiatric Concept Extraction from Electronic Health Records: A Comparative Study of Encoder-Based Language ModelsSemantic proximity Read

Improving clinical expertise in large language models using electronic medical recordsSemantic proximity Read

The Word and the Way: Strategies for Domain-Specific BERT Pre-Training in German Medical NLPSemantic proximity Read

Me-LLaMA: Medical Foundation Large Language Models for Comprehensive Text Analysis and BeyondSemantic proximity Read

MIRACLE - Medical Information Retrieval using Clinical Language Embeddings for Retrieval Augmented Generation at the point of careSemantic proximity Read

CLEVER: Clinical Large Language Model Evaluationby Expert ReviewSemantic proximity Read

How well it works: Benchmarking performance of GPT models on medical natural language processing tasksSemantic proximity Read

A Comprehensive Benchmark Study on Biomedical Text Generation and Mining with ChatGPTSemantic proximity Read

Schema-Grounded Multitask Instruction Fine-tuning for Joint Biomedical Named Entity Recognition and Relation Extraction in PharmacovigilanceSemantic proximity Read