Article

A Comprehensive Benchmark Study on Biomedical Text Generation and Mining with ChatGPT

2023-04-20

Abstract excerpt

In recent years, the development of natural language process (NLP) technologies and deep learning hardware has led to significant improvement in large language models(LLMs). The ChatGPT, the state-of-the-art LLM built on GPT-3.5, shows excellent capabilities in general language understanding and reasoning. Researchers also tested the GPTs on a variety of NLP related tasks and benchmarks and got excellent results....

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 7cbd5720-55ee-5a4d-aa51-38ed8296de7b
DOI: 10.1101/2023.04.19.537463

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

A Comprehensive Benchmark Study on Biomedical Text Generation and Mining with ChatGPTDOI 10.1101/2023.04.19.537463Read

Evaluation of Large Language Model Performance on the Biomedical Language Understanding and Reasoning Benchmark: Comparative StudySemantic proximity Read

GatorTron: A Large Language Model for Clinical Natural Language ProcessingSemantic proximity Read

Me-LLaMA: Medical Foundation Large Language Models for Comprehensive Text Analysis and BeyondSemantic proximity Read

How well it works: Benchmarking performance of GPT models on medical natural language processing tasksSemantic proximity Read

ChatGPT for phenotypes extraction: one model to rule them all?Semantic proximity Read

Large Language Models Are Poor Clinical Decision-Makers: A Comprehensive BenchmarkSemantic proximity Read

Domain-specific LLM Development and Evaluation – A Case-study for Prostate CancerSemantic proximity Read

An evaluation of GPT models for phenotype concept recognition.Semantic proximity Read

Assessing the Statistical Abilities of GPT-4 as a Zero-shot Reasoner: Strengths and WeaknessesSemantic proximity Read

Adapting LLMs for Biomedical Natural Language Processing: A Comprehensive Benchmark Study on Fine-Tuning MethodsSemantic proximity Read

Reasoning Models for Text Mining in Oncology – a Comparison Between o1 Preview and GPT-4oSemantic proximity Read

Large language models are universal biomedical simulatorsSemantic proximity Read