Article

How well it works: Benchmarking performance of GPT models on medical natural language processing tasks

2024-06-12

Abstract excerpt

<h4>Importance</h4> The ability of large language models (LLMs) to generate high-quality, human-like text has been accompanied with speculation about their application in healthcare, alongside ethical and safety concerns. <h4>Objective</h4> Evaluate LLM performance on medical natural language processing (NLP) tasks, benchmarked against other commercially available tools. <h4>Design</h4> Observational study to eval...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: a9f9c763-8a36-5cbc-a632-7d1bf532bd5d
DOI: 10.1101/2024.06.10.24308699

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

How well it works: Benchmarking performance of GPT models on medical natural language processing tasksDOI 10.1101/2024.06.10.24308699Read

Evaluation of Large Language Model Performance on the Biomedical Language Understanding and Reasoning Benchmark: Comparative StudySemantic proximity Read

Developing an open-source framework for LLM evaluation of patients using EHR clinical documentation; performance of LLMs relative to medical professionalsSemantic proximity Read

A Systematic Review of Large Language Models in Medical Specialties: Applications, Challenges and Future DirectionsSemantic proximity Read

CLEVER: Clinical Large Language Model Evaluationby Expert ReviewSemantic proximity Read

The Transformative Potential of Large Language Models in Mining Electronic Health Records DataSemantic proximity Read

Auditing frontier general-purpose large language models in biomedical tasks: reasoning gains, extraction limits, and benchmark reliabilitySemantic proximity Read

irAE-GPT: Leveraging large language models to identify immune-related adverse events in electronic health records and clinical trial datasetsSemantic proximity Read

A Systematic Review of Testing and Evaluation of Healthcare Applications of Large Language Models (LLMs)Semantic proximity Read

Large Language Models in Healthcare Current Development and Future DirectionsSemantic proximity Read

Testing and Evaluation of Generative Large Language Models in Electronic Health Record Applications: A Systematic ReviewSemantic proximity Read

Leveraging Large Language Models on Automating Outpatients’ Message Classifications of Electronic Medical RecordsSemantic proximity Read

FHIR-GPT Enhances Health Interoperability with Large Language ModelsSemantic proximity Read