Article

Reliability of large language model knowledge across brand and generic cancer drug names

2024-11-08

Abstract excerpt

<h4>Purpose</h4> To evaluate the performance and consistency of large language models (LLMs) across brand and generic oncology drug names in various clinical tasks, addressing concerns about potential fluctuations in LLM performance due to subtle phrasing differences that could impact patient care. <h4>Methods</h4> This study evaluated three LLMs (GPT-3.5-turbo-0125, GPT-4-turbo, and GPT-4o) using drug names fro...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: d3db216f-9bec-51df-a084-f00db66f2d5e
DOI: 10.1101/2024.11.08.24316949

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Reliability of large language model knowledge across brand and generic cancer drug namesDOI 10.1101/2024.11.08.24316949Read

Rx-LLM: a benchmarking suite to evaluate safe large language model performance for medication-related tasksSemantic proximity Read

Development and Testing of a Novel Large Language Model-Based Clinical Decision Support Systems for Medication Safety in 12 Clinical SpecialtiesSemantic proximity Read

Development and validation of a generative AI-assisted medication-indication knowledge baseSemantic proximity Read

Retrieval-Augmented Large Language Models for Clinically Aligned Adverse Event Coding in Acute Myeloid Leukemia Clinical TrialsSemantic proximity Read

Relationship Extraction for Adverse Drug Events in Clinical Notes Using Large Language ModelsSemantic proximity Read

irAE-GPT: Leveraging large language models to identify immune-related adverse events in electronic health records and clinical trial datasetsSemantic proximity Read

A Three-Tier Operational Benchmark for Evaluating Large Language Models on Hospital Medication SafetySemantic proximity Read

The TRIPOD-LLM Statement: A Targeted Guideline For Reporting Large Language Models UseSemantic proximity Read

Large language models to help appeal denied radiotherapy servicesSemantic proximity Read

Fine-tuning Large Language Models for Rare Disease Concept NormalizationSemantic proximity Read

Drug or Pokémon? Large language model performance in identification of fabricated medicationsSemantic proximity Read

Large language models management of complex medication regimens: a case-based evaluationSemantic proximity Read