Article

Benchmarking Large Language Models for Replication of Guideline-Based PGx Recommendations

2025-05-15

Abstract excerpt

<title>Abstract</title> <p>We evaluated the ability of large language models (LLMs) to generate clinically accurate pharmacogenomic (PGx) recommendations aligned with CPIC guidelines. Using a benchmark of 599 curated gene–drug–phenotype scenarios, we compared five leading models, including GPT-4o and fine-tuned LLaMA variants, through both standard lexical metrics and a novel semantic evaluation framework (LLM Sc...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: e6fd0a80-a360-5033-9032-867862e5fb16
DOI: 10.21203/rs.3.rs-6630450/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Benchmarking Large Language Models for Replication of Guideline-Based PGx RecommendationsDOI 10.21203/rs.3.rs-6630450/v1Read

PGxRAG: A Retrieval Augmented Generation supported Pharmacogenomics AssistantSemantic proximity Read

Interpretable Fine-tuned Large Language Models Facilitate Making Genetic Test Decisions for Rare DiseasesSemantic proximity Read

Performance Characteristics of Reasoning Large Language Models for Evidence Extraction from Clinical Genomics LiteratureSemantic proximity Read

Searching the Druggable Genome using Large Language ModelsSemantic proximity Read

Rx-LLM: a benchmarking suite to evaluate safe large language model performance for medication-related tasksSemantic proximity Read

An Empirical Analysis of Fine-Tuning Large Language Models on Bioinformatics Literature: PRSGPT and BioStarsGPTSemantic proximity Read

Using Large Language Models to Assemble, Audit, and Prioritize the Therapeutic LandscapeSemantic proximity Read

Large Language Models Facilitate the Generation of Electronic Health Record Phenotyping AlgorithmsSemantic proximity Read

Generation of guideline-based clinical decision trees in oncology using large language modelsSemantic proximity Read

MRQC-LLM: A Novel Large Language Model Framework for Enhancing Medical Record Quality ControlSemantic proximity Read

Ophtimus-V2-Tx: A Compact Domain-Specific LLM for Ophthalmic Diagnosis and Treatment PlanningSemantic proximity Read

Assessing the utility of large language models for phenotype-driven gene prioritization in the diagnosis of rare genetic disease.Semantic proximity Read