Article

Fine-tuning Large Language Models for Rare Disease Concept Normalization

2023-12-29

Abstract excerpt

<h4>ABSTRACT</h4> <h4>Objective</h4> We aim to develop a novel method for rare disease concept normalization by fine-tuning Llama 2, an open-source large language model (LLM), using a domain-specific corpus sourced from the Human Phenotype Ontology (HPO). <h4>Methods</h4> We developed an in-house template-based script to generate two corpora for fine-tuning. The first (NAME) contains standardized HPO names, sou...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: d6bc7c15-c5fb-5e0d-8d57-db3f81228f5a
DOI: 10.1101/2023.12.28.573586

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Fine-tuning Large Language Models for Rare Disease Concept NormalizationDOI 10.1101/2023.12.28.573586Read

Fine-tuning large language models for rare disease concept normalization.Semantic proximity Read

A hybrid framework with large language models for rare disease phenotyping.Semantic proximity Read

Genetic Transformer: An Innovative Large Language Model Driven Approach for Rapid and Accurate Identification of Causative Variants in Rare Genetic DiseasesSemantic proximity Read

Systematic benchmarking demonstrates large language models have not reached the diagnostic accuracy of traditional rare-disease decision support toolsSemantic proximity Read

Advancements in Multilingual Biomedical Natural Language Processing: Exploring Large Language Models for Named Entity Recognition and LinkingSemantic proximity Read

Prior Knowledge Shapes Fine-Tuning Success for Biomedical Term NormalizationSemantic proximity Read

Consistent Performance of GPT-4o in Rare Disease Diagnosis Across Nine Languages and 4967 CasesSemantic proximity Read

An Empirical Analysis of Fine-Tuning Large Language Models on Bioinformatics Literature: PRSGPT and BioStarsGPTSemantic proximity Read

Synonym Augmentation for Rare Disease Identification in Unstructured DataSemantic proximity Read

Investigation of synonym expansion and self-alignment pretraining for enhancing Human Phenotype Ontology concept recognition.Semantic proximity Read

Extraction of Human Phenotype Ontology (HPO) Concepts from Clinical Notes Utilizing Large Language Models (LLM) with Model Context Protocol (MCP)Semantic proximity Read

PheNormGPT: a framework for extraction and normalization of key medical findings.Semantic proximity Read