Article

LitGene: a transformer-based model that uses contrastive learning to integrate textual information into gene representations

2024-08-07

Abstract excerpt

Representation learning approaches leverage sequence, expression, and network data, but utilize only a fraction of the rich textual knowledge accumulated in the scientific literature. We present LitGene, an interpretable transformer-based model that refines gene representations by integrating textual information. The model is enhanced through a Contrastive Learning (CL) approach that identifies semantically simila...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 2ca5262d-d289-5d7f-bef3-fa803e3c8f56
DOI: 10.1101/2024.08.07.606674

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

LitGene: a transformer-based model that uses contrastive learning to integrate textual information into gene representationsDOI 10.1101/2024.08.07.606674Read

BioReason-Pro: Advancing Protein Function Prediction with Multimodal Biological ReasoningSemantic proximity Read

The Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human GenomicsSemantic proximity Read

Domain-specific embeddings uncover latent genetics knowledgeSemantic proximity Read

Database-Augmented Transformer-Based Large Language Models Achieve High Accuracy in Mapping Gene-Phenotype RelationshipsSemantic proximity Read

Genomics-FM: Universal Foundation Model for Versatile and Data-Efficient Functional Genomic AnalysisSemantic proximity Read

Benchmarking gene embeddings from sequence, expression, network, and text models for functional prediction tasksSemantic proximity Read

The Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human GenomicsSemantic proximity Read

GeneWalk identifies relevant gene functions for a biological context using network representation learningSemantic proximity Read

Genomic Touchstone: Benchmarking Genomic Language Models in the Context of the Central DogmaSemantic proximity Read

ECLIPSE: Exploration of Complex Ligand-Protein Interactions through Learning from Systems-level Heterogeneous Biomedical Knowledge GraphsSemantic proximity Read

Multimodal Data Integration Improves Disease Risk Prediction in the UK Biobank.Semantic proximity Read

AI and Machine Learning in Biology: From Genes to ProteinsSemantic proximity Read