Article

Gene-language models are whole genome representation learners

2024-03-19

Abstract excerpt

The language of genetic code embodies a complex grammar and rich syntax of interacting molecular elements. Recent advances in self-supervision and feature learning suggest that statistical learning techniques can identify high-quality quantitative representations from inherent semantic structure. We present a gene-based language model that generates whole-genome vector representations from a population of 16 disea...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 12427df7-c12f-5c0b-9e05-760579b01a11
DOI: 10.1101/2024.03.18.585642

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Gene-language models are whole genome representation learnersDOI 10.1101/2024.03.18.585642Read

Genos-m: a foundation model for human-associated microbial genomesSemantic proximity Read

ProkBERT Family: Genomic Language Models for Microbiome ApplicationsSemantic proximity Read

LAMBDA: A Prophage Detection Benchmark for Genomic Language ModelsSemantic proximity Read

DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genomeSemantic proximity Read

SAP: Synteny-aware gene function prediction for bacteria using protein embeddingsSemantic proximity Read

MetagenBERT: a Transformer Architecture using Foundational DNA Read Embedding Models to enhance Disease ClassificationSemantic proximity Read

GUANinE v1.1 Reveals Complementarity of Supervised and Genomic Language ModelsSemantic proximity Read

Integrating natural language processing and genome analysis enables accurate bacterial phenotype predictionSemantic proximity Read

METAGENE-1: Metagenomic Foundation Model for Pandemic MonitoringSemantic proximity Read

Towards AI-designed genomes using a variational autoencoderSemantic proximity Read

Learning a deep language model for microbiomes: the power of large scale unlabeled microbiome dataSemantic proximity Read

MicroGenomer: A Foundation Model for Transferable Microbial Genome Representations Enabling Multi-scale Genomic Understanding and Ecophysiological Trait PredictionSemantic proximity Read