Article

The Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human Genomics

2023-01-15

Abstract excerpt

Closing the gap between measurable genetic information and observable traits is a longstanding challenge in genomics. Yet, the prediction of molecular phenotypes from DNA sequences alone remains limited and inaccurate, often driven by the scarcity of annotated data and the inability to transfer learnings between prediction tasks. Here, we present an extensive study of foundation models pre-trained on DNA sequences...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: b99fe329-20ca-5500-9d2c-103d478a8cf5
DOI: 10.1101/2023.01.11.523679

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

The Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human GenomicsDOI 10.1101/2023.01.11.523679Read

The Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human GenomicsSemantic proximity Read

Enhancing personalized gene expression prediction from DNA sequences using genomic foundation models.Semantic proximity Read

Enhancing Recognition and Interpretation of Functional Phenotypic Sequences through Fine-Tuning Pre-Trained Genomic ModelsSemantic proximity Read

Benchmarking DNA Foundation Models for Genomic and Genetic TasksSemantic proximity Read

BioToken and BioFM – Biologically-Informed Tokenization Enables Accurate and Efficient Genomic Foundation ModelsSemantic proximity Read

Benchmarking DNA Foundation Models for zero-shot variant effect prediction: the role of context, training, and architectureSemantic proximity Read

Benchmarking DNA Sequence Models for Causal Regulatory Variant Prediction in Human GeneticsSemantic proximity Read

Interpretable variant effect prediction from genomic foundation model representationsSemantic proximity Read

Benchmarking DNA Foundation Models for zero-shot variant effect prediction: the role of context, training, and architectureSemantic proximity Read

MutBERT: Probabilistic Genome Representation Improves Genomics Foundation ModelsSemantic proximity Read

Annotating the genome at single-nucleotide resolution with DNA foundation modelsSemantic proximity Read

AlphaGenome: advancing regulatory variant effect prediction with a unified DNA sequence modelSemantic proximity Read