Article

The Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human Genomics

2023-03-21

Abstract excerpt

<title>Abstract</title> <p>Closing the gap between measurable genetic information and observable traits is a longstanding challenge in genomics. Yet, the prediction of molecular phenotypes from DNA sequences alone remains limited and inaccurate, often driven by the scarcity of annotated data and the inability to transfer learnings between prediction tasks. Here, we present an extensive study of foundation models...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 7576388c-d36a-5290-9463-54b46940b546
DOI: 10.21203/rs.3.rs-2644486/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

The Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human GenomicsDOI 10.21203/rs.3.rs-2644486/v1Read

The Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human GenomicsSemantic proximity Read

Enhancing personalized gene expression prediction from DNA sequences using genomic foundation models.Semantic proximity Read

Enhancing Recognition and Interpretation of Functional Phenotypic Sequences through Fine-Tuning Pre-Trained Genomic ModelsSemantic proximity Read

Benchmarking DNA Foundation Models for Genomic and Genetic TasksSemantic proximity Read

BioToken and BioFM – Biologically-Informed Tokenization Enables Accurate and Efficient Genomic Foundation ModelsSemantic proximity Read

Benchmarking DNA Foundation Models for zero-shot variant effect prediction: the role of context, training, and architectureSemantic proximity Read

Benchmarking DNA Sequence Models for Causal Regulatory Variant Prediction in Human GeneticsSemantic proximity Read

AlphaGenome: advancing regulatory variant effect prediction with a unified DNA sequence modelSemantic proximity Read

Interpretable variant effect prediction from genomic foundation model representationsSemantic proximity Read

Systematic Benchmarking of DNA Sequence Encoding Strategies for Predicting Regulatory Effects of Non-Coding SNPs.Semantic proximity Read

MutBERT: Probabilistic Genome Representation Improves Genomics Foundation ModelsSemantic proximity Read

DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genomeSemantic proximity Read