Article

MutBERT: Probabilistic Genome Representation Improves Genomics Foundation Models

2025-01-25

Abstract excerpt

<h4>Motivation</h4> Understanding the genomic foundation of human diversity and disease requires models that effectively capture sequence variation, such as single nucleotide polymorphisms (SNPs). While recent genomic foundation models have scaled to larger datasets and multi-species inputs, they often fail to account for the sparsity and redundancy inherent in human population data, such as those in the 1000 Gen...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: e7f0a557-c742-56f1-8b71-4dddbb1b8bef
DOI: 10.1101/2025.01.23.634452

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

MutBERT: Probabilistic Genome Representation Improves Genomics Foundation ModelsDOI 10.1101/2025.01.23.634452Read

Towards a universal foundation model for biobank-scale human genome variationSemantic proximity Read

Towards a universal foundation model for biobank-scale human genome variationSemantic proximity Read

The Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human GenomicsSemantic proximity Read

The Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human GenomicsSemantic proximity Read

BioToken and BioFM – Biologically-Informed Tokenization Enables Accurate and Efficient Genomic Foundation ModelsSemantic proximity Read

GPN-MSA: an alignment-based DNA language model for genome-wide variant effect predictionSemantic proximity Read

Benchmarking DNA Foundation Models for Genomic and Genetic TasksSemantic proximity Read

Genomic Touchstone: Benchmarking Genomic Language Models in the Context of the Central DogmaSemantic proximity Read

Benchmarking DNA Foundation Models for zero-shot variant effect prediction: the role of context, training, and architectureSemantic proximity Read

Generative haplotype prediction outperforms statistical methods for small variant detection in next-generation sequencing data.Semantic proximity Read

NucEL: Single-Nucleotide ELECTRA-Style Genomic Pre-training for Efficient and Interpretable RepresentationsSemantic proximity Read

Large Language Model as a Promising Framework for the Complete Clinical Interpretation of Human Genetic VariantsSemantic proximity Read