Article

BioToken and BioFM – Biologically-Informed Tokenization Enables Accurate and Efficient Genomic Foundation Models

2025-04-01

Abstract excerpt

Genomic variation underlies human phenotypic diversity, disease susceptibility, and evolutionary adaptation. Although large-scale genomic sequencing has transformed our ability to map genetic variation, accurately modeling and interpreting this data remains a central challenge; while genomic foundation models (GFMs) are a promising approach, they suffer from fundamental limitations. Current GFMs typically treat DN...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 7e1c27c5-6036-5e9d-9fe9-fff6bfca5dd3
DOI: 10.1101/2025.03.27.645711

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

BioToken and BioFM – Biologically-Informed Tokenization Enables Accurate and Efficient Genomic Foundation ModelsDOI 10.1101/2025.03.27.645711Read

Benchmarking DNA Foundation Models for Genomic and Genetic TasksSemantic proximity Read

The Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human GenomicsSemantic proximity Read

The Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human GenomicsSemantic proximity Read

NucEL: Single-Nucleotide ELECTRA-Style Genomic Pre-training for Efficient and Interpretable RepresentationsSemantic proximity Read

VariantFormer: A hierarchical transformer integrating DNA sequences with genetic variations and regulatory landscapes for personalized gene expression predictionSemantic proximity Read

MutBERT: Probabilistic Genome Representation Improves Genomics Foundation ModelsSemantic proximity Read

Mut-BPE: A Modified BPE Strategy Improves Variant Effect PredictionSemantic proximity Read

Genome modeling and design across all domains of life with Evo 2Semantic proximity Read

Tokenization to Transfer: Do Genomic Foundation Models Learn Good Representations?Semantic proximity Read

Genomics-FM: Universal Foundation Model for Versatile and Data-Efficient Functional Genomic AnalysisSemantic proximity Read

Interpretable variant effect prediction from genomic foundation model representationsSemantic proximity Read

Enhancing personalized gene expression prediction from DNA sequences using genomic foundation models.Semantic proximity Read