Article

Towards a universal foundation model for biobank-scale human genome variation

2025-11-11

Abstract excerpt

<title>Abstract</title> <p> Millions of human genomes have been genotyped by national biobanks worldwide. Training large language models (LLM) with this data may lead to a universal model of human genome with tremendous potential. Yet the quadrillions (10 <sup>15</sup> ) of nucleotides—resulting from genome length multiplied by population size—pose formidable challenges for modeling. In this study, we propose...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 22fe1523-637b-5164-b6ed-bf106257a2ad
DOI: 10.21203/rs.3.rs-7855919/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Towards a universal foundation model for biobank-scale human genome variationDOI 10.21203/rs.3.rs-7855919/v1Read

Towards a universal foundation model for biobank-scale human genome variationSemantic proximity Read

SNPBag: a foundation model for multitask genome-scale SNP analysisSemantic proximity Read

MutBERT: Probabilistic Genome Representation Improves Genomics Foundation ModelsSemantic proximity Read

The Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human GenomicsSemantic proximity Read

The Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human GenomicsSemantic proximity Read

Benchmarking DNA Foundation Models for Genomic and Genetic TasksSemantic proximity Read

BioToken and BioFM – Biologically-Informed Tokenization Enables Accurate and Efficient Genomic Foundation ModelsSemantic proximity Read

ATLAS: Population-Level Disease Locus Discovery via Differential Attention in Genomic Language ModelsSemantic proximity Read

Predicting functional constraints across evolutionary timescales with phylogeny-informed genomic language modelsSemantic proximity Read

Tokenization to Transfer: Do Genomic Foundation Models Learn Good Representations?Semantic proximity Read

Bridging Ancestry Gaps in Genomic Risk Prediction with Tabular Foundation ModelsSemantic proximity Read

VariantFormer: A hierarchical transformer integrating DNA sequences with genetic variations and regulatory landscapes for personalized gene expression predictionSemantic proximity Read