Article

METAGENE-1: Metagenomic Foundation Model for Pandemic Monitoring

2025-01-12

Abstract excerpt

We pretrain METAGENE-1, a 7-billion-parameter autoregressive transformer model, which we refer to as a _metagenomic foundation model_, on a novel corpus of diverse metagenomic DNA and RNA sequences comprising over 1.5 trillion base pairs. This dataset is sourced from a large collection of human wastewater samples, processed and sequenced using deep metagenomic (next-generation) sequencing methods. Unlike genomic m...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: c87e797f-7ad8-5a5a-bd9a-c4aefe138f41
DOI: 10.32388/fmepo7

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

METAGENE-1: Metagenomic Foundation Model for Pandemic MonitoringDOI 10.32388/fmepo7Read

Genos-m: a foundation model for human-associated microbial genomesSemantic proximity Read

Benchmarking DNA Foundation Models for Genomic and Genetic TasksSemantic proximity Read

Genomic Touchstone: Benchmarking Genomic Language Models in the Context of the Central DogmaSemantic proximity Read

Influ-BERT: A Domain-Adaptive Genomic Language Model for Advancing Influenza A Virus ResearchSemantic proximity Read

ProkBERT Family: Genomic Language Models for Microbiome ApplicationsSemantic proximity Read

Construction and validation of a phenotypic prediction model for bacterial gentamicin resistance using deep learning with gene sequences.Semantic proximity Read

NucEL: Single-Nucleotide ELECTRA-Style Genomic Pre-training for Efficient and Interpretable RepresentationsSemantic proximity Read

Towards end-to-end disease prediction from raw metagenomic dataSemantic proximity Read

Transformer-based deep learning for multiclass viral classification in metagenomic sequencingSemantic proximity Read

Tokenization to Transfer: Do Genomic Foundation Models Learn Good Representations?Semantic proximity Read

Deep learning methods in metagenomics: a reviewSemantic proximity Read

Distinguishing word identity and sequence context in DNA language modelsSemantic proximity Read