Article

DNA Compression with Genomic Language Models: Tokenization, Benchmarking, and an Information-Content Map

2026-06-12

Abstract excerpt

Lossless compression and probabilistic sequence modeling are two faces of the same coin: a model that assigns high probability to a sequence can encode it in few bits via arithmetic coding. We exploit this duality to evaluate genomic language models as compressors of DNA, using compression primarily as an objective probe of generative sequence modeling rather than as a deployable storage system. We release DNAGPT2...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 4ec83410-049c-506a-8ab2-763339980a2e
DOI: 10.64898/2026.06.10.731316

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

DNA Compression with Genomic Language Models: Tokenization, Benchmarking, and an Information-Content MapDOI 10.64898/2026.06.10.731316Read

In-Context Learning in Genomic Language Models as a Biological Evaluation TaskSemantic proximity Read

NucEL: Single-Nucleotide ELECTRA-Style Genomic Pre-training for Efficient and Interpretable RepresentationsSemantic proximity Read

Tokenization to Transfer: Do Genomic Foundation Models Learn Good Representations?Semantic proximity Read

Genomic Touchstone: Benchmarking Genomic Language Models in the Context of the Central DogmaSemantic proximity Read

<i>genomicBERT</i> : A Light-weight Foundation Model for Genome Analysis using Unigram Tokenization and Specialized DNA VocabularySemantic proximity Read

Mut-BPE: A Modified BPE Strategy Improves Variant Effect PredictionSemantic proximity Read

Understanding Pathways in Bioinformatics, Genomics, and Health ApplicationsSemantic proximity Read

The human genome’s vocabulary as proposed by the DNA language model GROVERSemantic proximity Read

MINA: linear probes reveal coding-sequence family signal in frozen DNA encoders up to protein compositionSemantic proximity Read

GeneCodeq: quality score compression and improved genotyping using a Bayesian framework.Semantic proximity Read

Benchmarking DNA Foundation Models for Genomic and Genetic TasksSemantic proximity Read

A Benchmark of Evo2 Genomic AI Models for Efficient and Practical DeploymentSemantic proximity Read