Article

In-Context Learning in Genomic Language Models as a Biological Evaluation Task

2025-12-09

Abstract excerpt

<title>Abstract</title> <p>We study whether base (non-instruction-tuned) genomic language models (gLMs) exhibit in-context learning (ICL) on DNA. Using an adapted NanoGPT trained on multiple Escherichia coli references with BPEtokenization, we frame promoter completion as a genomic ICL task:a 1,000bp upstream context (prompt) conditions autoregressive generation of downstream bases. We introduce an intrinsic eval...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: c143e7b3-dad6-5b6b-a9c6-2fa086f33939
DOI: 10.21203/rs.3.rs-8287395/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

In-Context Learning in Genomic Language Models as a Biological Evaluation TaskDOI 10.21203/rs.3.rs-8287395/v1Read

DNA Compression with Genomic Language Models: Tokenization, Benchmarking, and an Information-Content MapSemantic proximity Read

PlasmidLM: A Promptable DNA Language Model via Verifiable-Reward Post-TrainingSemantic proximity Read

NucEL: Single-Nucleotide ELECTRA-Style Genomic Pre-training for Efficient and Interpretable RepresentationsSemantic proximity Read

Genomic Touchstone: Benchmarking Genomic Language Models in the Context of the Central DogmaSemantic proximity Read

CENO: A Genome-Scale World Model for Evolutionary Sequence Interpretation and Programmable Regulatory DesignSemantic proximity Read

DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genomeSemantic proximity Read

<i>genomicBERT</i> : A Light-weight Foundation Model for Genome Analysis using Unigram Tokenization and Specialized DNA VocabularySemantic proximity Read

The human genome’s vocabulary as proposed by the DNA language model GROVERSemantic proximity Read

Distinguishing word identity and sequence context in DNA language modelsSemantic proximity Read

Tokenization to Transfer: Do Genomic Foundation Models Learn Good Representations?Semantic proximity Read

Benchmarking DNA Foundation Models for Genomic and Genetic TasksSemantic proximity Read

Findings from Sparse Autoencoders for DNA Sequence Models: Motif Detectors, Reading-Frame Features, and the Scarcity of Regulatory LogicSemantic proximity Read