Article

RegFormer: A Single-Cell Foundation Model Powered by Gene Regulatory Hierarchies

2025-01-26

Abstract excerpt

Single-cell RNA sequencing (scRNA-seq) enables high-resolution profiling of cellular diversity, but current computational models often fail to incorporate regulatory priors, handle data sparsity, or efficiently process long gene sequences. Here, we present RegFormer, a foundation model that integrates gene regulatory networks (GRNs) with Mamba-based state-space modeling, overcoming the scalability and context-leng...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 3360ae18-efa2-54c1-a1a2-b28e4e874c32
DOI: 10.1101/2025.01.24.634217

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

RegFormer: A Single-Cell Foundation Model Powered by Gene Regulatory HierarchiesDOI 10.1101/2025.01.24.634217Read

scEMB: Learning context representation of genes based on large-scale single-cell transcriptomicsSemantic proximity Read

Regulatory Logic in Larger Single-Cell Foundation Models: A Sparse Autoencoder Comparison of scFoundation and GeneformerSemantic proximity Read

scLong: A Billion-Parameter Foundation Model for Capturing Long-Range Gene Context in Single-Cell TranscriptomicsSemantic proximity Read

GeneBag: training a cell foundation model for broad-spectrum cancer diagnosis and prognosis with bulk RNA-seq dataSemantic proximity Read

Parameter-free representations outperform single-cell foundation models on downstream benchmarksSemantic proximity Read

GRNFormer: Accurate Gene Regulatory Network Inference Using Graph TransformerSemantic proximity Read

scGRIP: a graph-based explainable AI framework for single-cell multi-omics Gene Regulatory Inference with Prior KnowledgeSemantic proximity Read

Population-level comparisons of gene regulatory networks modeled on high-throughput single-cell transcriptomics dataSemantic proximity Read

ChromBERT-tools: A versatile toolkit for context-specific embedding of transcription regulators across different cell typesSemantic proximity Read