Article

A large-scale foundation model for bulk transcriptomes

2025-06-17

Abstract excerpt

Large language models (LLMs) have emerged as powerful foundation models leading to breakthroughs in transcriptome analysis. However, current RNA-seq foundation models are exclusively pretrained on sparse single-cell RNA-seq (scRNA-seq) data, which typically detects only ∼3000 genes per cell. This thus creates a critical gap in models specifically designed for bulk transcriptomes, a fundamentally different modality...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: ec765827-1ec5-58fc-9d79-924a6cf83b9f
DOI: 10.1101/2025.06.11.659222

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

A large-scale foundation model for bulk transcriptomesDOI 10.1101/2025.06.11.659222Read

Large Scale Foundation Model on Single-cell TranscriptomicsSemantic proximity Read

scLong: A Billion-Parameter Foundation Model for Capturing Long-Range Gene Context in Single-Cell TranscriptomicsSemantic proximity Read

scLong: A Billion-Parameter Foundation Model for Capturing Long-Range Gene Context in Single-Cell TranscriptomicsSemantic proximity Read

scKEPLM: Knowledge enhanced large-scale pre-trained language model for single-cell transcriptomicsSemantic proximity Read

CellTosg2Sequence: A Unified Text-Omics-Signaling-Graph Large Language Model for Single-Cell AnalysisSemantic proximity Read

RegFormer: A Single-Cell Foundation Model Powered by Gene Regulatory HierarchiesSemantic proximity Read

scEMB: Learning context representation of genes based on large-scale single-cell transcriptomicsSemantic proximity Read

CellFM: a large-scale foundation model pre-trained on transcriptomics of 100 million human cellsSemantic proximity Read

VariantFormer: A hierarchical transformer integrating DNA sequences with genetic variations and regulatory landscapes for personalized gene expression predictionSemantic proximity Read

Language may be all omics needs: Harmonizing multimodal data for omics understanding with CellHermesSemantic proximity Read

Beyond Annotation: Leveraging Raw RNA-seq Reads via Foundation Models for Multi-Cancer Early DetectionSemantic proximity Read

Regulatory Logic in Larger Single-Cell Foundation Models: A Sparse Autoencoder Comparison of scFoundation and GeneformerSemantic proximity Read