Article

Generative pretraining from large-scale transcriptomes: Implications for single-cell deciphering and clinical translation

2022-02-02

Abstract excerpt

Exponential accumulation of single-cell transcriptomes poses great challenge for efficient assimilation. Here, we present an approach entitled tGPT towards integration of 22.3 million single-cell transcriptomes by modeling gene expression rankings as generative pretraining task. tGPT is conceptually simple in that it autoregressively models the ranking of a gene in the context of its preceding neighbors. We demo...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 55f17d77-55e4-56de-8a0c-a12865c9f7cc
DOI: 10.1101/2022.01.31.478596

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Generative pretraining from large-scale transcriptomes: Implications for single-cell deciphering and clinical translationDOI 10.1101/2022.01.31.478596Read

scEMB: Learning context representation of genes based on large-scale single-cell transcriptomicsSemantic proximity Read

Learning interpretable cellular and gene signature embeddings from single-cell transcriptomic dataSemantic proximity Read

GeneBag: training a cell foundation model for broad-spectrum cancer diagnosis and prognosis with bulk RNA-seq dataSemantic proximity Read

RegFormer: A Single-Cell Foundation Model Powered by Gene Regulatory HierarchiesSemantic proximity Read

GeneBag: training a cell foundation model for broad-spectrum cancer diagnosis and prognosis with bulk RNA-seq dataSemantic proximity Read

CLOP-DiT: Structured-Metadata-Conditioned Single-Cell Latent Generation via Contrastive Language-Omics Pretraining and Diffusion TransformersSemantic proximity Read

evoCancerGPT: Generating Zero-Shot Single-Cell and Single-Sample Cancer Progression Through Transfer LearningSemantic proximity Read

scLong: A Billion-Parameter Foundation Model for Capturing Long-Range Gene Context in Single-Cell TranscriptomicsSemantic proximity Read

scKEPLM: Knowledge enhanced large-scale pre-trained language model for single-cell transcriptomicsSemantic proximity Read

Learning interpretable cellular and gene signature embeddings from single-cell transcriptomic dataSemantic proximity Read

Scalable batch-correction approach for integrating large-scale single-cell transcriptomesSemantic proximity Read