Article

Scaling Dense Representations for Single Cell with Transcriptome-Scale Context

2024-12-03

Abstract excerpt

Developing a unified model of cellular systems is a canonical challenge in biology. Recently, a wealth of public single-cell RNA sequencing data as well as rapid scaling of self-supervised learning methods have provided new avenues to address this longstanding challenge. However, rapid parameter scaling has been essential to the success of large language models in text and images, while similar scaling has not bee...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 3c76083f-56be-5460-8a51-462140041358
DOI: 10.1101/2024.11.28.625303

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Scaling Dense Representations for Single Cell with Transcriptome-Scale ContextDOI 10.1101/2024.11.28.625303Read

CellFM: a large-scale foundation model pre-trained on transcriptomics of 100 million human cellsSemantic proximity Read

scLong: A Billion-Parameter Foundation Model for Capturing Long-Range Gene Context in Single-Cell TranscriptomicsSemantic proximity Read

scLong: A Billion-Parameter Foundation Model for Capturing Long-Range Gene Context in Single-Cell TranscriptomicsSemantic proximity Read

Benchmarking single-cell foundation models in a zero-shot settingSemantic proximity Read

Tahoe-x1: Scaling Perturbation-Trained Single-Cell Foundation Models to 3 Billion ParametersSemantic proximity Read

GeneBag: training a cell foundation model for broad-spectrum cancer diagnosis and prognosis with bulk RNA-seq dataSemantic proximity Read

RegFormer: A Single-Cell Foundation Model Powered by Gene Regulatory HierarchiesSemantic proximity Read

scKEPLM: Knowledge enhanced large-scale pre-trained language model for single-cell transcriptomicsSemantic proximity Read

scEMB: Learning context representation of genes based on large-scale single-cell transcriptomicsSemantic proximity Read

Large Scale Foundation Model on Single-cell TranscriptomicsSemantic proximity Read

GeneBag: training a cell foundation model for broad-spectrum cancer diagnosis and prognosis with bulk RNA-seq dataSemantic proximity Read

EpiAgent: Foundation model for single-cell epigenomic dataSemantic proximity Read