Article

scBERT as a Large-scale Pretrained Deep Language Model for Cell Type Annotation of Single-cell RNA-seq Data

2021-12-07

Abstract excerpt

Annotating cell types based on the single-cell RNA-seq data is a prerequisite for researches on disease progress and tumor microenvironment. Here we show existing annotation methods typically suffer from lack of curated marker gene lists, improper handling of batch effect, and difficulty in leveraging the latent gene-gene interaction information, impairing their generalization and robustness. We developed a pre-tr...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 4d184174-905b-5374-82ac-2baf72d4574d
DOI: 10.1101/2021.12.05.471261

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

scBERT as a Large-scale Pretrained Deep Language Model for Cell Type Annotation of Single-cell RNA-seq DataDOI 10.1101/2021.12.05.471261Read

GeneBag: training a cell foundation model for broad-spectrum cancer diagnosis and prognosis with bulk RNA-seq dataSemantic proximity Read

GeneBag: training a cell foundation model for broad-spectrum cancer diagnosis and prognosis with bulk RNA-seq dataSemantic proximity Read

Scaling cross-tissue single-cell annotation modelsSemantic proximity Read

Learning interpretable cellular and gene signature embeddings from single-cell transcriptomic dataSemantic proximity Read

mcBERT: Patient-Level Single-cell Transcriptomics Data RepresentationSemantic proximity Read

Clinical Phenotype Prediction From Single-cell RNA-seq Data using Attention-Based Neural NetworksSemantic proximity Read

Learning multi-cellular representations of single-cell transcriptomics data enables characterization of patient-level disease statesSemantic proximity Read

Nephrobase Cell+: Multimodal Single-Cell Foundation Model for Decoding Kidney BiologySemantic proximity Read

Reference-free Cell-type Annotation for Single-cell Transcriptomics using Deep Learning with a Weighted Graph Neural NetworkSemantic proximity Read

RegFormer: A Single-Cell Foundation Model Powered by Gene Regulatory HierarchiesSemantic proximity Read

scKEPLM: Knowledge enhanced large-scale pre-trained language model for single-cell transcriptomicsSemantic proximity Read

scLong: A Billion-Parameter Foundation Model for Capturing Long-Range Gene Context in Single-Cell TranscriptomicsSemantic proximity Read