Article

TabVI: Leveraging Lightweight Transformer Architectures to Learn Biologically Meaningful Cellular Representations

2025-02-17

Abstract excerpt

Transformer-based foundation models are changing the landscape of natural language processing (NLP), computer vision, and audio, achieving human-level performance across a variety of tasks. Extending these models to single-cell genomics holds significant potential for revealing the cellular and molecular perturbations associated with disease. However, unlike the sequential structure of language, the functional org...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 07cc5694-ece7-53ee-881f-cbede94097d6
DOI: 10.1101/2025.02.13.637984

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

TabVI: Leveraging Lightweight Transformer Architectures to Learn Biologically Meaningful Cellular RepresentationsDOI 10.1101/2025.02.13.637984Read

CellFM: a large-scale foundation model pre-trained on transcriptomics of 100 million human cellsSemantic proximity Read

Parameter-free representations outperform single-cell foundation models on downstream benchmarksSemantic proximity Read

A Cross-Species Generative Cell Atlas Across 1.5 Billion Years of Evolution: The TranscriptFormer Single-cell ModelSemantic proximity Read

Tahoe-x1: Scaling Perturbation-Trained Single-Cell Foundation Models to 3 Billion ParametersSemantic proximity Read

Scaling Dense Representations for Single Cell with Transcriptome-Scale ContextSemantic proximity Read

Language may be all omics needs: Harmonizing multimodal data for omics understanding with CellHermesSemantic proximity Read

HoloCell: A Generative Foundation Model for Holistic Cellular ModelingSemantic proximity Read

BIOFORMERS: A SCALABLE FRAMEWORK FOR EXPLORING BIOSTATES USING TRANSFORMERSSemantic proximity Read

scKEPLM: Knowledge enhanced large-scale pre-trained language model for single-cell transcriptomicsSemantic proximity Read

scGenAI: A generative AI platform with biological context embedding of multimodal features enhances single cell state classificationSemantic proximity Read

Large Scale Foundation Model on Single-cell TranscriptomicsSemantic proximity Read

RegFormer: A Single-Cell Foundation Model Powered by Gene Regulatory HierarchiesSemantic proximity Read