Article

BIOFORMERS: A SCALABLE FRAMEWORK FOR EXPLORING BIOSTATES USING TRANSFORMERS

2023-12-01

Abstract excerpt

<h4> A bstract </h4> Generative pre-trained models, such as BERT and GPT, have demonstrated remarkable success in natural language processing and computer vision. Leveraging the combination of large-scale, diverse datasets, transformers, and unsupervised learning, these models have emerged as a promising method for understanding complex systems like language. Despite the apparent differences, human language and...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: fa85ee6a-4b56-59c3-83fb-f181ece80c24
DOI: 10.1101/2023.11.29.569320

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

BIOFORMERS: A SCALABLE FRAMEWORK FOR EXPLORING BIOSTATES USING TRANSFORMERSDOI 10.1101/2023.11.29.569320Read

TabVI: Leveraging Lightweight Transformer Architectures to Learn Biologically Meaningful Cellular RepresentationsSemantic proximity Read

On Using Large Language Models to Understand the Language of LifeSemantic proximity Read

CellFM: a large-scale foundation model pre-trained on transcriptomics of 100 million human cellsSemantic proximity Read

CLOP-DiT: Structured-Metadata-Conditioned Single-Cell Latent Generation via Contrastive Language-Omics Pretraining and Diffusion TransformersSemantic proximity Read

scGenAI: A generative AI platform with biological context embedding of multimodal features enhances single cell state classificationSemantic proximity Read

scGenePT: Is language all you need for modeling single-cell perturbations?Semantic proximity Read

Geometric Representations of Knowledge Inside Biological Large Language Models: an Empirical AnalysisSemantic proximity Read

Large Scale Foundation Model on Single-cell TranscriptomicsSemantic proximity Read

LitGene: a transformer-based model that uses contrastive learning to integrate textual information into gene representationsSemantic proximity Read

Generative genomics accurately predicts future experimental resultsSemantic proximity Read

Generative single-cell transcriptomics via large language modelsSemantic proximity Read

Tokenizing single-cell transcriptomes as a native language for large language modelsSemantic proximity Read