Article

A foundation language model to decipher diverse regulation of RNAs

2024-10-13

Abstract excerpt

RNA metabolism is tightly regulated by cis -elements and trans -acting factors. Most information guiding such regulation is encoded in RNA sequences. Considering the similarities in semantic and syntactic features between RNAs and human language, we developed LAMAR, a transformer-based foundation la nguage m odel for RN A r egulation, to decipher general rules underlying RNA processing. The model was pretrain...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: eb54d27e-0901-5d2a-97a2-e97bc09f1527
DOI: 10.1101/2024.10.12.617732

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

A foundation language model to decipher diverse regulation of RNAsDOI 10.1101/2024.10.12.617732Read

Deciphering 3’ UTR mediated gene regulation using interpretable deep representation learningSemantic proximity Read

BEACON: Benchmark for Comprehensive RNA Tasks and Language ModelsSemantic proximity Read

CellFM: a large-scale foundation model pre-trained on transcriptomics of 100 million human cellsSemantic proximity Read

Decoding the RNA binding systems by UltraGenSemantic proximity Read

Perturbation-aware predictive modeling of RNA splicing using bidirectional transformersSemantic proximity Read

Analysis of RNA translation with a deep learning architecture provides new insight into translation controlSemantic proximity Read

Deep generative models generate mRNA sequences with enhanced translation capacity and stabilitySemantic proximity Read

DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genomeSemantic proximity Read

Large Scale Foundation Model on Single-cell TranscriptomicsSemantic proximity Read

Natural language-based representation and modeling of RBP bindingSemantic proximity Read

RNA language models predict mutations that improve RNA function.Semantic proximity Read

Deep learning modeling of ribosome profiling reveals regulatory underpinnings of translatome and interprets disease variantsSemantic proximity Read