Article

Mixture of Experts Enable Efficient and Effective Protein Understanding and Design

2024-12-03

Abstract excerpt

Proteins play a fundamental role in life. Understanding the language of proteins offers significant potential for gaining mechanistic insights into biological systems and introduces new avenues for treating diseases, enhancing agriculture, and safeguarding the environment. While large protein language models (PLMs) like ESM2-15B and xTrimoPGLM-100B have achieved remarkable performance in diverse protein understand...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 82b74a1f-6c02-5ba4-8642-9dacd9fa43a5
DOI: 10.1101/2024.11.29.625425

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Mixture of Experts Enable Efficient and Effective Protein Understanding and DesignDOI 10.1101/2024.11.29.625425Read

InstructPLM: Aligning Protein Language Models to Follow Protein Structure InstructionsSemantic proximity Read

Pretrained protein language models choose between sequence novelty and structural completenessSemantic proximity Read

InterPLM: Discovering Interpretable Features in Protein Language Models via Sparse AutoencodersSemantic proximity Read

Pool PaRTI: A PageRank-Based Pooling Method for Identifying Critical Residues and Enhancing Protein Sequence RepresentationsSemantic proximity Read

InstructPLM: Aligning Protein Language Models to Follow Protein Structure InstructionsSemantic proximity Read

Contrasting Sequence with Structure: Pre-training Graph Representations with PLMsSemantic proximity Read

TRILL: Orchestrating Modular Deep-Learning Workflows for Democratized, Scalable Protein Analysis and EngineeringSemantic proximity Read

ProtSyntax: a protein large language model for decoding post-translational modification syntax and functionSemantic proximity Read

ProtSyntax: a protein large language model for decoding post-translational modification syntax and functionSemantic proximity Read

Adapting protein language models for structure-conditioned designSemantic proximity Read

Rapid and Reproducible Multimodal Biological Foundation Model Development with AIDO.ModelGeneratorSemantic proximity Read

Paying Attention to Attention: High Attention Sites as Indicators of Protein Family and Function in Language ModelsSemantic proximity Read