Overview of Evolutionary Scale Modeling (ESM) models
mainThe ESM repository provides Transformer-based protein language models developed by Meta FAIR. These models are designed for various protein-related tasks including structure prediction, functional property prediction, and sequence design.
Key model families include:
- ESM-2: State-of-the-art (SOTA) general-purpose protein language models used for predicting structure, function, and other properties from single sequences.
- ESMFold: An end-to-end model that generates accurate 3D protein structures directly from a sequence by leveraging ESM-2.
- MSA Transformer (ESM-MSA-1b): A model designed to extract embeddings from Multiple Sequence Alignments (MSAs), enabling high-performance structure inference.
- ESM-1v: A specialized model for zero-shot prediction of the functional effects of sequence variations (variant effects).
- ESM-IF1: An inverse folding model used for fixed-backbone sequence design or predicting the effects of variations on a given structure.