AlphaBind, a deep learning model designed to optimize antibody sequences, by leveraging large-scale pre-trained affinity datasets and fine-tuning on experimental data.
AlphaBind was pre-trained on a dataset of 7.5 million antibody-antigen affinity measurements, which includes data from yeast display systems and diverse antibody libraries obtained from multiple experimental sources, focusing on quantitative affinity measurements.
The model utilizes transformer-based architecture with protein sequence embeddings generated using ESM-2nv (Evolutionary Scale Model) embeddings. The model consists of 4 attention heads, 7 layers, and about 15 million parameters.
The model fine-tunes on specific antibody-antigen systems using AlphaSeq data, then performs stochastic greedy optimization by generating sequence mutations (using ESM-2nv logits) to explore sequence space and predict binding affinity. This process generates thousands of candidate sequences, which are filtered based on affinity predictions and developability metrics before in vitro validation.
The novel sequences based on three systems were verified in experimentally.
The method projects the epitope and paratope onto 2D images and then uses a ResNET to predict the interacting vs non-interacting pairs.
Negative set was done by pairing non-cognate antibody-antigen pairs, rotations etc.
The method was not benchmarked against epitope predictions tools, that arguably do not take pairs into account, but against docking tools, scoring 13 out of 18 methods tested.
Pilot single-shot computational antibody design, where known binders were taken and new ones computationally generated on their basis, maintaining binding with a good developability profile.
The pipeline starts with known binders to the SARS-CoV-2 RBD
Novel binders were generated using a combination of computational approaches, including: Observed Antibody Space (OAS): Paired and unpaired sequences from the OAS dataset to identify antibody candidates within a certain edit distance from the starting antibodies. Inverse Folding Model (AbMPNN):generated new antibody sequences maintaining structural features compatible with binding to the SARS-CoV-2 RBD. ESM: guided the mutation of sequences to retain or improve binding affinity while enhancing developability.
The developability properties were assessed using Rosetta scoring to evaluate antibody stability and interface energetics, alongside TAP.
Experimental methods for screening included size-exclusion chromatography (SEC) to assess aggregation propensity and differential scanning fluorimetry (DSF) for thermal stability. Antibodies that passed these criteria were deemed suitable for development.
Success rate of the method: The pipeline demonstrated a success rate of 54% for generating binding antibodies that retained affinity against escape mutations on the SARS-CoV-2 RBD.
Authors tested RFDiffusion for the design task but with poor success rate - albeit not the antibody-fine tuned version it appears, that should work better.
Study evaluates a number of generative models on datasets of antibodies with reported affinities.
The methods tested were: MEAN, dyMEAN, IgBLEND, Ablang, Ablang2, AntiBerty, ESM, Antifold, ESM-IF, AbX, Diffab + their own version of Diffab.
Datasets used were the Absci HER2 datasets (100s of binders) and a number of datasets with tens of binders each.
All models have some correlation with the affinity data, though weak.
Adding epitope information is not a game changer, showing that information that is mostly captured is fitness of antibody first and antigen second, if at all.
Employing structural information helps as compared to purely sequence approaches.
GearBind - Novel framework to predict the effect of mutations on an antibody-antigen complex
The architecture is graph-based, trained in a contrastive fashion on real atoms and their surroundings versus randomly samples (from rotamer libraries) atoms within the same environment. They use the real proteins from CATH for this purpose. The random points are serving as ‘negatives’ for contrastive learning whereas the real ones as positives.
The method shows improvement on previous datasets: SKEMPI and the Absci HER2 dataset.
The authors demonstrated the effectiveness of the method by performing in silico affinity maturation on two existing binders.
Novel language model incorporating structural information, with demonstrated experimental ability to improve design of therapeutic antibodies.
The new language model, ProseLM, builds upon Progen family of models from the same authors.
Structural information in the form of structural adapter layers after language model layers, encoding backbone and associated functional annotations.
Models with more parameters achieve much better perplexity. There is also some improvement by adding tangential context information such as ligands etc.
They trained an antibody-specific version of ProseLM, only on SABDAB data and it does much better on sequence recovery even than the larger models.
They use the model to propose mutations for Nivolumab ad Secukinumab, with mutations both in CDRs and Frameworks. THey used structures from the PDB as the basis for designs.
They found better binders, however if CDRs were re-designed the overall success rate of maintaining binding was lower (25% for Nivolumab) than when frameworks were redesigned (92%).
An active learning framework is proposed to efficiently identify antibody mutations that enhance binding affinity, minimizing wet-lab experiments.
From the paper: “Active learning is a framework from experimental design that focuses on making informed decisions about which experiments to perform next”. That’s important these days to effectively generate prediction first data to maximize the effectiveness of models.
Bayesian optimization is used with relative binding free energy (RBFE) methods to iteratively propose and evaluate new antibody sequences, improving binding affinity predictions.
Various encoding schemes, including one-hot, bag of amino acids, BLOSUM, and AbLang2, are tested. The best performing methods are identified through validation with pre-computed data.
The study uses two RBFE methods: NQFEP for accurate but costly simulations, and Schrödinger Res Scan for faster but less precise results. The active learning loop consistently finds better binding sequences using these methods.
AbLang2 encoding with the Tanimoto kernel consistently outperformed other methods in the validation phase, indicating its effectiveness in predicting improved binding affinities.
NQFEP method provides more accurate but computationally expensive simulations, while the Schrödinger Res Scan offers quicker but less precise results. Despite the higher computational cost, the NQFEP method might be preferable when high accuracy is crucial.
Update on tfold-AB including modeling of the complex with the antigen, with applications to virtual screening.
They mostly use SABDAB/Covabdab as reference datasets.
The modeling happens by generating antibody & antigen features supplemented by a large language model, followed by flexible docking.
For antigen feature generation, they use AF2
They are training on several tasks simultaneously, ab structure prediction, complex prediction etc. making it a multi-task training.
On docking their method achieves DockQ 0.217 vs AlphaFold-Multimer DockQ score of 0.158 - that is global docking.
Whe local docking information is given, constraining paratope/epitope sites, their algorithm achieves DockQ of 0.416.
They demonstrate that filtering antibodies by their predicted modeling confidence score gives moderate enrichment against PD1 and Sars-cov-2 antigens, showing promise for virtual screening.
Novel dataset of 0.5m anti-trastuzumab antibodies together with benchmarking of affinity classification methods.
They generated a dataset of ~500,000 anti-Her2 trastuzumab variants by modifying the CDR-H3. The binding affinity is divided into high/medium/low with reasonably even split (178,160, 196,392, and 171,732 respectively).
They split their dataset into positives and negatives by putting medium and low binders into the negative set.
They contrast their dataset with this from Mason et al. (~39k variants vs theirs 0.5m), to show that in a small (relatively) number of cases, binders in one set can be labeled as negative in another.
They test that the predictor developed by Mason et al. for binding/non binding classification works as intended on the novel 0.5m dataset. Likewise their model trained on Mason data and tested on their ds (and vice versa) has predictive power. It does but to a much lesser extent than training on data from the same experiment.
As methods to benchmark they used FLAML https://arxiv.org/abs/1911.04706, CNN and EGNN.
CNN and FLAML are top performers, but CNN performs well on the small data (signal starting with ~170 sequences).
Performance drops radically when train/val splits are done with respect to the clonotype.
THey tested AbLang, ProteinMPNN, ESM and Blosum on their ability to generate binding trastuzumab variants. As control they also randomly generated sequences. They observed the following percentages of sequences exhibiting CNN-HER2-max binding probabilities greater than 90%: 13% for Random, 26% for BLOSUM, 27% for AbLang (when masking all ten residues simultaneously), 29% for AbLang (when masking one residue at a time), 19% for ProteinMPNN, and 30% for ESM (when masking one residue at a time), respectively.