Computational Antibody Papers

Filter by tags
language models
Filter by published year
2025
TitleKey points
    • Demonstration that general purpose language models - like GPT3.5 - can reason about antibody - engineering tasks.
    • Authors explore the topic of in context learning - e.g. few shot learning where several examples are given and on the basis of that the model needs to provide a prediction for a new case.
    • They tested an array of general purpose models, such as GPTs, LLamas, Mistrals etc.
    • They tested on three antibody tasks - mouse/human discrimination, specificity prediction (from ngs) and isotype identification. In theory not that difficult tasks, but remember we are dealing witha general purpose language model.
    • They literally prompt the model with examples on, say mouse antibodies, human antibodies and provide a next one to predict.
    • They find that the predictions are not bad, especially in few shot scenario (16 examples or so).
    • In one test it even achieved accuracy on par with AntiBERTy.
    • Method to employ low-N data for biologic engineering.
    • Assuming we have a dataset of ~100 affinity data points, we can choose (100 choose 2) pairs where we know which one has a larger readout than the other (e.g. stronger affinity) giving combinatorially larger amount of data points to train on.
    • The architecture used is CNN on top of a language model.
    • Benchmarked on three internal campaigns, Il6, EGFR and an undisclosed target.