A Matrix Variational Auto-Encoder for Variant Effect Prediction in Pharmacogenes

Antoine Honoré, Borja Rodríguez Gálvez, Yoomi Park, Yitian Zhou, Volker M. Lauschke, Ming Xiao · 2025

Read A Matrix Variational Auto-Encoder for Variant Effect Prediction in Pharmacogenes by Antoine Honoré, Borja Rodríguez Gálvez, Yoomi Park, Yitian Zhou, Volker M. Lauschke, Ming Xiao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-02624.txt.

Introduction

Six authors, Antoine Honoré, Borja Rodríguez Gálvez, Yoomi Park, Yitian Zhou, Volker Lauschke, and Ming Xiao, wrote this 2025 paper on predicting how gene variants change drug response. Tools that judge variant effects often rely on alignments of like proteins across species. That route assumes natural variants are fit, which can fail for drug genes under weak evolutionary pressure.

Lab data from deep mutational scanning offer a second route, since they score many variants directly. The team built a transformer-based model, called matVAE, that learns from such data with a structured prior. They tested it on 33 scanning data sets covering 26 drug target and drug-processing proteins from the ProteinGym benchmark. Trained on alignments, their model beat the top rival, DeepSequence, at zero-shot prediction. It did so with far fewer parameters and less compute.

Catalog record

CREATORAntoine Honoré, Borja Rodríguez Gálvez, Yoomi Park, Yitian Zhou, Volker M. Lauschke, Ming Xiao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-02624

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Matrix Variational Auto-Encoder for Variant Effect Prediction in Pharmacogenes Antoine Honoré, Borja Rodríguez Gálvez, Yoomi Park, Yitian Zhou, Volker M. Lauschke, Ming Xiao Abstract Variant effect predictors (VEPs) aim to assess the functional impact of protein variants, traditionally relying on multiple sequence alignments (MSAs). This approach assumes that naturally occurring variants are fit, an assumption challenged by pharmacogenomics, where some pharmacogenes experience low evolutionary pressure. Deep mutational scanning (DMS) datasets provide an alternative by offering quantitative fitness scores for variants. In this work, we propose a transformer-based matrix variational auto-encoder (matVAE) with a structured prior and evaluate its performance on 33 DMS datasets corresponding to 26 drug target and ADME proteins from the ProteinGym benchmark. Our model trained on MSAs (matVAE-MSA) outperforms the state-of-the-art DeepSequence model in zero-shot prediction on DMS datasets, despite using an order of magnitude fewer parameters and requiring less computation at inference time. We also compare matVAE-MSA to matENC-DMS, a model of similar capacity trained on DMS data, and find that the latter performs better on supervised prediction tasks. Additionally, incorporating AlphaFold-generated structures into our transformer model further improves performance, achieving results comparable to DeepSequence trained on MSAs and finetuned on DMS. These findings highlight the potential of DMS datasets to replace MSAs without significant loss in predictive performance, motivating further development of DMS datasets and exploration of their relationships to enhance variant effect prediction. 1 Introduction Variant effect predictors (VEPs) are mathematical models aiming at predicting the effect of one or multiple variants in a sequence of amino-acids (AAs). The effect of a protein variant is typically defined as a loss or gain of function of a cell carrying the variant, compared to a cell carrying a wild-type (WT) protein without variant. The accurate prediction of variant effect has many promising applications for personalized medicine, particularly in the field of pharmacogenomics, where variants on drug targets or Absorption-Distribution-Metabolism-Excretion (ADME) proteins are of particular interest ( Huang et al. 2016 ) . In this context, VEPs can be used to assess individual patient response to chemotherapeutic treatments from their genetic background, thus eliminating the need for multiple attempts at treatments. The most effective VEPs have been designed using data from multiple sequence alignments (MSAs) and based on the conservation assumption : fit variants were selected out by nature and thus, learning a distribution over variants found in nature implicitly captures the biochemical constraints that characterize fit variants. New sequencing techniques combined with machine learning could lead to significant advances in variant effect prediction, by providing quantitative data in region of the protein sequence space unexplored in existing MSA datasets. Deep mutational scanning (DMS) has recently emerged as a way to yield large-scale datasets of protein quantitative fitness scores ( Fowler & Fields 2014 ) . The fitness scores can also be obtained with different selection assays, allowing to quantify various effects, e.g. effect on phenotype or effect on structure. DMS thus allows to challenge the conservation assumption of VEPs design from MSAs. This is in turn is of particular importance in pharmacogenomics, since pharmacogenes are generally under low evolutionary pressure ( Zhou et al. 2022 ; Ingelman-Sundberg et al. 2018 ) . In this article, we design a VEP and use it to evaluate the validity of the conservation assumption for pharmacogene-related proteins. Our architecture exploits the structure of variational auto-encoders (VAEs) and allows models of similar capacity and designs to be trained on both MSA and DMS data. We also exploit a transformer architecture in order to improve upon existing VAE-based VEPs. Both VAE and transformers are key components of the best performing models in the ProteinGym benchmark ( Notin et al. 2023a ) . We experiment with a VAE-based model exploiting multimodal priors, and we derive a matrix encoding scheme inspired from linear matrix decomposition to replace the input flattening operation found for instance in DeepSequence. Contributions Our contributions are summarized as follows: 1. We design protein specific models combining a VAE and a transformer for variant effect prediction. We study their zero-shot prediction performances on 33 deep mutational scanning (DMS) datasets of drug related and ADME proteins available in the ProteinGym benchmark. 2. We propose a new way to train VAEs for deep unsuperivsed clustering using expressive latent prior based on discrete distributions. We evaluate the model on zero-shot predictions when trained on MSA data available in ProteinGym. We experiment with and without adding protein structure information to our model. 3. We adapt our model to directly predict labels from DMS datasets using a prediction head from the latent space, thus preserving our model capacity. In light of the comparison in performances of the models trained unsupervised on MSA and supervised DMS label data, we discuss the extent of the validity of the conservation assumption. 1.1 Related works Zero-shot predictors VEPs exploiting site-independent position-wise frequencies of AAs in MSAs remain the methods of choice in pharmacology, e.g. SIFT or Polyphen-2 ( Ng & Henikoff 2003 ; Adzhubei et al. 2010 ; Durbin 1998 ) . However, other models can achieve much better zero-shot prediction performances on at least one pharmacogene-related protein DMS dataset (Details in Table A.5 ), according to the recent ProteinGym variant effect prediction benchmark ( Notin et al. 2023a ) . Many of these models compute the functional cellular effect of a variant v compared to a wild-type sequence {\underline{\mathbf{x}}}^{(wt)} , via the log-likelihood ratio: \hat{y}=\ln\frac{p({\underline{\mathbf{x}}}^{(v)})}{p({\underline{\mathbf{x}}}^{(wt)})}, (1) where p(.) is a generative probability density chosen to maximize p({\underline{\mathbf{x}}}^{(v)}) , for sequences \underline{\mathbf{x}}^{(v)} from the MSA.For instance, the Evolutionary Scale modeling (ESM) approaches ( Rives et al. 2021 ) , rely solely on a transformer-based protein language model (PLM) for modeling the distribution over sequences in MSAs. Tranception ( Notin et al. 2022a ) additionally integrates predictions using position-wise frequencies of AAs in MSAs. TranceptEVE ( Notin et al. 2022b ) combines the Tranception model with a VAE-based model ( Frazer et al. 2021 ) for AA sequence modeling. Other methods such as Masked Inverse Folding (MIF) ( Yang et al. 2023 ) learn to predict protein sequences from a given structure. VESPA ( Marquet et al. 2022 ) combines protein sequence embedding from PLMs with known bio-mechanical properties of AAs to predict variant effect with a linear regression model. Other model do not rely on the ratio in ( 1 ) to compute variant effect. MSA Transformer ( Rao et al. 2021 ) is based on ESM and uses axial attention to optimize a masking loss over an entire MSA, rather than on individual sequences. It learns a representation of Hamming distances in the MSA and the hamming distance to WT sequence is used as a proxy for variant effect. GEMME ( Laine et al. 2019 ) predicts variant effect via the distance to WT sequence in an evolutionary tree. This approach shows very good performances and has several order of magnitude fewer parameters than transformer-based approaches. DeepSequence ( Riesselman et al. 2018 ) introduces a VAE and approximates the distribution of input data \underline{\mathbf{x}} (Eq. ( 1 )) with the variational evidence lower bound. Supervised learning predictors Recently, several models combining DMS and MSA datasets have been proposed Hsu et al. 2022 . The general idea is to

Read the complete text