A Comparative Study of Model Adaptation Strategies for Multi-Treatment Uplift Modeling
Ruyue Zhang, Xiaopeng Ke, Ming Liu, Fangzhou Shi, Chang Men, Zhengdan Zhu · 2025
Read A Comparative Study of Model Adaptation Strategies for Multi-Treatment Uplift Modeling by Ruyue Zhang, Xiaopeng Ke, Ming Liu, Fangzhou Shi, Chang Men, Zhengdan Zhu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01185.txt.
Introduction
Ruyue Zhang and colleagues compare ways to adapt uplift models from two treatments to many. Uplift modeling estimates how a treatment changes an individual's outcome, guiding decisions in marketing and healthcare, where choosing among several treatments is common. Existing multi treatment methods are mostly adaptations of binary treatment methods.
The authors sort all current adaptations into two types: structure adaptation and feature adaptation. They show empirically that neither stays effective across data conditions, such as noise or a mix with observational data. They propose a third route, orthogonal function adaptation, grounded in the function approximation theorem. In wide ranging experiments it greatly improved uplift performance over the vanilla adaptations and showed the highest robustness across the conditions tested.
Catalog record
| CREATOR | Ruyue Zhang, Xiaopeng Ke, Ming Liu, Fangzhou Shi, Chang Men, Zhengdan Zhu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-01185
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Comparative Study of Model Adaptation Strategies for Multi-Treatment Uplift Modeling Ruyue Zhang, Xiaopeng Ke, Ming Liu, Fangzhou Shi, Chang Men, Zhengdan Zhu Abstract Uplift modeling has emerged as a crucial technique for individualized treatment effect estimation, particularly in fields such as marketing and healthcare. Modeling uplift effects in multi-treatment scenarios plays a key role in real-world applications. Current techniques for modeling multi-treatment uplift are typically adapted from binary-treatment works. In this paper, we investigate and categorize all current model adaptations into two types: Structure Adaptation and Feature Adaptation. Through our empirical experiments, we find that these two adaptation types cannot maintain effectiveness under various data characteristics (noisy data, mixed with observational data, etc.). To enhance estimation ability and robustness, we propose Orthogonal Function Adaptation (OFA) based on the function approximation theorem. We conduct comprehensive experiments with multiple data characteristics to study the effectiveness and robustness of all model adaptation techniques. Our experimental results demonstrate that our proposed OFA can significantly improve uplift model performance compared to other vanilla adaptation methods and exhibits the highest robustness. † † address: DiDi Chuxing, Beijing, China 1 Introduction Recently, Causal Inference has shown its effectiveness in many domains such as online marketing [ 1 , 2 , 3 ] , advertising [ 4 ] , and health care [ 5 ] . Among these, in online marketing, causal effect prediction is vital to subsidy distribution, as subsidies are widely adopted to stimulate user engagement and expand platform user bases. A key component of causal inference modeling is the causal effect prediction problem with multiple discrete treatment candidates. Recent work on causal effect estimation has mainly focused on binary treatment versus control settings, and extensions are usually required for multi-treatment scenarios. Randomized Controlled Trials (RCTs) are widely regarded as the gold standard for causal inference, serving as the foundation for the development of numerous foundational estimation methods. Among them, representative approaches include tree-based methods [ 6 ] , meta-learners [ 7 , 8 ] , balancing neural networks (BNN) [ 9 ] , and TARNet [ 10 ] . Nonetheless, given the ethical and practical limitations of RCTs, a parallel line of work focuses on causal estimation methods that operate on observational data, such as CFRNet [ 10 ] , DR-CFR [ 11 ] , SITE [ 12 ] , DragonNet [ 13 ] , and HydraNet [ 14 ] . These works mitigate confounding bias through distribution balancing or representation learning. Overall, these methods have demonstrated strong performance in binary treatment settings. However, how to extend binary treatment models to multi-treatment scenarios remains an open question—unfortunately, current research in this area lacks systematic and reliable investigation. In multi-treatment uplift modeling, binary models are often extended in different ways depending on how the treatment variable is incorporated into the model structure. Particularly for modeling with observational data, the adjustment for distributional differences also needs to be adapted to the multi-treatment setting. Methods such as tree-based models and BNN typically treat the treatment as an input feature, which is a broadly applicable approach . In contrast, for binary models with a two-head structure such as CFRNet, a common practice is to extend the architecture into a multi-head form . The MEMENTO [ 15 ] model exemplifies this approach, with the main difference being its specific method for balancing data distribution. Nonetheless, neither of these approaches consistently delivers stable performance across different datasets, underscoring the limitations of current extension strategies and calling for more efficient and flexible solutions for multi-treatment uplift modeling. To figure out the robust modeling method for multi-treatment scenarios, we organize all modeling approaches for multi-treatment scenarios and classify them into two groups: Structural Adaptation and Feature Adaptation . Additionally, we introduce a novel multi-treatment modeling approach, Orthogonal Function Adaptation , which is designed as a plug-and-play module that enhances model generalization across diverse datasets. Its architecture consistently improves estimation performance under various data conditions with minimal additional computational overhead. Our experimental evaluation encompasses a diverse collection of datasets, including randomized controlled trials (RCTs), observational studies, synthetically generated data with noise, and data satisfying monotonicity constraints. Results demonstrate that the proposed OFA method consistently outperforms existing baselines across the majority of these settings. Our main contributions are summarized as follows. • To the best of our knowledge, we are the first to categorize current works on multi-treatment uplift modeling and conduct a comprehensive study on this scenario. • We propose the Orthogonal Function Adaptation (OFA) technique for multi-treatment modeling based on the Weierstrass approximation theorem. This method is plug-and-play and can maintain computational complexity while increasing the treatment options. • We conduct comprehensive experiments on synthetic and real-world datasets. The experimental results demonstrate that the proposed OFA outperforms other vanilla adaptations across various data characteristics. 2 Methodology Figure 1: Overview of different model adaptation categories 2.1 Notation Let \mathcal{D}=\{X_{i},Y_{i},T_{i}\}_{i=1}^{N} denotes the dataset where X_{i}\in\mathbb{R}^{d} represents the d -dimensional input feature vector, Y_{i} denotes the label, and T_{i}\in\mathcal{T} denotes the treatment. \mathcal{T}=\{t_{1},t_{2},\cdots,t_{m}\} is the set of m possible treatment values. In this paper, we discuss the adaptation for multi-valued treatments under the Neyman-Rubin potential outcome framework [ 16 ] . We assume the uplift model has the following form: f(X,T;\theta_{f})=g(\varphi_{X};T) where \varphi_{X} denotes the hidden feature, and g(\cdot,\cdot) denotes the associated effect estimator that operates on the hidden feature. 2.2 Feature Adaptation Feature Adaptation technique is to concatenate the treatment value with the features as shown in Figure 1 (a). The corresponding model can be written as f_{FA}(X,T;\theta_{f_{FA}})=g(\text{concat}(\varphi_{X},T)) where \text{concat}(\cdot,\cdot) denotes the concatenation function. 2.3 Structure Adaptation To handle multi-valued treatments, another common way is to construct branches from the original model as shown in Figure 1 (b). This can be represented as the set of effect estimators \mathcal{G}=\{g_{1},g_{2},\ldots,g_{m}\} . Consequently, the model becomes f_{SA}(X,T;\theta_{f_{SA}})=g_{T}(\varphi_{X}). Note that the hidden feature \varphi_{X} could be the input feature \varphi_{X}=X , and the whole model degenerates into several separate submodels. 2.4 Orthogonal Function Adaptation Through the Weierstrass approximation theorem [ 17 ] , we can use a set of orthogonal polynomials to approximate every continuous function. Here, we propose the Orthogonal Function Adaptation (OFA) method as shown in Figure 1 (c). We modify the model to generate coefficients for each polynomial function. Without loss of generality, we utilize orthogonal polynomials [ 18 ] to estimate the target function. The model can be written as f_{OFA}(X,T;\theta_{OFA})=\sum_{j=0}^{p}a_{j}(\varphi_{X})\cdot P^{(j)}(T) where p is the highest degree of the polynomial, a_{j}(\cdot) denotes the coefficient estimator, and P^{(j)} is the j -th orthogonal polynomial. In this paper, we select the Legendre orthogonal polynomial [ 19 ] to construct the approximation. These polynomials can be written as \displaystyle P^{(0)}(t) \displaystyle=1,P^{(1)}(t)=t, \displaystyle(k+1)P^{(k+1)}(t) \displaystyle=(2k+1)tP^{(k)}(t)-kP^{(k-1)}(t). Using the theorem from [ 20 ] , we can also prove that the OFA achieves the lowest complexity while the error \leq\varepsilon : \small C_{\text{OFA}}=\mathcal{O}(\varepsilon^{-\frac{m}{r}})<C_{\text{SA}}=\mathcal{O}(\varepsilon^{-\frac{d}{r}})<C_{\text{FA}}=\Omega(\varepsilon^{-\frac{m+d}{r}}) where C is the model complexity and m<d must hold. 2.5 Loss Design We select the Binary Cross-Entropy Loss as the basic loss. It could be written as: \small\mathcal{L}_{\text{BCE}}=\frac{1}{N}\sum_{i=1}^{N}Y_{i}\log(f(X_{i},T_{i};\theta))+(1-Y_{i})\log(1-f(X_{i},T_{i};\theta)) As for handling the selection bias of the observation data, we apply the balanced representation technique in this paper. We select the Maximum Mean Discrepancy (MMD) [ 21 ] and Wasserstein discrepancy (WASS) [ 22 ] function