Application of Propensity Score Models and Causal Estimators in Observational Studies under Model Misspecification

Apu Chandra Das, Sakib Salam, Md Robiul Islam Talukder, Ashim Chandra Das, Antar Chandra Das, Rakhi Chowdhury, for the Alzheimer’s Disease Neuroimaging Initiative · 2026

Read Application of Propensity Score Models and Causal Estimators in Observational Studies under Model Misspecification by Apu Chandra Das, Sakib Salam, Md Robiul Islam Talukder, Ashim Chandra Das, Antar Chandra Das, Rakhi Chowdhury, for the Alzheimer’s Disease Neuroimaging Initiative (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20633.txt.

Introduction

Apu Chandra Das and five colleagues test causal estimators when propensity score models are wrong. Propensity methods aim to cut bias in studies where treatment is not assigned at random, but a wrong model can skew results badly. They run many simulations that vary how the score model and the result model are set up. They compare three estimators and four ways to estimate scores, from plain logistic models to tree and margin methods.

Catalog record

CREATORApu Chandra Das, Sakib Salam, Md Robiul Islam Talukder, Ashim Chandra Das, Antar Chandra Das, Rakhi Chowdhury, for the Alzheimer’s Disease Neuroimaging Initiative
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51207
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.20633

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Application of Propensity Score Models and Causal Estimators in Observational Studies under Model Misspecification Apu Chandra Das, Sakib Salam, Md Robiul Islam Talukder, Ashim Chandra Das, Antar Chandra Das, Rakhi Chowdhury, for the Alzheimer’s Disease Neuroimaging Initiative Abstract Propensity score (PS) methods are widely used in observational studies to reduce confounding and estimate causal treatment effects. However, the validity of PS-based causal estimators depends heavily on correct model specification, and model misspecification may lead to substantial bias and instability. In this study, we systematically evaluate the performance of commonly used causal estimators, including response surface modeling (RSM), inverse probability weighting (IPW), and augmented inverse probability weighting (AIPW), under varying levels of PS and outcome model misspecification. We compare classical logistic regression with several machine learning approaches for PS estimation, including random forests (RF), support vector machines (SVM), and linear discriminant analysis (LDA). Extensive simulation studies were conducted under multiple scenarios defined by combinations of correctly specified and misspecified PS and outcome models, varying sample sizes, and different covariate correlation structures. Estimator performance was assessed using bias, absolute bias, root mean squared error, empirical standard error, and confidence interval width. Results demonstrate that AIPW consistently provides robust and stable estimates across most scenarios due to its doubly robust property, whereas IPW is highly sensitive to PS misspecification and unstable PS estimates produced by flexible machine learning methods. RSM performs well only when the outcome model is correctly specified. Real-world applications using the ACTG175 clinical trial and the Alzheimer’s Disease Neuroimaging Initiative (ADNI) dataset further illustrate the practical implications of estimator choice and PS modeling strategy. Overall, our findings highlight the importance of integrating flexible machine learning approaches within doubly robust frameworks to improve causal effect estimation in observational studies. keywords Causal inference; Propensity score; Model misspecification; Inverse probability weighting; Doubly robust estimation 1 Introduction While randomized controlled trials (RCTs) are considered the gold standard for assessing treatment efficacy, ethical, financial, and logistical constraints often limit their feasibility in biomedical and clinical research 19 ; 23 . As a result, observational studies and real-world data have become increasingly important for evaluating treatment effects in practice. The assignment of treatment in observational studies is not random, which leads to confounding. Patients receiving different treatments may differ systematically in their baseline characteristics, which can bias treatment effect estimates if not properly addressed. The potential outcomes framework provides a formal foundation for addressing these challenges by guiding adjustment for such imbalances 37 ; 39 . Over the past decades, a wide variety of statistical methods have been developed to estimate causal effects under these conditions. Early foundational work focused on standardization and outcome regression approaches, which were formalized by Cochran 10 . The paradigm shifted significantly with the introduction of the propensity score (PS) framework by Rosenbaum and Rubin 36 , establishing a principled method to control for confounding through balancing scores. This milestone catalyzed the development of PS matching, subclassification, and stratification methods further advanced by Imbens 24 and others 1 ; 18 . To address time-varying confounding, Robins et al. 33 subsequently introduced inverse probability weighting (IPW) within the marginal structural model framework. This line of semiparametric research, rooted in earlier work by Robins et al. 34 , ultimately culminated in doubly robust architectures like the augmented inverse probability weighting (AIPW) estimator formalized by Bang and Robins 7 . More recently, van der Laan et al. 42 proposed targeted maximum likelihood estimation (TMLE), offering a flexible semiparametric framework that explicitly integrates machine learning algorithms with formal causal inference. Commonly used methods in causal inference include response surface model (RSM), inverse probability weighting (IPW), and augmented inverse probability weighting (AIPW). RSM models the relationship between covariates and outcomes directly, while IPW relies on PS—the probability of receiving treatment given observed covariates—to construct a weighted pseudo-population in which treatment assignment is independent of covariates 36 . AIPW combines both outcome modeling and PS weighting and is particularly attractive due to its doubly robust property, providing consistent estimates if either the outcome model or the PS model is correctly specified 7 . The PS is therefore a central tool in causal inference to deal with the confounding issue through covariate balancing 36 . Its application has recently extended to areas such as real-world data integration and information borrowing. In particular, Wang et al. 44 and Lu et al. 30 developed PS–integrated power prior approaches to incorporate external data into clinical studies, while Das et al. 13 ; 12 proposed flexible borrowing frameworks to improve operating characteristics in clinical trial settings. These developments highlight the growing importance of PS methodology in modern clinical research. However, the performance of PS-based approaches critically depends on accurate estimation of the PSs. In particular, misspecification of the PS model can lead to inadequate covariate balance, resulting in biased estimates and increased variability 6 ; 25 . Achieving accurate estimation typically requires correct specification of the functional form of the treatment assignment mechanism, including appropriate handling of nonlinearities and interactions. Traditionally, PSs are estimated using parametric models such as logistic regression. While these models are simple and interpretable, they may fail to capture complex relationships between covariates and treatment assignment, potentially leading to model misspecification 29 . To address this limitation, machine learning methods such as random forests (RF), support vector machines (SVM), and linear discriminant analysis (LDA) have been increasingly adopted for PS estimation 31 . Although these approaches can improve predictive performance, they may also yield extreme PS estimates, leading to unstable weights and increased variability in IPW estimators 29 ; 6 . Despite these developments, misspecification remains a fundamental challenge in observational studies, as the true functional forms of both the outcome and PS models are typically unknown. It may arise from incorrect functional forms, omitted variables, or unaccounted interactions, potentially leading to biased estimates and increased variability. Several studies have demonstrated that causal estimators are sensitive to model misspecification, with RSM and IPW performing poorly under incorrect specification and doubly robust methods offering only partial protection 7 ; 25 ; 43 ; 16 ; 28 . For instance, Kang and Schafer 25 showed that even doubly robust estimators can exhibit substantial bias and instability in practical settings. Similarly, Waernbaum 43 demonstrated that no single estimator uniformly dominates across misspecification scenarios, and Hainmueller 16 highlighted limitations of traditional PS methods and proposed alternative weighting strategies. However, the impact of machine learning–based PS estimation on the performance of classical causal estimators under model misspecification remains insufficiently understood. Recent work by Chen et al. 8 compared several causal estimators combined with super learner approaches and demonstrated improved performance of doubly robust methods under certain settings. Building on this line of work, a more systematic evaluation across a broader range of model misspecification scenarios, sample sizes, and covariate correlation structures is needed. Therefore, our primary objective is to systematically evaluate the impact of machine learning–based PS estimation methods on the performance of commonly used causal estimators—including RSM, IPW, and AIPW—under varying levels of model specification, sample sizes, and covariate correlation structures. In this study, we design extensive simulation scenarios to evaluate the performance of causal estimators under varying model specifications and data settings. We consider four model specification regimes based on combinations

Read the complete text