Integration of aggregated data in causally interpretable meta-analysis by inverse weighting

Tat Thang Vo, Tran Trong Khoi Le, Sivem Afach, Stijn Vansteelandt · 2025

Read Integration of aggregated data in causally interpretable meta-analysis by inverse weighting by Tat Thang Vo, Tran Trong Khoi Le, Sivem Afach, Stijn Vansteelandt (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-05634.txt.

Introduction

Tat Thang Vo and co-authors extend causal meta analysis to trials that share only summary data, in a 2025 paper. Pooling trial results fairly is hard when patient mixes differ, since traits that change a drug's effect may be unevenly spread. Newer methods restandardize each trial to a target group, but they need full patient level records.

Many trials cannot share those records. The authors adapt moment based methods from health technology assessment so summary level data can join the pool. They add computing methods to cover extra summary values that reports often lack. Simulations test the approach, and a real case compares two psoriasis drugs. The work widens who can take part in fair pooled verdicts.

Catalog record

CREATORTat Thang Vo, Tran Trong Khoi Le, Sivem Afach, Stijn Vansteelandt
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-05634

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Integration of aggregated data in causally interpretable meta-analysis by inverse weighting Tat Thang Vo, Tran Trong Khoi Le, Sivem Afach, Stijn Vansteelandt Abstract Obtaining causally interpretable meta-analysis results is challenging when there are differences in the distribution of effect modifiers between eligible trials. To overcome this, recent work on transportability methods has considered standardizing results of individual studies over the case-mix of a target population, prior to pooling them as in a classical random-effect meta-analysis. One practical challenge, however, is that case-mix standardization often requires individual participant data (IPD) on outcome, treatments and case-mix characteristics to be fully accessible in every eligible study, along with IPD case-mix characteristics for a random sample from the target population. In this paper, we aim to develop novel strategies to integrate aggregated-level data from eligible trials with non-accessible IPD into a causal meta-analysis, by extending moment-based methods frequently used for population-adjusted indirect comparison in health technology assessment. Since valid inference for these moment-based methods by M-estimation theory requires additional aggregated data that are often unavailable in practice, computational methods to address this concern are also developed. We assess the finite-sample performance of the proposed approaches by simulated data, and then apply these on real-world clinical data to investigate the effectiveness of risankizumab versus ustekinumab among patients with moderate to severe psoriasis. Keywords: causal inference, meta-analysis, inverse probability weighting, direct standardization, case-mix heterogeneity 1 Introduction Meta-analysis is a quantitative procedure of assessing and combining data from multiple studies ( Chandler et al., 2019 ) . Conventional meta-analysis methods, however, do not provide findings with a clear causal interpretation when the distribution of effect modifiers differs between eligible trials ( Dahabreh et al., 2020 ; Truong et al., 2023 ; Vo et al., 2019 ) . To remedy this, a novel framework called causally interpretable meta-analysis (or causal meta-analysis for short) has recently been proposed ( Dahabreh et al., 2020 ; Vo et al., 2019 ; Vo et al., 2021 ; Sobel et al., 2017 ) . This framework considers standardizing results of eligible studies over the case-mix of a target population, before pooling them as in a classical random-effect meta-analysis. The obtained summary findings do not suffer from case-mix heterogeneity between studies, and quantify the treatment effect for a well-defined target population. One practical challenge of causal meta-analysis, however, is that it requires the individual participant data (IPD) to be fully accessible in every eligible study and in the target population. In practice, data sharing is often subject to administrative and privacy concerns ( Ross, 2016 ) . To the best of our knowledge, little work has been done to formally address the complexity due to limited access to IPD in causal meta-analysis. Quite recently, Rott et al. (2024) has proposed a new method to simulate covariates for individuals of studies without IPD accessible, when certain summary statistics (or aggregated data) are available from these non-IPD trials. This method, however, requires a strong parametric assumption that the covariance of covariates (COC) is either the same in all eligible studies and in the target population, or the COC in the target population is a mixture of the COCs in eligible studies with IPD. Other simulation-based methods have also been proposed by Remiro-Azócar et al. (2022) and Phillippo et al. (2020) , under a similar assumption. Alternatively, in health technology assessment (HTA), moment-based methods have been used to transport treatment effects of one randomized trial with IPD to a target population with aggregated data, without having to impose homogeneity on the covariance matrix of the covariates in different trial populations ( Signorovitch et al., 2012 ; Truong et al., 2023 ) . The extension of these methods to causal meta-analysis has not yet been investigated. Besides, establishing asymptotic inference for these so-called population-adjusted methods is quite challenging ( Cheng et al., 2020 ) . Common practice includes randomly drawing bootstrap samples from the trial’s IPD, while considering the aggregated data of the target population as fixed. This overlooks the uncertainty in these aggregated data, and can lead to type I error inflation or under-coverage issues in the resulting confidence interval of the treatment effect estimate in the target population. In this paper, we propose novel methods to integrate aggregated-level data from eligible trials with non-accessible IPD into a causal meta-analysis, with the aim to infer the summary treatment effect for each trial population in the analysis. To achieve this, we first revisit the moment-based methods for transportation of treatment effects across populations proposed in HTA, and then develop extensions of these methods to causal meta-analysis. Unlike previous methods, we do not require homogeneity of the covariance matrix of the covariates in different eligible trials to obtain consistent effect estimates. We also show that valid inference for these moment-based methods by M-estimation theory requires additional aggregated data that are often unavailable in practice. Methods to address this challenge are thus developed. We illustrate the proposed approaches on numerically simulated data, and on real-world data of a meta-analysis investigating the effectiveness of risankizumab versus ustekinumab among patients with moderate to severe psoriasis. 2 Transportability of causal effects in meta-analysis 2.1 Causal estimand, identification and estimation: a brief overview Consider a meta-analysis of q randomized trials to evaluate the comparative effectiveness of two treatments ( X=0,1 ) on a dichotomous outcome (Y=0,1) . Let S be an indicator of the study from which a given patient originates, which takes values from 1 to q , and \bm{L}=(L_{1},\ldots,L_{p-1}) be a set of p-1 baseline covariates that are collected across studies. Assume for now that the IPD is accessible for all eligible studies. In that case, we observe O_{i}=(\bm{L}_{i},S_{i},X_{i},Y_{i}) for each individual i in the dataset. These observations (O_{1},\ldots,O_{n}) are independent and identically distributed realizations of O=(\bm{L},S,X,Y) . Denote Y\left(x,k\right) the counterfactual outcome that would be observed if a patient participated in trial k and were assigned to treatment x . Our focus is on identifying and estimating the risk difference: \theta(j,k):=\mathsf{P}\{Y\left(x=1,{k}\right)=1\mid S=j\}-\mathsf{P}\{Y\left(x=0,k\right)=1\mid S=j\} which expresses the treatment effect when all individuals from the target population of trial S=j were given the (version of) treatment versus control used in trial k . While we here focus on risk differences, extension to other effect measures such as relative risks or odds ratios is relatively straightforward. To identify \theta(j,k) , the following assumptions are made for x=0,1 and j,k=1,\ldots,q : (i) Transportability , i.e., Y\left(x,{k}\right)\mathchoice{\mathrel{\hbox to0.0pt{$\displaystyle\perp$\hss}\mkern 2.0mu{\displaystyle\perp}}}{\mathrel{\hbox to0.0pt{$\textstyle\perp$\hss}\mkern 2.0mu{\textstyle\perp}}}{\mathrel{\hbox to0.0pt{$\scriptstyle\perp$\hss}\mkern 2.0mu{\scriptstyle\perp}}}{\mathrel{\hbox to0.0pt{$\scriptscriptstyle\perp$\hss}\mkern 2.0mu{\scriptscriptstyle\perp}}}S\mid\bm{L} , which requires that \bm{L} contains all outcome prognostic factors that are differentially distributed across populations. (ii) Positivity , i.e. \mathsf{P}\{0<\mathsf{P}\left(S=j\mid\bm{L}\right)<1\}=1 , which requires that trials are sufficiently similar in terms of target populations, so that there is an adequate overlap in the distribution of \bm{L} across studies. (iii) Consistency , i.e. Y\left(x,k\right)=Y when S=k and X=x , which states that Y(x,k) agrees with the observed outcome Y for all individuals in study k receiving treatment x . (iv) Ignorability within each trial , i.e. Y\left(x,{k}\right)\mathchoice{\mathrel{\hbox to0.0pt{$\displaystyle\perp$\hss}\mkern 2.0mu{\displaystyle\perp}}}{\mathrel{\hbox to0.0pt{$\textstyle\perp$\hss}\mkern 2.0mu{\textstyle\perp}}}{\mathrel{\hbox to0.0pt{$\scriptstyle\perp$\hss}\mkern 2.0mu{\scriptstyle\perp}}}{\mathrel{\hbox to0.0pt{$\scriptscriptstyle\perp$\hss}\mkern 2.0mu{\scriptscriptstyle\perp}}}X\mid S , which holds when the treatment is randomized within each study. A more detailed discussion of the above causal assumptions can be found in some recent works ( Vo et al., 2019 ; Sobel et al.,

Read the complete text