Estimating Heterogeneous Causal Effect on Networks via Orthogonal Learning

Yuanchen Wu, Yubai Yuan · 2025

Read Estimating Heterogeneous Causal Effect on Networks via Orthogonal Learning by Yuanchen Wu, Yubai Yuan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-18484.txt.

Introduction

A treatment can affect not just the person treated, but their neighbors too. Yuanchen Wu and Yubai Yuan present a method to estimate such direct and spillover effects on networks in this 2025 paper. Effects differ across people and links, which makes the job harder. Likeness between connected people also confounds the picture.

Their two-stage method first uses graph neural networks to model the nuisance parts: how traits and network shape drive outcomes. The second stage strips those parts out and fits a clear attention-based model of interference. A math trick called orthogonalization keeps first-stage errors from skewing the result. A bootstrap procedure adds uncertainty bounds for the spillover map. Tests show better estimates of varied effects. The output can flag influential neighbors and recover the sign of spillovers.

Catalog record

CREATORYuanchen Wu, Yubai Yuan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-18484

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Estimating Heterogeneous Causal Effect on Networks via Orthogonal Learning Yuanchen Wu, Yubai Yuan Abstract Estimating causal effects on networks is important for both scientific research and practical applications. Unlike traditional settings that assume the Stable Unit Treatment Value Assumption (SUTVA), interference allows an intervention/treatment on one unit to affect the outcomes of others. Understanding both direct and spillover effects is critical in fields such as epidemiology, political science, and economics. Causal inference on networks faces two main challenges. First, causal effects are typically heterogeneous, varying with unit features and local network structure. Second, connected units often exhibit dependence due to network homophily, creating confounding between structural correlations and causal effects. In this paper, we propose a two-stage method to estimate heterogeneous direct and spillover effects on networks. The first stage uses graph neural networks to estimate nuisance components that depend on the complex network topology. In the second stage, we adjust for network confounding using these estimates and infer causal effects through a novel attention-based interference model. Our approach balances expressiveness and interpretability, enabling downstream tasks such as identifying influential neighborhoods and recovering the sign of spillover effects. We integrate the two stages using Neyman orthogonalization and cross-fitting, which ensures that errors from nuisance estimation contribute only at higher order. As a result, our causal effect estimates are robust to bias and misspecification in modeling causal effects under network dependencies. 1 Introduction Understanding causal effects on networks requires quantifying whether, and to what extent, a unit’s behavior is influenced by its interactions with others. The goal is to identify and measure the causal impact of network interference on individual outcomes. While modern data collection and social media provide large-scale network data with individual-level features, the complex structure of such data poses major challenges for causal inference. Traditional methods, which rely on independence assumptions, inevitably fail to capture the intricate dependencies present in real-world networks. One of the major challenges is the inherent heterogeneity of causal effects under network interference. In real-world networks, both node features and the strengths of pairwise connections vary widely, so the way one unit’s outcome responds to its neighbors depends on a complex mix of individual traits and relational structure. Accurately capturing spillover heterogeneity is essential for identifying true causal effects and for developing theories that reflect diverse patterns of interaction across networks. Another key challenge is the complex confounding introduced by the network structure. Units connected within a network exhibit correlated behaviors, driven not only by target interference but also by latent dependencies stemming from shared traits and network topology. Separating spillover effect from non-causal associations arising from network topology requires sophisticated adjustments to handle high-dimensional features and latent relationships. Running example: political polarization. Social media campaigns often utilize targeted ads (treatment) designed to influence voter turnout (outcome) ( bond2012experiment ) . These campaigns can directly influence recipients of targeted ads by encouraging them to vote, and also generate spillover effects as the voting message is reshared via social networks. Figure 1 : Causal diagram for an ego unit i on network where units j and k are two neighbors of i . The magnitude of these spillover effects vary among voters depending on their ideological alignment and socioeconomic status. Critically, the sign of the spillover effects also differ based on voters’ ideological positions, which is the well-documented phenomenon of political polarization and echo chambers ( bail2018exposure ) . Moreover, political attitudes often leads to clusters of voters with similar turnout patterns in social media, i.e., network homophily . Therefore, targeted ads exposure may be overlapped with groups of active voters, making it difficult to separate the causal impact of ads exposure from non-exposure voting patterns. The causal relation among outcome, treatment, and individual features over network is illustrated in Figure 1 . In this paper, we propose a novel method for estimating heterogeneous causal effects on networks from observational data under complex network dependencies. We introduce a new orthogonal learning design that separates the estimation of nuisance parameters arising from network dependencies from the estimation of causal effects, including both direct and spillover effects. The proposed method enjoys a robust estimation property: as long as the nuisance estimation bias is moderate, the estimation error for the causal effect remains of the same order as that of an oracle estimator with known nuisance components. In addition, the proposed framework balances expressive power and interpretability in modeling interference heterogeneity. Specifically, we use graph neural networks to estimate nuisance components, including both the conditional mean and propensity scores, therefore avoiding the strong parametric assumptions common in traditional methods. Inspired by attention mechanisms, our method introduces an attention-based interference model that summarizes the spillovers a unit receives from its neighborhood. This formulation allows spillover effects to depend on the features of both the sender and receiver, as well as on their local interaction patterns within the network. 2 Related works Estimating heterogeneous causal effects in the presence of high-dimensional features and complex confounding has received increasing attention in recent years. Many methods have been developed within the frameworks of semiparametric theory ( kennedy2024semiparametric ) and double machine learning ( chernozhukov2018double ) , primarily for treatment effect estimation from independent observational samples ( foster2023orthogonal ; kennedy2017non ; kennedy2023towards ; kunzel2019metalearners ; nie2021quasi ; semenova2021debiased ) . Meanwhile, the widespread applications and theoretical importance of causal inference on networks have sparked a surge of interest in developing network-specific methodologies. However, the methods above are not directly applicable to network data due to interference between units, which violates the core independence assumption underlying classical causal inference frameworks ( rubin1974estimating ) . Causal inference on networks introduces a distinct estimand—often referred to as the spillover effect, peer effect, or herd effect—that quantifies the causal influence transmitted through network connections. To address this, several recent methods have been proposed for causal effect estimation on networks ( forastiere2021identification ; aronow2017estimating ; ogburn2024causal ; goldsmith2013social ; toulis2013estimation ; leung2022causal ; leung2020treatment ) . A central component of model-based approaches is the use of exposure mappings, which summarize how a unit is affected by the treatment assignments of others ( aronow2017estimating ) . Many existing methods assume a known exposure mapping ( ogburn2024causal ; jiang2022estimating ; khatami2024graph ; chen2024doubly ) or use simplified forms, such as the average treatment among neighbors ( li2022random ) . These assumptions may be infeasible or overly simplistic in real-world settings, limiting the ability to capture complex interference mechanisms. Other methods aim to relax outcome model assumptions while requiring strong structural constraints, such as known clusters in the network ( bargagli2025heterogeneous ; hudgens2008toward ) . At the other end of the spectrum, deep learning-based approaches have emerged, where both interference and contextual information are encoded as latent representations in outcome models ( ma2022learning ; huang2023modeling ; ma2021causal ; wu2025causal ) . However, the black-box nature of these models makes it difficult to define interpretable treatment and spillover effects. More importantly, existing methods struggle to capture spillover effects between pairs of units connected on network. 3 Notations Consider a network with n units \bm{V}=\{1,2,\ldots,n\} . Let \bm{t}=(t_{1},\ldots,t_{n})\in\{0,1\}^{n} denote the treatment assignment vector, where t_{i} is the treatment received by unit i . Under network interference, the potential outcome of unit i is

Read the complete text