A Diagnostic to Find and Help Combat Positivity Issues – with a Focus on Continuous Treatments
Katharina Ring, Michael Schomaker · 2025
Read A Diagnostic to Find and Help Combat Positivity Issues – with a Focus on Continuous Treatments by Katharina Ring, Michael Schomaker (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-11820.txt.
Introduction
Katharina Ring and Michael Schomaker build a diagnostic for a silent flaw in causal studies in a 2025 paper. Causal estimates need positivity: every treatment level must plausibly occur for every kind of person studied. With continuous treatments, violations are common and rarely checked. When one is found, the usual advice is to change the question, the estimand, with little guidance on how.
Their diagnostic shows, person by person, how well the data can support a given estimand, before any model is fitted. Simulations map how treatment policies behave as violations deepen, and where bias should be expected. A drug study in children with HIV illustrates the tool in practice. The authors aim it at applied researchers who must defend their estimand. It answers both whether trouble exists and how to retreat to safer ground.
Catalog record
| CREATOR | Katharina Ring, Michael Schomaker |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-11820
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Diagnostic to Find and Help Combat Positivity Issues – with a Focus on Continuous Treatments Katharina Ring, Michael Schomaker Abstract 1 Department of Statistics, Ludwig-Maximilians University Munich, Geschwister-Scholl-Platz 1, 80539 Munich, Germany 2 Centre for Infectious Disease Epidemiology and Research, University of Cape Town, 7925 Cape Town, South Africa Abstract The positivity assumption is central in the identification of a causal effect, yet is rarely discussed, especially in conjunction with continuous treatments or Modified Treatment Policies. One common recommendation for dealing with a violation is to change the estimand. However, an applied researcher is faced with two problems: First, how can she tell whether there is a positivity violation given her estimand of interest, preferably without having to estimate a model first? Second, if she finds a problem with positivity, how should she change her estimand in order to arrive at an estimand which does not face the same issues? We suggest a novel diagnostic which allows the researcher to answer both questions by providing insights into how well an estimation for a certain estimand can be made for each observation using the data at hand. We provide a simulation study on the general behaviour of different MTPs at different levels of positivity violations and show how the diagnostic helps understand where bias is to be expected. We illustrate the application of our proposed diagnostic in a pharmacoepidemiological study based on data from CHAPAS-3, a trial comparing different treatment regimens for children living with HIV. 1 Introduction Even though the assumption of positivity is essential to most standard causal estimation procedures, it is rarely discussed. In addition, most of the few works that consider consequences and solutions to positivity violations in detail are heavily focused on the binary treatment case, for example because “[…] it is the most commonly explored setting in the existing literature and has a well-developed set of methods available for comparison.” [ 1 , page 1474] . However, continuous treatments are very often of interest in practice [ 2 ] . While positivity violations can be detected via cross tabulation in sufficiently simple binary settings, diagnosing positivity violations in a continuous setting is not trivial as there are always more values the variables can take than there are data points. This shows the need for a diagnostic that helps an applied researcher detecting positivity violations specifically in continuous data. Once a researcher has reached the conclusion that there are positivity issues with an estimand, a common recommendation is to switch the estimand [ 1 ] . Ideally, the researcher will find a compromise making sure the estimand is as close as possible to the original research question and avoiding bias due to positivity issues [ 3 ] . But this reveals another problem: How can a good alternative estimand be found, which solves this trade-off well? Regarding the identification of positivity issues, some tools exist which can be used in continuous treatment cases. Petersen et al. [ 3 ] suggested a parametric bootstrap which given an estimator produces an optimistic estimate of the bias. This tool may not always be very accurate and captures not only positivity issues but also other forms of sparsity, rendering its main purpose serving as a warning sign. The main drawback for this diagnostic is that it is estimator-specific. It can only be used once an estimator has been chosen and does not answer the question if the issue is with the estimator or the data. In addition, once positivity issues are identified with this tool, there is no guidance on what can be done to combat this issue. Another approach suggested by Zhu et al. [ 1 ] is to generalize propensity score based approaches, which are often used in order to deal with positivity issues in binary treatments [ 4 ] , to continuous treatments. The generalized propensity score (GPS) is an estimate of the conditional density of the treatment given the variables of the adjustment set. However, this requires modeling a density first and leaves the researcher with a potentially high-dimensional density estimate, which cannot easily be used to derive information about positivity. In addition, the generalized propensity score assumes that observations with every feature combination require positivity in all potential treatments, but this is only true for a static treatment scheme. As discussed before, changing the estimand, typically to a more elaborate scheme, is one of the solutions to positivity problems, therefore a useful diagnostic needs to work on a large variety of estimands. Finally, the possibility of extrapolation from high density regions is not addressed at all if positivity is diagnosed via the GPS. Recently, Danelian et al. [ 5 ] proposed a regression tree based method to identify sparse areas called positivity regression tree (PoRT) algorithm. Chatton et al. [ 6 ] extended this to longitudinal settings with the sequential PoRT (sPoRT) algorithm. So far the authors have only considered binary exposure, but the algorithm could be adjusted to other types of treatment. However, as the algorithms depend on hyperparameters to define what constitutes a positivity issue, an extension to continuous treatments would mean this non-trivial question has to be answered first, likely falling back to ideas like the GPS. Once a researcher has diagnosed a positivity problem and whishes to change the estimand, they can use one of several estimands with relaxed positivity assumptions. For example, Kennedy [ 7 ] introduced a class of estimands called incremental propensity score interventions which do not rely on any positivity assumption as the propensity score itself is used to define the estimand. While this is potentially an interesting estimand to a researcher facing positivity issues, it solves the trade-off between bias due to positivity issues and closeness to the estimand of interest rather one-sidedly. In addition, the estimand is not necessarily easy to interpret and may not lead to a meaningful conclusion within the research field in question. Another large class of estimands with relaxed positivity assumptions are modified treatment policies (MTP) [ 8 ] . While MTP estimands leave the researcher a lot of options to define an estimand that can likely be estimated without suffering from a high bias due to positivity issues, it remains unclear, which MTPs will result in a satisfactorily low bias. In order to help applied researchers diagnose positivity issues and find good ways to respond to them, we introduce a diagnostic in this work. The diagnostic shows, given an estimand, how much support there is for all n prediction problems of the causal estimand and helps a researcher compare different estimands based on which are likely to avoid bias due to positivity issues given a data set. The diagnostic can also act as a guide to a researcher aiming to tweak an estimand in order to avoid bias due to positivity issues. In the next chapter, the notation and setup of the work is introduced as well as core concepts. In Chapter 3 , the diagnostic is first motivated and then two versions are introduced alongside a guide on how to choose hyperparameters. Chapter 4 contains a simulation study where the diagnostic is applied to different MTPs estimated on data with varying degrees of positivity violations, highlighting the issues