Exploring the heterogeneous impacts of Indonesia’s conditional cash transfer scheme (PKH) on maternal health care utilisation using instrumental causal forests
Vishalie Shah, Julia Hatamyar, Taufik Hidayat, Noemi Kreif · 2025
Read Exploring the heterogeneous impacts of Indonesia’s conditional cash transfer scheme (PKH) on maternal health care utilisation using instrumental causal forests by Vishalie Shah, Julia Hatamyar, Taufik Hidayat, Noemi Kreif (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-12803.txt.
Introduction
Vishalie Shah, Julia Hatamyar, Taufik Hidayat, and Noemi Kreif wrote this 2025 paper on Indonesia's conditional cash transfer scheme, called PKH. The scheme pays poor families who meet health and school conditions. The authors ask whether its effect on mothers' use of health care varies from place to place.
They use a new machine learning method, instrumental causal forests, which hunts for uneven treatment effects. Random assignment to the program serves as an instrument for actually joining it. Four outcomes are tracked: good assisted delivery, delivery in a facility, prenatal visits, and postnatal visits. Effects split sharply by the supply side of care. Mothers in areas with more doctors, nurses, and birth assistants gained more from the scheme. The gap persisted even though the program's design had weighed local readiness.
Catalog record
| CREATOR | Vishalie Shah, Julia Hatamyar, Taufik Hidayat, Noemi Kreif |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-12803
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Exploring the heterogeneous impacts of Indonesia’s conditional cash transfer scheme (PKH) on maternal health care utilisation using instrumental causal forests Vishalie Shah, Julia Hatamyar, Taufik Hidayat, Noemi Kreif Abstract This paper uses instrumental causal forests, a novel machine learning method, to explore the treatment effect heterogeneity of Indonesia’s conditional cash transfer scheme on maternal health care utilisation. Using randomised programme assignment as an instrument for enrollment in the scheme, we estimate conditional local average treatment effects for four key outcomes: good assisted delivery, delivery in a health care facility, pre-natal visits, and post-natal visits. We find significant treatment effect heterogeneity by supply-side characteristics, even though supply-side readiness was taken into account during programme development. Mothers in areas with more doctors, nurses, and delivery assistants were more likely to benefit from the programme, in terms of increased rates of good assisted delivery outcome. We also find large differences in benefits according to indicators of household poverty and survey wave, reflecting the possible impact of changes in programme design in its later years. The impact on post-natal visits in 2013 displayed the largest heterogeneity among all outcomes, with some women less likely to attend post-natal check ups after receiving the cash transfer in the long term. 1 Introduction In recent decades, conditional cash transfer (CCT) programmes have become a popular policy tool in many low- and middle-income countries for alleviating short-term poverty via cash injections, while also improving the long-term trajectory of vulnerable families via investments in human capital ( Parker and Todd,, 2017 ) . Regular cash payments are made to households in exchange for compliance with certain behaviours, such as school attendance for children, or attendance at health check-ups for new mothers, among others. Numerous evaluations of CCTs, mainly based on randomised experiments (for example, PROGRESA in Mexico and PRAF in Honduras), have demonstrated the ability of these interventions to make substantial improvements on education, consumption and health outcomes, particularly in the short-term ( Fiszbein and Schady,, 2009 ; Millán et al.,, 2019 ; Bastagli et al.,, 2019 ; Owusu-Addo et al.,, 2018 ; García and Saavedra,, 2017 ; Lagarde et al.,, 2007 ; Kabeer and Waddington,, 2015 ) . The majority of the CCT evaluation literature to date has focused on average effects, with fewer studies formally analysing whether effects differ for population subgroups defined by observable characteristics. Anti-poverty programmes are expected to impact households differently depending on their ability to convert the cash injections into desirable outcomes, which is highly dependent on their own attributes ( Ravallion,, 2005 ; Cooper et al.,, 2020 ) . For example, urban mothers may already have easier access to preventive health care facilities to satisfy the health requirements for pre- and post-natal check-ups, compared to those in rural regions. The cash injection could assist rural households in addressing some of the financial barriers in accessing health care, such as transport costs. Understanding this type of heterogeneity in programme impacts can help to inform better policy targeting that, among other objectives, identifies households that are expected to benefit the most, and protects those that are expected to benefit the least ( Cooper et al.,, 2020 ) . Of those studies that do in fact explore subgroup effects for pre-specified populations, many find evidence of heterogeneity that is consistent with the broader literature suggesting that CCT effectiveness on health outcomes is modified through various social determinants of health, such as education, wealth and the urban-rural distinction ( Owusu-Addo et al.,, 2018 ; Bastagli et al.,, 2019 ) . In this paper, we contribute to the growing evidence base on the heterogeneous effects of CCT programmes by evaluating Indonesia’s Program Keluarga Harapan (Family Hope Programme, or PKH) using a unique data set from a large-scale randomised experiment that was implemented in 2007 alongside a baseline survey and two follow-up surveys in 2009 and 2013. We are interested in exploring how enrolment into PKH has influenced maternal health care utilisation in the short-term (2009) and the longer-term (2013) by performing separate analyses for both time periods. Existing evaluations of PKH have focused on estimating overall average effects, finding notable improvements in various utilisation outcomes, such as the probability of having a facility delivery, or that the delivery is assisted by trained professionals ( Kusuma et al.,, 2016 ; Cahyadi et al.,, 2020 ) . Few studies have acknowledged that PKH impacts may be heterogeneous, and preliminary subgroup analyses that stratify treatment effects by pre-selected “effect modifiers” (e.g. gender, employment sector, parental education levels), have shown this to be the case. However, traditional approaches to heterogeneous treatment effect estimation (e.g. estimating treatment effects on effect modifier strata, or performing interactions between the treatment variable with effect modifiers in a linear regression) have their own limitations, including potentially arbitrary subgroup analyses and issues of multiple hypotheses testing. Recent developments in machine learning (ML) based estimators of treatment effect heterogeneity use flexible modelling strategies that can identify heterogeneous population subgroups in a more principled way by performing (higher-order) interactions between the treatment variable and baseline characteristics. Generalised random forests, developed by Athey et al., (2019) , have become a popular tree-based ML tool for estimating causal effects, including the conditional average treatment effect (CATE) function, which captures heterogeneity in treatment effects, by searching over the entire covariate space in a data-adaptive manner, rather than focusing on specific covariates selected a priori . We rely on the random assignment of PKH to inform our empirical strategy. While the programme was randomised, actual enrolment was not random, due to non-compliance and targeted assignment within randomised populations. Following ( Cahyadi et al.,, 2020 ) , we address these potential observed and unobserved differences between enrolled and not enrolled groups using an instrumental variable analysis, where we instrument PKH enrolment with theoriginal randomisation mechanism itself. We extend their analysis by focussing on estimating the heterogenous effects of the programme, using the instrumental causal forest approach Athey et al., (2019) ; a variant of generalised random forests that allows for the presence of unmeasured confounding if there is a valid instrument available. This method targets the estimation of the so-called conditional local average treatment effect, characterising how treatment effects vary according to observed characteristics of compliers, in our case mothers who complied with the randomisation protocol. We summarise treatment effect heterogeneity using three approaches: (1) we find the best linear predictors of heterogeneity; (2) we assess how the most and least affected population groups differ in terms of observable characteristics, and (3) we estimate depth-two optimal policy trees and describe which characteristics are chosen as the most important decision criteria for treatment allocation ( Chernozhukov et al., 2018b, ; Semenova and Chernozhukov,, 2021 ; Knaus et al.,, 2021 ; Kennedy,, 2020 ; Athey and Wager,, 2019 ) . This paper has three main contributions. First, we add to the growing collection of CCT evaluation studies that look beyond average impacts and capture heterogenous impacts according to observable differences in covariates. A novel contribution is our use of data-driven methods, in particular tree-based causal ML, to estimate and make inferences on the heterogeneous impacts of a CCT intervention. Our findings could help to support those from existing heterogeneity analyses by identifying potentially new population subgroups