Bridging Predictions and Interventions: An Integrated Framework for Automated Decision-Systems

Inioluwa Deborah Raji, Lydia T. Liu, Angela Zhou · 2026

Read Bridging Predictions and Interventions: An Integrated Framework for Automated Decision-Systems by Inioluwa Deborah Raji, Lydia T. Liu, Angela Zhou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-25668.txt.

Introduction

Risk scores and prediction tools now shape bail, triage, and student support decisions, yet better predictions strangely often fail to produce better outcomes. Inioluwa Deborah Raji, Lydia Liu, and Angela Zhou argue in this 2026 perspective that the field grades the wrong thing. A prediction dropped into an organisation rewires workflows, judgements, and incentives around it, so accuracy alone cannot predict downstream effects. Their framework reorients the study of automated decision systems from forecasting individuals toward designing interventions in social systems.

Case evidence runs through the argument: a celebrated sepsis model with strong test scores missed most real cases in outside hospitals while over alerting on the healthy, breeding distrust. Pretrial and education tools show similarly mixed records. The authors propose that evaluation should start from the decision and its setting, treating the prediction as one moving part inside an intervention.

Catalog record

CREATORInioluwa Deborah Raji, Lydia T. Liu, Angela Zhou
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.25668

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bridging Predictions and Interventions: An Integrated Framework for Automated Decision-Systems Inioluwa Deborah Raji, Lydia T. Liu, Angela Zhou Abstract Automated decision systems (ADS) leverage predictions about individual future outcomes to inform consequential decision-making in organizational settings. Across various settings — including criminal pretrial release, clinical triage, student support, and more — it is often assumed that improved predictive accuracy is the priority consideration in determining better downstream outcomes upon the deployment of ADS. In practice, real-world case studies reveal that this is far from the case: introducing individual predictions into decision-making modifies organizational workflows, assessment, and decision-making processes in ways that require a complete re-consideration of our approach to the design, evaluation, and deployment of ADS. As a result, this Perspective develops an integrated framework for studying ADS in social systems, shifting current priorities from a purely prediction-based paradigm towards an intervention-oriented view that accounts for real-world conditions. Our aim is to improve our understanding of ADS and more meaningfully anticipate its downstream societal and organizational consequences. 1 Introduction Automated decision systems (ADS) leverage statistical pattern recognition in historical data to make predictions about individuals. Developed using computational methods ranging from simple regression to more complex generative modeling, the goal of ADS is to inform bureaucratic decision-making ( 66 ) . Organizations cite common reasons for their adoption of ADS: standardized predictive assessments can help structure complex casework, reduce arbitrary variability in decisions, and achieve strong predictive performance in difficult tasks ( 57 ; 36 ) . Yet a central paradox persists: despite the increasing ubiquity of ADS in public life, evidence that its deployments improve social outcomes is slim or inconsistent at best, revealing a substantial gap between predictive performance and real-world impact. While ADS developers report 65–70% accuracy rates in recidivism prediction on undisclosed evaluation data ( 51 ) , it remains unclear whether RATs reduce detainment rates while ensuring public safety as claimed ( 3 ; 25 ) . Similarly, the widely deployed Epic Sepsis Model (ESM) reported a high area-under-the-curve (AUC) performance of over 0.80; yet in external validation, the clinical decision support tool failed to identify 67% of thousands of hospitalized patients with life-threatening sepsis, while simultaneously flagging too many patients without sepsis — prompting user distrust and alert fatigue ( 74 ) . Predictive tools used in early-warning educational systems to identify students at risk of dropout have had equally mixed results ( 19 ; 20 ) , with some sites documenting significant improvements in graduation rates ( 67 ) , while other districts finding weak to null effects on student success ( 58 ) . This landscape of mixed results highlights persistent gaps in our understanding of how ADS manifest in practice. Across domains, myopically focusing on standalone ADS model properties, such as predictive accuracy ( 45 ; 43 ) , rarely translates straightforwardly into any meaningful judgment of improvement to downstream outcomes. Upon deployment, complexities abound: ADS are not just stand-alone artifacts, but operate as bureaucratic interventions, changing how organizations make decisions. In this Perspective, we bridge analysis of ADS prediction accuracy with an expanded understanding of how ADS act as bureaucratic interventions . More specifically, when organizations deploy ADS, they also enact an organizational policy change by modifying processes of individual assessment and decisions . Often focused on limits to predictive accuracy, those that design and deploy ADS typically overlook the importance of how organizations operationalize these tools, i.e., how they adopt, display, and act on predictions. Expanding on community-level findings ( 54 ) , our integrated view can inform new methods of ADS design, evaluation, and implementation to bridge the crucial gap between our understanding of model properties and our judgment of the associated real world consequences. 2 Problem setup ADS are conceptualized to improve or standardize population-level outcomes (e.g. student dropout, patient readmission, recidivism rate) by informing an organization’s decision-makers (e.g. academic advisors, doctors and nurses, or judges) of the underlying risk of an individual decision subject ( 43 ) . This population of individual decision subjects (e.g. students, patients, pre-trial defendants) is often represented by covariate information X_{i} (e.g. demographics and history). Although each subject eventually experiences a measured outcome, Y_{i} (e.g. drop out, re-admission, recidivism), this outcome is often not observable at the point of decision-making. Therefore, the most common ADS is a predictive model R(X)=\mathbb{E}[Y\mid X] that predicts the outcome Y_{i} for each individual decision subject at the point that a decision is being made about that individual. Typical conceptions of ADS focus on (X,R,Y) alone. Yet, as previously discussed, predictive information rarely impacts actual individual outcomes in isolation. Rather, predictions inform downstream decision-makers that in turn affect outcomes. Figure 1 illustrates how this arises across different domains: dropout-prediction directs the decision of who receives additional student advising resources and that in turn is what impacts actual student dropout rates – in the same way, diagnostic prediction informs decisions to triage and treat; and predicted recidivism risk can inform decisions for detention, carceral resource allocation ( 7 ) , supervisory conditions ( 71 ) , or court diversion programs. Figure 1 : Example of predictive ADS and the decisions they inform. Introducing predictions into operational workflows changes consequential decision-making processes. Therefore, in our integrated view, we introduce the additional considerations of assessment — i.e. how predictive information shapes the sorting, categorical arrangement or ranking of individual subjects — and decisions — i.e. intervention actions available to decision-makers that can have a direct material influence on individual decision-subject outcomes. Assessment, \hat{Y} . “Assessment” maps observed individual-level information (i.e. covariates, X_{i} ), to simpler categories that can be used to inform future decisions. In the sepsis prediction example, the assessment is the binary “high-risk label” that pages a nurse or not. In drop-out prediction, the assessment is labeling a student “at-risk of dropout”. Designing a meaningful assessment involves designing the categories and the boundaries between them. Although on-the-ground decision-makers already perform discretionary categorization when taking into account input signals as well as individual beliefs and organizational guidance, “assessment” can also encompass algorithmic categorization. Common practices of algorithmic categorization include thresholding predictive risk scores to high- or low-risk labels \hat{Y}=\mathbb{I}[R(X)>t], that then drive the form of decisions for all within a category. Decision, D . Decisions involve making a choice among the available actions that can be taken by an individual decision maker, typically affecting individual decision subjects. In the education setting, schools guide guidance counselors on which students receive additional resources such as 1:1 student counseling. In sepsis management, hospitals select patients for early intervention. In pre-trial adjudication, judges decide whether or not to release or detain individuals. Predictive output \hat{Y} may inform decision-makers without directly determining which actions should be taken in order to optimize decision utility or downstream outcomes ( 55 ) . When decisions have an unknown causal effect on outcomes, we can use the potential outcomes framework to describe an individual’s outcomes under different decisions ( 68 ) . Each individual is described by their individual attributes (i.e. covariates X ), realized decision(s) D , and realized outcome(s) Y . Each individual has a random vector of potential outcomes Y(d) , d\in\mathcal{D} , and Y(d) indicates the outcome realized under decision D=d . In

Read the complete text