Borrowing From the Future: Enhancing Early Risk Assessment through Contrastive Learning
Minghui Sun, Matthew M. Engelhard, Benjamin A. Goldstein · 2025
Read Borrowing From the Future: Enhancing Early Risk Assessment through Contrastive Learning by Minghui Sun, Matthew M. Engelhard, Benjamin A. Goldstein (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-11210.txt.
Introduction
Minghui Sun and co-authors improve early childhood risk prediction by letting models learn from later, richer data, in a 2025 paper. Clinicians judge a child's risks at many stages, from before birth to toddler checkups. Later judgments are naturally more accurate. Care, though, works best when risks are caught early. That tension defines pediatric prediction.
Their framework, Borrowing From the Future, treats each time window as its own modality. Contrastive training aligns early views with later ones. At test time, only early data are needed. The model has already absorbed what the future usually reveals. Tests target early-stage risk scores in child health. Earlier, steadier warnings could trigger support sooner.
Catalog record
| CREATOR | Minghui Sun, Matthew M. Engelhard, Benjamin A. Goldstein |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-11210
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Borrowing From the Future: Enhancing Early Risk Assessment through Contrastive Learning Minghui Sun, Matthew M. Engelhard, Benjamin A. Goldstein Abstract Risk assessments for a pediatric population are often conducted across multiple stages. For example, clinicians may evaluate risks prenatally, at birth, and during Well-Child visits. Although predictions made at later stages typically achieve higher precision, it is clinically desirable to make reliable risk assessments as early as possible. Therefore, this study focuses on improving prediction performance in early-stage risk assessments. Our solution, Borrowing From the Future (BFF) , is a contrastive multi-modal framework that treats each time window as a distinct modality. In BFF, a model is trained on all available data throughout the time while performing a risk assessment using up-to-date information. This contrastive framework allows the model to “borrow” informative signals from later stages (e.g., Well-Child visits) to implicitly supervise the learning at earlier stages (e.g., prenatal/birth stages). We validate BFF on two real-world pediatric outcome prediction tasks, demonstrating consistent improvements in early risk assessments. The code is available at https://github.com/scotsun/bff . 1 1 1 1 † † volume: 298 † † year: 2025 † † workshop: Machine Learning for Healthcare 1 Introduction Clinical risk assessments can be conducted at multiple points in time. For a pediatric population, risk may be assessed prenatally, at birth, and during developmental Well-Child visits ( Lipkin et al. 2020 ) . Numerous studies have leveraged prenatal information to develop clinical prediction models for pediatric outcomes, highlighting important links between maternal prenatal factors and child health ( Beijers et al. 2010 ; Walsh et al. 2019 ; Kong et al. 2024 ) . Risk assessments performed at later time points tend to be more accurate because: (i) additional information has accumulated over watchful waiting, and (ii) the child is temporally closer to the potential onset of the condition, making recent data more predictive of the eventual diagnosis. However, it is clinically desirable to perform risk assessments as early as possible, allowing timely interventions and preventive actions. In this work, our goal is to improve the risk assessment at earlier points in time. A clinical prediction model (CPM) that relies solely on the data from the earlier time windows may have limited performance, since the data may lack explicit and direct predictive relevance to the target outcome. Therefore, we develop a contrastive learning framework to adjust the learning of the early information. In general, contrastive learning improves representation quality by leveraging information from different views of the same sample ( Chen et al. 2020 ; Tian et al. 2020 ) , or by integrating data across different modalities observed from the same sample ( Radford et al. 2021 ) . In existing contrastive methods for sequential data, representations are learned either at the overall sequence level or at individual timestamps ( Gao et al. 2021 ; Yue et al. 2022 ; Lee et al. 2023 ) . However, for our clinical use case, where risk assessments are performed across distinct time windows, we aim to efficiently learn representations at the time window level. To achieve our objective, we introduce Borrowing From the Future (BFF) , a contrastive multi-modal framework that reinterprets modality in a different way. While traditional multi-modal approaches integrate heterogeneous data types (e.g., text and images) to leverage complementary information, our framework takes a different approach. We treat each temporal segment (such as maternal prenatal, at-birth, and child developmental stages) as a distinct modality, thereby converting the single-modality medical code data into a multi-modal configuration. One key element in the BFF framework is the contrastive regularization (CR). Drawing on advances from unsupervised and self-supervised contrastive learning studies ( Oord et al. 2018 ; Tian et al. 2020 ; Radford et al. 2021 ; Yuan et al. 2021 ; Lin and Hu 2022 ) , our CR contains both within-modal and across-modal contrastive losses. This dual strategy supports the learning of distinct temporal features. More importantly, training with across-modal alignment allows early modalities to benefit from stronger predictive signals found in later time points, effectively “borrowing” future information as implicit supervision to enhance patient-specific representations. The principle of supervising less informative modalities using a stronger modality is inspired by the design of CLIP ( Radford et al. 2021 ) , which aligns visual and textual representations through cross-modal supervision. An effective way to aggregate multi-modal representations is crucial in multi-modal learning. We adapt the self-gating mechanism in SE block proposed by Hu et al. 2018 to our multi-modal setting, replacing the original sigmoid gate with softmax gates for different modalities. We term this approach Softmax Self-Gating . This mechanism applies self-modulated softmax scores to individually weight the features from each modality before the final aggregation. Modalities can be easily masked off in the softmax to handle missing data or prevent access to future information during model evaluation. Meanwhile, the gating mechanism provides inherent model explainability, because the softmax scores provide an interpretable measure of the feature-wise attention given to each modality embedding in the final prediction task. To summarize, in the BFF framework, we treat Electronic Health Records (EHR) medical codes observed from different time windows as separate modalities. We use contrastive learning to separately extract modality-specific and patient-specific features. During the learning of patient-specific features, the CR effectively borrows information from the future modality to improve the representation learning in the earlier modalities. We use Softmax Self-Gating to aggregate the multi-modal features. We use two real-world pediatric outcome prediction tasks to show the effectiveness of our framework: a time-to-diagnosis prediction task for Autism Spectrum Disorder (ASD) and a binary outcome prediction task of Recurrent Acute Otitis Media (rAOM). According to the experiment results of these two tasks, BFF improves a CPM’s performance at early risk assessments. Our contributions are as follows: • We propose BFF, a framework that converts uni-modal EHR data to multi-modal data by considering data over different time windows as separate modalities. It leverages contrastive learning to enhance CPMs’ performance at early risk assessments. • We design a contrastive regularization that jointly optimizes within-modal feature understanding and cross-modal representation alignment. The cross-modal alignment, in turn, enriches the representations learned on earlier modalities. • We introduce Softmax Self-Gating, a straightforward yet powerful mechanism for achieving efficient and explainable multi-modal fusion. Generalizable Insights about Machine Learning in the Context of Healthcare Contrastive learning has been extensively explored as an effective approach to enhancing representation learning. In this study, we employ this technique to boost the performance of a CPM in early risk assessments. Data gathered during the child development period are highly relevant to clinical outcomes of interest. We leverage these data as a form of “implicit” supervision to guide the learning of historical information from the maternal prenatal period and at-birth encounter — two clinically significant time windows for early risk assessments. Our proposed framework, BFF, is therefore capable of advancing preventive care for pediatric populations. 2 Related Work Multi-modal Contrastive Learning. InfoNCE ( Oord et al. 2018 ) is a foundational work for contrastive learning and is then extended to various settings. In self-supervised learning (SSL) settings, representations are learnt through within-modal alignment ( Chen et al. 2020 ; He et al. 2020 ; Gao et al. 2021 )