Synthesize, Retrieve, and Propagate: A Unified Predictive Modeling Framework for Relational Databases

Ning Li, Kounianhua Du, Han Zhang, Quan Gan, Minjie Wang, David Wipf, Weinan Zhang · 2025

Read Synthesize, Retrieve, and Propagate: A Unified Predictive Modeling Framework for Relational Databases by Ning Li, Kounianhua Du, Han Zhang, Quan Gan, Minjie Wang, David Wipf, Weinan Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-08327.txt.

Introduction

Ning Li and co-authors present a framework called SRP for making predictions from data stored across many linked tables, in a paper from 2025. Linked tables are the standard way firms store large, mixed data. Their structure makes it hard to use deep learning tools built for flat data. Past work either merged tables into one or built a graph from key links.

The new framework works in three steps. It builds new features from the links between tables. It then pulls in related rows that share deeper ties, not just direct keys. Last, it passes messages across a graph so each row learns from its neighbors. Tests on five real data sets show the method works well. The authors also break down which parts help most, to guide later use in industry.

Catalog record

CREATORNing Li, Kounianhua Du, Han Zhang, Quan Gan, Minjie Wang, David Wipf, Weinan Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-08327

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Synthesize, Retrieve, and Propagate: A Unified Predictive Modeling Framework for Relational Databases Ning Li, Kounianhua Du, Han Zhang, Quan Gan, Minjie Wang, David Wipf, Weinan Zhang Abstract Relational databases (RDBs) have become the industry standard for storing massive and heterogeneous data. However, despite the widespread use of RDBs across various fields, the inherent structure of relational databases hinders their ability to benefit from flourishing deep learning methods. Previous research has primarily focused on exploiting the unary dependency among multiple tables in a relational database using the primary key - foreign key relationships, either joining multiple tables into a single table or constructing a graph among them, which leaves the implicit composite relations among different tables and a substantial potential of improvement for predictive modeling unexplored. In this paper, we propose SRP, a unified predictive modeling framework that S ynthesizes features using the unary dependency, R etrieves related information to capture the composite dependency, and P ropagates messages across a constructed graph to learn adjacent patterns for prediction on relation databases. By introducing a new retrieval mechanism into RDB, SRP is designed to fully capture both the unary and the composite dependencies within a relational database, thereby enhancing the receptive field of tabular data prediction. In addition, we conduct a comprehensive analysis on the components of SRP, offering a nuanced understanding of model behaviors and practical guidelines for future applications. Extensive experiments on five real-world datasets demonstrate the effectiveness of SRP and its potential applicability in industrial scenarios. The code is released at https://github.com/NingLi670/SRP. 1 Introduction The advent of the digital age has led to an exponential increase in the generation and storage of data, which is predominantly housed in relational databases due to their efficiency and structured design ( Zahradník, Neumann, and Šír 2023 ) . Relational databases (RDBs) ( Chamberlin 1976 ) have become the industry standard across diverse fields such as recommendation systems ( Sarwat, Avery, and Mokbel 2013 ) , engineering ( Yaqoob et al. 2022 ) , and enterprise applications ( Halpin and Morgan 2010 ) . Despite the widespread use of RDBs, the application of advanced machine learning models, particularly neural models, on this form of data is limited ( Zhang et al. 2024 ) due to the inherent structure. Unlike the fixed-size numeric tensors used in machine learning models, an RDB consists of interlinked table structures with heterogeneous features. This discrepancy necessitates different approaches to processing RDB data and learning its representation. Figure 1: Illustration of different solutions and difference between unary and composite dependencies. Previous works extract the dependencies among tables within an RDB using foreign key - primary key (FK-PK) relationships, either by merging multiple tables into a single table or constructing a graph from multiple tables, followed by a traditional tabular model or graph neural network for predictions, as illustrated in the upper part of Figure 1 . This dependency pattern is unary, constrained by the inherent connections between the unary FK column and PK column in an RDB. As depicted in the lower left of Figure 1 , the target instance with an unknown label can only gather information from instances sharing the same user or item along the inherent FK-PK connections. However, the implicit composite relations within an RDB still remain unexplored, which could be of great help for prediction. As shown in the lower right of Figure 1 , by retrieving similar instances using composite attributes, the target instance can access information that is not explicitly connected in the original RDB. Motivated by this, we aim to design a framework that extensively explores these richer dependencies within an RDB to achieve better prediction performance. In this paper, we propose Synthesis-Retrieval-Propagation (SRP), a novel unified predictive framework that captures both the unary and the composite dependencies among relational databases, enlarging the receptive field of tabular data prediction. Conceptually, unary dependency refers to the direct relationship between entities through FK-PKs, typically constructed as the connections between two unary columns, whereas composite dependency refers to the complex, often indirect relationship between entities that are not explicitly defined by FK-PK connections in the database schema. These dependencies arise from composite attributes and contextual similarities between entities, which can be discovered through methods such as retrieval-based similarity measures ( Qin et al. 2021 ; Zheng et al. 2023 ) . The SRP framework consists of three key modules: synthesis, retrieval, and propagation. Given a target instance, i.e., a particular row in the target table of the considered RDB, the synthesis module generates additional features along the FK-PK connections from related tables in the RDB, extracting unary dependencies. The retrieval module builds new relationships beyond the original FK-PKs to capture the implicit composite dependencies by performing retrieval and top- K ranking based on the rich attributes of entities. The propagation module then learns adjacent patterns, utilizing the retrieval information through message passing. The final prediction is made by integrating the representations from different modules, effectively fusing the unary and composite dependencies. As a result, SRP yields a solution model that traverses all tables within the RDB, synthesizing new features and constructing new connections beyond the existing FK-PK relationships. This enables SRP to capture both explicit and implicit information from all tables, constructing a comprehensive representation of the data. The main contributions can be summarized in three folds: • SRP framework . We propose a framework named SRP that captures both the unary and the composite dependencies within a relational database through synthesis, retrieval, and propagation. This unified framework is adaptable to various types of RDBs. • Introduce retrieval to RDB prediction . Leveraging the retrieval algorithm, we uncover the implicit connected information beyond the inherent FK-PK relationships for modeling complex composite dependencies in RDBs. To the best of our knowledge, SRP is the first framework to introduce the retrieval mechanism for predictive tasks in relational databases. • SOTA performance and comprehensive analysis . Experiments on five real-world datasets demonstrate that SRP consistently outperforms a wide range of competitive baselines, achieving state-of-the-art performance. Furthermore, our empirical analysis reveals that RDBs with diverse characteristics, such as limited attributes, sparse relational structures, or imbalanced distributions, exhibit different preferences for the SRP modules. 2 Related Works Feature Engineering. Early approaches relied on manual feature engineering for predictive tasks on relational databases ( Chen, Han, and Yu 2002 ; Nisbet, Elder, and Miner 2009 ) , but this process is labor-intensive and heavily dependent on domain expertise. To automate this process, methods such as DFS ( Kanter and Veeramachaneni 2015 ) , OneBM ( Lam et al. 2017 ) , R2N ( Lam et al. 2018 ) , and DAFEE ( Zhao et al. 2020 ) have been proposed. These techniques construct features by following join paths or table relationships, using either rule-based transformations or neural models. However, they primarily capture unary dependencies along FK-PK paths and often rely on simple aggregation strategies, which may discard important information. In contrast, our SRP framework introduces a retrieval mechanism to build richer, cross-table dependencies and employs a frequency-aware aggregator to better preserve valuable patterns. Relational Deep Learning. Recent works have focused on converting relational databases into graphs. Methods like RDB2Graph and 4dbinfer ( Wang et al. 2024 ) represent table rows

Read the complete text