InferF : Declarative Factorization of AI/ML Inferences over Joins Accepted to SIGMOD 2026 as a Full Research Paper DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 Tha

Kanchan Chowdhury a,c , Lixi Zhou a , Lulu Xie a , Xinwei Fu b , Jia Zou a · 2025

Read InferF : Declarative Factorization of AI/ML Inferences over Joins Accepted to SIGMOD 2026 as a Full Research Paper DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 Tha by Kanchan Chowdhury a,c , Lixi Zhou a , Lulu Xie a , Xinwei Fu b , Jia Zou a (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-20489.txt.

Introduction

Chowdhury, Zhou, Xie, Fu, and Zou stop AI models from redoing work on joined data. Their 2025 paper, accepted to SIGMOD 2026, presents the InferF system. Machine learning pipelines often run inference on features joined from many tables. Joins duplicate records massively, so identical computations repeat. Factorized learning splits computations onto the separate source tables instead.

InferF handles arbitrary inference workflows over multi-way joins. Workflows become analyzable expression graphs for fine-grained splitting. Partial computations get pushed down to qualified nodes of the join tree. A greedy method scores placements with a per-node cost model. A genetic algorithm searches for better factorization plans iteratively. The system runs on Velox, Meta's open source database engine. Denormalized IMDB data balloons past one terabyte from 1.2 gigabytes normalized. Tests on real datasets observed speedups up to 11.3 times. The authors map when factorization actually pays off.

Catalog record

CREATORKanchan Chowdhury a,c , Lixi Zhou a , Lulu Xie a , Xinwei Fu b , Jia Zou a
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE110 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-20489

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

InferF : Declarative Factorization of AI/ML Inferences over Joins Accepted to SIGMOD 2026 as a Full Research Paper DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 Thanks: Most of Kanchan Chowdhury’s work is done when he was in ASU; Jia Zou is the corresponding author. Kanchan Chowdhury a,c , Lixi Zhou a , Lulu Xie a , Xinwei Fu b , Jia Zou a Abstract . Real-world AI/ML workflows often apply inference computations to feature vectors joined from multiple datasets. To avoid the redundant AI/ML computations caused by repeated data records in the join’s output, factorized ML has been proposed to decompose ML computations into sub-computations to be executed on each normalized dataset. However, there is insufficient discussion on how factorized ML could impact AI/ML inference over multi-way joins. To address the limitations, we propose a novel declarative InferF system, focusing on the factorization of arbitrary inference workflows represented as analyzable expressions over the multi-way joins. We formalize our problem to flexibly push down partial factorized computations to qualified nodes in the join tree to minimize the overall inference computation and join costs and propose two algorithms to resolve the problem: (1) a greedy algorithm based on a per-node cost function that estimates the influence on overall latency if a subset of factorized computations is pushed to a node, and (2) a genetic algorithm for iteratively enumerating and evaluating promising factorization plans. We implement InferF on Velox, an open-sourced database engine from Meta, evaluate it on real-world datasets, observed up to 11.3 × 11.3\times speedups, and systematically summarized the factors that determine when factorized ML can benefit AI/ML inference workflows. 1. Introduction Running AI/ML inferences over data denormalized from multiple tables is a prevalent pattern in data science pipelines. Out of 2{,}000 most recent Jupyter notebooks involving at least one join, which we crawled from Github, 18.6\% of them contain 6 to 101 joins. Moreover, among the 173{,}851 SQL files in The Stack ( Kocetkov et al. 2022 ) that contain at least one join and represent feature processing and other analytics tasks, 29.6\% involve 6 to 3{,}573 joins. Data denormalization introduces data redundancy, causing redundant AI/ML computations. For example, the normalized IMDB tables require only 1.2 gigabytes of storage, whereas the fully denormalized IMDB tables exceed 1 terabyte ( Huang et al. 2023 ) , representing nearly a 1000{\times} increase due to redundant data replication across joins, which leads to redundant (sub-)inference computations . To address the problem, factorized ML ( Schleich et al. 2016 ; Kumar et al. 2015 ; Schleich et al. 2019 ; Huang et al. 2023 ; Chen et al. 2017 ; Li et al. 2019 ) is proposed to run the end-to-end processing in the database, decompose the ML computations, and push the decomposed computations down through the join operators. However, most of the existing factorized ML works focus on the AI/ML training process, including F ( Schleich et al. 2016 ) for regression models, FL ( Kumar et al. 2015 ) for generalized linear models, LMFAO ( Schleich et al. 2019 ) for decision trees, Bayesian networks, etc., JoinBoost ( Huang et al. 2023 ) for gradient boosting trees, Morpheus ( Chen et al. 2017 ) and MorpheusFI ( Li et al. 2019 ) for linear algebra operators in training workloads. None of the existing in-database factorized ML systems ( Schleich et al. 2019 ; Olteanu and Schleich 2016a ; Schleich et al. 2016 ; Huang et al. 2023 ; Khamis et al. 2018 ; Abo Khamis et al. 2019 ; Olteanu and Schleich 2016b ; Kumar et al. 2015 ; Chen et al. 2017 ; Li et al. 2019 ; Shaikhha et al. 2022 ) have systematically explored the potential of factorized ML for the inference process. In particular, considering the diversity of data and join cardinalities in multi-way join queries, fine-grained factorization of inference computations and selective (group) push-down strategies could yield substantial performance improvements, which haven’t been discussed in any existing works. Furthermore, existing systems primarily focus on factorizing specific ML models, operators, or transformed semirings, making them difficult to generalize to arbitrary inference workflows. To bridge the gap, we first formalize the problem of optimizing AI/ML inference computations over multi-way joins without affecting inference accuracy. In contrast to existing works, which focus on the training processes, our system focuses on factorizing the model inference process. We aim to accelerate the inference of pretrained models over relational data. In our target scenarios, the testing dataset to be scored is first prepared using feature extraction queries, which are then applied with AI/ML inference functions for popular models such as deep neural networks, decision trees, and nearest neighbor search, to drive insights and decision-making. This scenario is ubiquitous in data science pipelines and enterprise ML applications ( Armenatzoglou et al. 2022 ; Bisong and Bisong 2019 ; Boehm et al. 2016 ; Boehm et al. 2019 ; Li et al. 2024 ; Guan et al. 2023 ; Zhou et al. 2024b ; Zhou et al. 2022 ; Guan et al. 2025 ; Zhou et al. 2024a ) . For example, in 130 customer engagements with Microsoft, the requirements of 91\% of them were captured by such batch inference ( Park et al. 2022a ) . Additionally, our work can be applied to more complex inference queries where AI/ML-based filter predicates and projections are nested within SQL ( Park et al. 2022a ; Zhang et al. 2025 ) . It is critical to reduce the end-to-end latency of inference queries to improve user experiences and reduce operational costs, since inference queries drive up to 90\% of costs associated with ML in the enterprise ( ama 2021 ; ama [n.d.] ; Crankshaw et al. 2017 ; Shen et al. 2019 ) . Our work focuses on addressing the following challenges : Challenge-1: Exponential Search Space. Flexibly assigning each group of factorized arbitrary (sub-)computations to datasets or join nodes to minimize execution costs is a new problem, which faces an exponential search space, as analyzed in Sec. 3.4 . Challenge-2: Cost Estimation. Given the diverse inference workflows with different complexity and output dimension size of each factorized sub-computation, different number and cardinalities of join operators, and different sizes of underlying datasets, it is hard to understand the key trade-offs that determine the benefits and costs of each fine-grained factorization and push-down plan. Challenge-3: Arbitrary Inference Workflows. AI/ML inference computations are often encapsulated in UDFs that are opaque to query optimizers, making it hard to analyze which portions of inference workflows are factorizable, and which tables or intermediate joins the computations could be pushed to. To the best of our knowledge, no existing in-DB factorized ML system has addressed the aforementioned challenges. In this work, to address the challenges, we propose a declarative system called InferF with the following key contributions : (1) A New Problem Formalization. Prior systems focus on abstracting the training process as a batch of aggregation queries (e.g., LMFAO ( Schleich et al. 2019 ; Khamis et al. 2018 ; Olteanu and Schleich 2016a ; Schleich et al. 2016 ) ), a semi-ring ( Huang et al.

Read the complete text