DLF: Enhancing Explicit-Implicit Interaction via Dynamic Low-Order-Aware Fusion for CTR Prediction

Kefan Wang, Hao Wang, Wei Guo, Yong Liu, Jianghao Lin, Defu Lian, Enhong Chen · 2025

Read DLF: Enhancing Explicit-Implicit Interaction via Dynamic Low-Order-Aware Fusion for CTR Prediction by Kefan Wang, Hao Wang, Wei Guo, Yong Liu, Jianghao Lin, Defu Lian, Enhong Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-19182.txt.

Introduction

Kefan Wang and co-authors sharpen click forecasts by guarding the simple links. Their 2025 paper deals with click-through rate prediction, the gauge behind online ads and ranking. Plain feature pairs state clear links but thin out in sparse data. Deep nets learn rich patterns yet wash out those simple links. Two-stream blends share too little and train unevenly.

Their frame, DLF, adds a low-order network that keeps simple signals while trimming echo from shortcuts. A fusion block then blends plain and deep streams at each layer with learned weights. Tests on public data put DLF at the front, and the code is public, the team reports.

Catalog record

CREATORKefan Wang, Hao Wang, Wei Guo, Yong Liu, Jianghao Lin, Defu Lian, Enhong Chen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-19182

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DLF: Enhancing Explicit-Implicit Interaction via Dynamic Low-Order-Aware Fusion for CTR Prediction Kefan Wang, Hao Wang, Wei Guo, Yong Liu, Jianghao Lin, Defu Lian, Enhong Chen Abstract . Click-through rate (CTR) prediction is a critical task in online advertising and recommender systems, relying on effective modeling of feature interactions. Explicit interactions capture predefined relationships, such as inner products, but often suffer from data sparsity, while implicit interactions excel at learning complex patterns through non-linear transformations but lack inductive biases for efficient low-order modeling. Existing two-stream architectures integrate these paradigms but face challenges such as limited information sharing, gradient imbalance, and difficulty preserving low-order signals in sparse CTR data. We propose a novel framework, D ynamic L ow-Order-Aware F usion ( DLF ), which addresses these limitations through two key components: a Residual-Aware Low-Order Interaction Network (RLI) and a Network-Aware Attention Fusion Module (NAF). RLI explicitly preserves low-order signals while mitigating redundancy from residual connections, and NAF dynamically integrates explicit and implicit representations at each layer, enhancing information sharing and alleviating gradient imbalance. Together, these innovations balance low-order and high-order interactions, improving model expressiveness. Extensive experiments on public datasets demonstrate that DLF achieves state-of-the-art performance in CTR prediction, addressing key limitations of existing models. The implementation is publicly available at https://github.com/USTC-StarTeam/DLF . Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’25), July 13–18, 2025, Padua, Italy DOI: 10.1145/3726302.3729956 ISBN: 979-8-4007-1592-1/2025/07 CCS: Information systems Recommender systems 1. Introduction Figure 1. Drawbacks of deep explicit interaction and deep implicit interaction Recommender systems have become ubiquitous in digital platforms, helping users navigate through vast amounts of content by providing personalized suggestions based on their preferences and behaviors ( Tong et al., 2024 ; Zhang et al., 2024c ; Yin et al., 2024a ; Xie et al., 2024a ; Gu et al., 2025 ) . Click-through rate (CTR) prediction is a fundamental task in online advertising and recommender systems ( Graepel et al., 2010 ; He et al., 2014 ; Richardson et al., 2007 ; Liu et al., 2023 ; Wang et al., 2025a ; Wu et al., 2024 ) . It aims to estimate the probability that a user will click on a given item, such as an advertisement or a recommended product, based on the user’s historical behavior ( Xu et al., 2024 ; Wang et al., 2024 ; Han et al., 2024 ) , item attributes ( Wang et al., 2025b ; Wang et al., 2021a ; Ye et al., 2025 ) , and contextual information ( Shen et al., 2024b ) . Accurate CTR prediction is critical, as it directly affects the quality of recommendations, user engagement, and platform revenue. Typically, CTR prediction models take various features as input, encode them into dense representations, and then predict the likelihood of user clicks through learned feature interactions ( Wang et al., 2017 ; Guo et al., 2017 ) . A major challenge in CTR prediction lies in effectively modeling feature interactions, which are the relationships between different input features. These interactions can be categorized into explicit interactions and implicit interactions. Explicit interactions ( Rendle, 2010 ; Xiao et al., 2017 ) are those that are directly modeled or predefined, such as the interaction between two feature embeddings using mathematical operations like the inner product. Implicit interactions ( Mao et al., 2023 ) , on the other hand, are automatically learned by neural networks through non-linear transformations, without requiring explicit definitions. Both types of interactions are essential for accurately modeling user behavior in CTR tasks, as they provide complementary information about user preferences. Recent advances in feature interaction modeling have led to the development of two main paradigms: explicit interaction models and implicit interaction models. Explicit interaction models, such as FM ( Rendle, 2010 ) and CIN ( Lian et al., 2018 ) , leverage inductive biases to efficiently capture low-order or high-order feature interactions. However, these methods often suffer from data sparsity issues ( Zhang et al., 2025b ; Zhang et al., 2025a ; Han et al., 2023 ; Yin et al., 2024c ; Yin et al., 2024b ) , which degrade their ability to learn robust high-level representations. On the other hand, implicit interaction models, such as multi-layer perceptrons (MLPs) ( Mao et al., 2023 ) , excel at capturing complex feature relationships through non-linear transformations. Yet, MLPs lack the inductive biases necessary for efficiently modeling simple operations like inner products ( Rendle et al., 2020 ) , which limits their ability to learn explicit patterns. This fundamental trade-off has motivated the development of two-stream models, such as DeepFM ( Guo et al., 2017 ) , DCN ( Guo et al., 2017 ) , and xDeepFM ( Lian et al., 2018 ) , which aim to integrate explicit and implicit interaction modeling into a unified framework. Despite their success, two-stream models face several critical limitations. As shown in Figure 1 , traditional two-stream architectures typically model explicit and implicit interactions independently, combining them only at the final layer. This separation leads to two major issues. First, the lack of interaction between the two streams prevents effective information sharing, which is particularly problematic as explicit streams struggle with data sparsity ( Deng et al., 2021a ; Liu et al., 2020b ) , while implicit streams fail to efficiently capture multiplicative feature interactions ( Rendle et al., 2020 ) . Second, the separation exacerbates gradient imbalance during backpropagation ( Hu et al., 2019 ) , where one stream may dominate the optimization process, hindering the overall convergence and expressiveness of the model. Furthermore, the effectiveness of residual connections in propagating low-order signals can be influenced by the unique characteristics of CTR data. Due to the inherent sparsity of CTR features and the potential limitations of feature embeddings, the representational quality of low-order signals may degrade as they are propagated through residual pathways. This leads to a compression of the vector space, where suboptimal embeddings occupy valuable representational capacity, thereby limiting the network’s ability to model complex high-order interactions. To address these limitations, we propose a novel framework, D ynamic L ow-Order-Aware F usion (DLF) , which enables more effective and efficient explicit-implicit interaction modeling. The proposed framework introduces two key innovations: a Residual-Aware Low-Order Interaction Network (RLI) and a Network-Aware Attention Fusion Module (NAF) , which work together to overcome the challenges faced by existing two-stream models. The RLI network is designed to explicitly preserve low-order signals while avoiding redundancy and interference caused by residual connections. Instead of relying solely on residual mechanisms to propagate low-order information, the RLI network introduces an additional pathway that explicitly captures low-order interactions between the initial feature embeddings and the current layer representations. This ensures that low-order features are preserved throughout the network, even as the depth of the interaction layers increases. To further address the potential conflict between residual signals and low-order interactions, a dynamic control mechanism is incorporated to adaptively balance their contributions. This design not only mitigates the sparsity issues faced by explicit streams but also enhances the overall expressiveness of the model by balancing low-order

Read the complete text