Selective Test-Time Compute Scaling for Click-Through Rate Prediction via Uncertainty-Triggered Feature Path Exploration DOI: 10.1145/1122445.1122456 Conference: Woodstock ’18: ACM Symposium on Neural Gaze Detection; June 03–05, 2018; Woodstock, NY Woodstock ’18: ACM Symposium on Neural Gaze Detection, June 03–05, 2018, Woodstock, NY Price: 15.00 ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Recommender systems CCS: Computing methodologies Neural networks
Moyu Zhang, Yun Chen, Yujun Jin, Jinxin Hu, Yu Zhang, Xiaoyi Zeng · 2026
Read Selective Test-Time Compute Scaling for Click-Through Rate Prediction via Uncertainty-Triggered Feature Path Exploration DOI: 10.1145/1122445.1122456 Conference: Woodstock ’18: ACM Symposium on Neural Gaze Detection; June 03–05, 2018; Woodstock, NY Woodstock ’18: ACM Symposium on Neural Gaze Detection, June 03–05, 2018, Woodstock, NY Price: 15.00 ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Recommender systems CCS: Computing methodologies Neural networks by Moyu Zhang, Yun Chen, Yujun Jin, Jinxin Hu, Yu Zhang, Xiaoyi Zeng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24989.txt.
Introduction
Moyu Zhang leads UTTSI, spending test-time compute where click calls waver. Test-time scaling helps language models, but click models face asymmetry: known mixes stay confident, while sparse mixes waver. Training-phase fixes learn one fixed rule, no per-case recourse. UTTSI pairs logit confidence with a frequency prior to separate true uncertainty from ambiguity. All cases get adaptive filtering; uncertain cases get stochastic exploration pooled by consistency. Sure cases skip exploration, holding overhead near three times base cost. Four data sets confirm consistent gains.
Catalog record
| CREATOR | Moyu Zhang, Yun Chen, Yujun Jin, Jinxin Hu, Yu Zhang, Xiaoyi Zeng |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60484 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.24989
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Selective Test-Time Compute Scaling for Click-Through Rate Prediction via Uncertainty-Triggered Feature Path Exploration DOI: 10.1145/1122445.1122456 Conference: Woodstock ’18: ACM Symposium on Neural Gaze Detection; June 03–05, 2018; Woodstock, NY Woodstock ’18: ACM Symposium on Neural Gaze Detection, June 03–05, 2018, Woodstock, NY Price: 15.00 ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Recommender systems CCS: Computing methodologies Neural networks Moyu Zhang, Yun Chen, Yujun Jin, Jinxin Hu, Yu Zhang, Xiaoyi Zeng Abstract . Scaling test-time compute has proven highly effective for language models, yet the analogous opportunity in industrial Click-Through Rate (CTR) prediction remains largely unexplored. CTR models suffer from a fundamental asymmetry: while training exposes the model to diverse feature combinations, at inference time many combinations are sparsely observed, causing unreliable predictions for a non-trivial fraction of instances. Existing training-phase solutions such as adaptive gating and feature interaction architectures learn a fixed selection function that is itself subject to the same sparsity, offering no per-instance recourse at deployment. We argue that a principled solution requires deciding how much computation each instance deserves after observing it, rather than applying a uniform inference procedure to all. To this end, we propose UTTSI ( U ncertainty- T riggered T est- T ime S elective I nference), a training-free model-agnostic framework that scales inference depth proportionally to per-instance uncertainty. UTTSI estimates uncertainty from two complementary signals: a model-internal logit confidence score and a data-level frequency prior, which together distinguish epistemic uncertainty due to sparse feature coverage from aleatoric ambiguity near the decision boundary. Based on this estimate, every instance first undergoes adaptive feature filtering that removes embeddings with insufficient training support, and uncertain instances additionally receive a variable number of stochastic feature-path explorations proportional to their estimated uncertainty, whose predictions are aggregated via consistency-weighted ensembling. Confident instances bypass exploration entirely, keeping the average overhead to approximately 2.8 × 2.8\times base model cost while maintaining worst-case latency equal to a single forward pass on parallelized serving infrastructure. Extensive experiments demonstrate that UTTSI yields significant improvements over all baselines. 1. Introduction Click-through rate (CTR) prediction models are core modules of recommendation systems. They facilitate accurate recommendations by predicting a user’s click probability on a target item ( back1 ; back2 ; back3 ; back4 ) , as shown in Figure 1 (a). The prediction is derived from modeling the interactions among a vast combination of input features, encompassing user profiles and item attributes ( fm ; deepfm ; autoint ; sfpnet ; pepnet ) . Therefore, effectively modeling these feature interactions is crucial for accurate prediction in CTR tasks ( genctr ; dgenctr ) . With recent advances in deep learning, numerous studies have proposed increasingly complex model architectures to capture feature correlations ( gate1 ; gate2 ; hstu ) , while others have explored generative paradigms to overcome the limitations of the discriminative binary label space ( mtgr ; dgenctr ; onerec ) . Figure 1. A comparison of CTR inference paradigms. (a) Standard inference feeds all features directly into the model. (b) Naive multi-path exploration applies uniform feature subset sampling to all instances, incurring unnecessary computation for easy ones. (c) UTTSI estimates per-instance uncertainty and routes accordingly: confident instances undergo lightweight feature filtering only, while uncertain instances receive additional multi-path exploration with consistency-weighted aggregation. Despite significant advances in model architecture and training objectives ( dgenctr ; mtgr ) , existing CTR research has focused almost exclusively on the training phase, leaving the optimization potential of the inference phase largely unexplored. In practice, even well-trained models exhibit substantially different prediction reliability across instances during inference. For feature combinations that are well-represented in training data, the model produces confident and accurate predictions. However, for combinations that are sparse or previously unseen, the model’s learned representations become unreliable, often leading to representation collapse and high prediction uncertainty ( emb1 ; rcola ) . This per-instance reliability gap cannot be adequately addressed by training-time mechanisms alone. Although adaptive gating and attention mechanisms ( erase ; gate1 ; gate2 ; pepnet ) are designed to dynamically weight features, they learn a single deterministic selection function that is itself subject to the same data sparsity: when the model lacks sufficient training observations for a feature combination, its learned gating decisions for that combination are equally unreliable. More fundamentally, training and inference have inherently asymmetric objectives. The training phase benefits from exposure to diverse patterns, including sparse ones, to learn generalizable feature representations. In contrast, the inference phase should prioritize leveraging only the feature combinations that the model has already learned to evaluate reliably, thereby avoiding the disruptive influence of unreliable features on prediction accuracy. This asymmetry motivates test-time optimization as a complementary paradigm to training-phase improvements. Rather than relying on a single learned decision function, test-time optimization can explore multiple plausible feature configurations for a given instance and aggregate predictions from these diverse paths, deriving robustness from the diversity of exploration rather than the accuracy of any single gate. Moreover, by deferring the allocation of additional computation until the actual instance is observed, test-time optimization enables selective budget allocation: investing extra test-time computation only in samples that exhibit high uncertainty, while avoiding unnecessary overhead for confident predictions. This selective property is particularly valuable in industrial systems ( gen1 ; gen2 ; p5 ; tiger ; lcrec ; idrec ) , where the escalating training costs of ever-larger models make maximizing the return on already-trained parameters an increasingly important goal. While recent works have begun to explore the test-time paradigm in recommendation ( tta ) , these efforts have primarily focused on augmenting user behavior sequences for sequential recommendation and fail to address the fundamental problem of feature combination sparsity that plagues CTR prediction. Sequence augmentation techniques such as item dropout or reordering are inherently inapplicable to CTR, which operates on sparse categorical feature fields rather than dense item sequences; perturbing feature values does not carry the same semantic continuity, and the per-combination reliability differential that drives prediction uncertainty in CTR has no counterpart in sequential settings. Moreover, directly transferring test-time scaling techniques from Large Language Models (LLMs) ( ttl1 ; ttl2 ) is infeasible, as LLM methods rely on token-level generation likelihoods for confidence assessment, a mechanism absent in CTR models with binary classification objectives. This gap motivates us to rethink what test-time optimization should look like for CTR prediction. The core challenge is not merely generating multiple feature views, but doing so in a way that is grounded in per-instance reliability . As illustrated in Figure 1 (b), even a straightforward multi-path extension to CTR—which generates diverse feature subsets and aggregates their predictions—fails to address the fundamental issue: without knowing which features are unreliable for a given instance, the exploration paths may repeatedly include noise features, and the aggregation cannot distinguish useful diversity from redundant variation. The severity of this problem is compounded by the power-law frequency distribution typical of industrial CTR data: a small fraction of feature values dominates training observations, while the vast majority appear only a handful of times, and prior work has shown that such tail-value embeddings can be statistically indistinguishable from randomly initialized ones ( emb1 ; rcola ) . Developing an effective uncertainty-driven test-time paradigm for CTR therefore requires addressing two challenges: (1) how to