Distributionally Robust Set Representation Learning Under Inference-Time Element Corruption

Yankai Chen, Hanrong Zhang, Bowei He, Philip S. Yu, Xue (Steve) Liu · 2026

Read Distributionally Robust Set Representation Learning Under Inference-Time Element Corruption by Yankai Chen, Hanrong Zhang, Bowei He, Philip S. Yu, Xue (Steve) Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30089.txt.

Introduction

Yankai Chen, Hanrong Zhang, Bowei He, Philip S. Yu and Xue Liu tackle set learning when live models meet damaged inputs, such as outliers or missing parts. Standard methods shine on clean data but ignore corruption at test time. Their SW-DRSO method optimizes a stand-in for the worst-case loss across plausible corrupted variants. A barycentric adversary makes that search tractable with differentiable optimization over simplex weights. Across four tasks, it boosts robustness while keeping overall performance high.

Catalog record

CREATORYankai Chen, Hanrong Zhang, Bowei He, Philip S. Yu, Xue (Steve) Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE80752
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.30089

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Distributionally Robust Set Representation Learning Under Inference-Time Element Corruption Yankai Chen, Hanrong Zhang, Bowei He, Philip S. Yu, Xue (Steve) Liu Abstract Standard Set Representation Learning methods typically excel on curated data but often overlook the challenge of Inference-time Element Corruption . This refers to scenarios where deployed models encounter element-level degradations, such as outliers or missing components, that may distort set representation and degrade performance. We propose SW-DRSO, a distributionally robust optimization framework tailored for sets. Rather than minimizing loss solely on observed training data, SW-DRSO optimizes a tractable surrogate of the worst-case expected loss over a family of plausible inference-time variations. We introduce a barycentric adversary that approximates the intractable search over corrupted sets by a differentiable training-time optimization over simplex weights. Extensive experiments across four tasks demonstrate that SW-DRSO effectively enhances robustness against corruption while maintaining high overall performance. † † affiliationnotice: *Corresponding author. 1 Introduction Set Representation Learning (SRL) aims to encode a unordered collection of elements into a vector while preserving essential set-theoretic properties ( 89 ; 78 ) . This capability is crucial across diverse domains, from processing point clouds ( 69 ) and modeling protein structures ( 64 ) , to enabling batch retrieval and recommendation ( 46 ; 93 ; 70 ; 8 ; 24 ) . Recent methods employ attention mechanisms ( 40 ) , optimal transport formulations ( 78 ; 57 ) , and sophisticated aggregation strategies ( 95 ) to capture complex set structures while adhering to preserve permutation invariance and handle variable cardinality. Figure 1 : Illustration of inference-time element corruption. (a) The corruption leads to variations in the prediction space. (b) While ERM performance degrades on the corrupted set S^{\prime} , our SW-DRSO enhances robustness by optimizing the decision boundary. While standard SRL methods excel on curated data, they often overlook a robustness challenge in practical environments: Inference-time element corruption . Specifically, it refers to scenarios where models trained on clean and complete sets, but are deployed on inputs with element-level degradation at inference time. Such corruption is typically sparse and localized: it affects only a small fraction of elements without altering the overall set theme, i.e., label-preserving . Common examples include outlier points that appear in point clouds due to sensor errors ( 74 ) . Despite their sparsity, as shown in Figure 1 (a), even a few corrupted elements may impact the set encoder and task processing to produce unreliable predictions. For instance, attention-based pooling is vulnerable to outliers that attract disproportionate weights, thereby dominating the global representation ( 97 ) . To handle such inference-time uncertainty, Distributionally Robust Optimization (DRO) offers a principled framewor ( 75 ; 4 ) . By minimizing the worst-case expected loss over a family of plausible distributions, DRO can hedge against unknown inference-tiem corruption patterns ( 71 ) . This approach offers a natural extension beyond standard Empirical Risk Minimization (ERM), which optimizes performance only on nominal training distributions and may fail to generalize when inference-time inputs deviate from the training regime. However, applying DRO directly to SRL problems faces fundamental computational challenges. First, defining the ambiguity regions 1 1 1 The family of plausible corrupted distributions. We use “region” instead of the standard term “ambiguity set” to avoid confusion with the set-structured data itself. is non-trivial for set-structured data. Unlike continuous inputs where ambiguity regions are naturally constructed via norm-bounded perturbations ( 72 ) , sets are discrete and combinatorial. Second, even with a well-defined ambiguity region, solving the inner maximization in conventional DRO formulation to identify the worst cases is computationally prohibitive. This typically requires solving discrete combinatorial optimization with factorial complexity ( 18 ; 36 ) , making the training process unscalable. To address these challenges, we propose SW-DRSO (Sliced-Wasserstein Distributionally Robust Set Optimization), a scalable DRO framework designed for SRL. As shown in Figure 1 (b), it improves the robustness with better optimized decision boundary compared with conventional ERM. Specifically, we first represent sets as empirical measures ( 61 ) and define the corruption region via the Sliced-Wasserstein (SW) metric ( 5 ; 63 ; 2 ) . This formulation enables flexible modeling of corrupted sets without requiring discrete enumeration, while the geometric properties of the SW metric facilitate set encoding and ambiguity region construction. Second, we introduce a data synthesis strategy that approximates the worst-case optimization through Wasserstein barycentric adversaries ( 1 ) . By synthesizing barycenters from local neighborhoods, we transform the intractable search over the combinatorial set space into efficient optimization over a low-dimensional probability simplex (i.e., the convex hull of mixing weights). Our analysis shows that this differentiable parameterization approximates the inner supremum better than discrete optimization. To empirically validate SW-DRSO, we extensively evaluate SW-DRSO across four diverse downstream tasks spanning varied data modalities and distinct corruption patterns, comparing it against state-of-the-art set representation baselines. In summary, our main contributions are three-fold: • We propose SW-DRSO to enable effective distributionally robust optimization for Set Representation Learning. • We formulate and optimize a tractable ambiguity region through barycentric data synthesis, which converts the computationally prohibitive worst-case search into an efficient, differentiable optimization task. • Our results show that SW-DRSO consistently outperforms baselines, enhancing robustness against severe corruptions without compromising accuracy on clean data. 2 Related Work Set Representation Learning (SRL). Representation learning aims to transform raw structured objects into compact embeddings that preserve task-relevant semantics for downstream prediction, retrieval, clustering, and decision making ( 93 ; 8 ; 7 ; 42 ; 44 ; 43 ) . Early methods focus on mapping sets to a Hilbert space using permutation-invariant pooling operations ( 89 ; 78 ; 62 ; 40 ; 95 ; 94 ) . Some architectures learn optimal permutations directly ( 94 ; 73 ) or establish canonical ordering through sorting ( 95 ) . Attention-based mechanisms have also become prominent; 40 adapted the Transformer architecture ( 81 ) for set data, while 31 utilized cross-attention for permutation invariance. Alternative strategies include minimizing discrepancies between sets ( 57 ) , box embeddings ( 39 ) , and fuzzy representations ( 86 ) . For geometric alignments, 78 pioneered Optimal Transport via Bipartite Matching, while 63 ; 12 introduced Sliced-Wasserstein embedding to capture distributional topology. Recent advances include meta-learning ( 19 ; 38 ) , injective embeddings like FSW ( 2 ) , quantum modeling ( 80 ) , and protein language applications ( 64 ) . We adopt ( 63 ) as our set encoder to leverage Sliced-Wasserstein geometric properties. Distributionally Robust Optimization (DRO). DRO improves decision making by optimizing the worst-case expected objective over plausible distributions ( 71 ; 72 ; 4 ) . A central theme of DRO is constructing ambiguity regions ( 71 ; 82 ; 66 ; 56 ; 88 ; 30 ) . Classical formulations include moment-based and divergence-based approaches such as KL-divergence ( 29 ; 96 ; 65 ) , while 79 utilizes kernel mean embeddings in Reproducing Kernel Hilbert Space and 75 minimizes maximum expected loss over predefined groups. Ambiguity regions defined through Wasserstein distance have gained attention ( 36 ; 37 ) . Wasserstein-DRO (WDRO) is appealing due to its geometric interpretability, connections to regularization, and ability to capture distributional shifts ( 18

Read the complete text