Supplementary Material

Zi-Hao Zhou, Jun-Jie Wang, Tong Wei, Min-Ling Zhang · 2025

Read Supplementary Material by Zi-Hao Zhou, Jun-Jie Wang, Tong Wei, Min-Ling Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-22028.txt.

Introduction

Zi-Hao Zhou and co-authors tackle a weak spot in contrastive learning, a method that trains models by pulling like examples together and pushing unlike ones apart. Labels in real data are often fuzzy or wrong, so pairs built from labels can mislead the model. Their 2025 paper replaces hard labels with a softer measure.

The new measure, called continuous semantic similarity, scores how close two examples sit in meaning, and sharpens itself as training goes on. Pairs become edges in a graph, weighted by that score. Tests on noisy-label and partial-label tasks show clear gains when the frame is added to old methods. A math bound shows the approach can near fully supervised results.

Catalog record

CREATORZi-Hao Zhou, Jun-Jie Wang, Tong Wei, Min-Ling Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE160 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-22028

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Supplementary Material Zi-Hao Zhou, Jun-Jie Wang, Tong Wei, Min-Ling Zhang Abstract Contrastive learning has achieved remarkable success in learning effective representations, with supervised contrastive learning often outperforming self-supervised approaches. However, in real-world scenarios, data annotations are often ambiguous or inaccurate, meaning that class labels may not reliably indicate whether two examples belong to the same class. This limitation restricts the applicability of supervised contrastive learning. To address this challenge, we introduce the concept of “continuous semantic similarity” to define positive and negative pairs. Instead of directly relying on imprecise class labels, we measure the semantic similarity between example pairs, which quantifies how closely they belong to the same category by iteratively refining weak supervisory signals. Based on this concept, we propose a graph-theoretic framework for weakly-supervised contrastive learning, where semantic similarity serves as the graph weights. Our framework is highly versatile and can be applied to many weakly-supervised learning scenarios. We demonstrate its effectiveness through experiments in two common settings, i.e., noisy label and partial label learning, where existing methods can be easily integrated to significantly improve performance. Theoretically, we establish an error bound for our approach, showing that it can approximate supervised contrastive learning under mild conditions. The implementation code is available at https://github.com/Speechless-10308/WSC . † † affiliationnotice: Equal contribution 1 Introduction In recent years, there has been a resurgence of research in contrastive learning, which has led to significant advancements in the field of representation learning ( He et al., 2020 ; Oord et al., 2018 ; Chen et al., 2020 ; Caron et al., 2020 ; Zbontar et al., 2021 ; Khosla et al., 2020 ) . These works share a common underlying principle: they aim to pull an anchor and its corresponding “positive” examples closer together in the embedding space, while simultaneously pushing the anchor away from a set of “negative” examples. In self-supervised contrastive learning, positive examples are generated through various data augmentation techniques applied to the original samples, thereby creating different views or representations of the same data instance. Negative examples, on the other hand, are randomly selected from different samples, as illustrated in Figure 1(a) . In contrast, fully-supervised contrastive learning utilizes additional supervisory information by treating samples from the same class as positive pairs, thereby constructing multiple positive examples ( Khosla et al., 2020 ) , as shown in Figure 1(b) . However, real-world supervisory information is often inaccurate and ambiguous ( Lin et al., 2023 ; Zhang et al., 2021b ; Wang et al., 2022 ; Zhang et al., 2022 ; Guo et al., 2020 ; Guo et al., 2025 ) , manifesting as weakly-supervised information such as noisy labels ( Amsaleg et al., 2017 ; Yan et al., 2013 ) and partial labels ( Luo and Orabona, 2010 ; Chen et al., 2018 ; Dong et al., 2023 ) , which cannot directly indicate class membership between samples. As a result, traditional methods fail to effectively utilize weak supervisory information, significantly limiting the applicability of supervised contrastive learning in real-world tasks. To address the limitations of existing methods, we introduce a more general concept of positive and negative examples: continous semantic similarity. Samples with a higher likelihood of belonging to the same category are assigned higher semantic similarity, where values of 1 and 0 correspond to positive and negative pairs in traditional contrastive learning, respectively. This can be viewed as a continuous extension of the conventional positive-negative example framework. Furthermore, as illustrated in Figure 1(c) , we extend the contrastive learning objective to align the feature similarity of two samples with their corresponding semantic similarity. (a) Self-supervised Contrastive (b) Supervised Contrastive (c) Weakly-supervised Contrastive Figure 1: (a) Self-supervised contrastive learning constructs positive example pairs by using different views of the same image and constructs negative example pairs by using different images. (b) Supervised contrastive learning further regards different images of the same class as additional positive example pairs. (c) Our proposed weakly-supervised contrastive learning abandons the concepts of discrete positive and negative examples. Specifically, we formulate a graph-theoretic framework for weakly-supervised representation learning, where vertices represent augmented data points and edges are defined by their corresponding semantic similarity. The semantic similarity is constructed from two perspectives. First, data points derived from different views of the same instance are assigned a relatively high semantic similarity. Second, we leverage the corresponding weakly-supervised information to approximate whether two samples belong to the same class, thereby constructing the semantic similarity between data points from different instances after augmentation. By modeling semantic similarities using the provided weakly-supervised information, our method is highly versatile and applicable to various weakly-supervised learning scenarios, including noisy label and partial label settings. The contrastive loss derived from our framework is straightforward to implement, stable during training, and can be seamlessly integrated as a plug-and-play component, consistently enhancing the performance of existing methods in weakly-supervised learning. Additionally, we provide a comprehensive theoretical analysis of the method’s performance, deriving the downstream error bound for feature learning using our contrastive loss under various weakly-supervised settings. The analysis shows that, under mild conditions, our framework can approximate the performance achievable with fully-supervised information, thus theoretically ensuring its effectiveness. In summary, our main contributions are summarized below: • We propose a unified framework for contrastive learning that leverages weakly-supervised information, including noisy and partial labels. By introducing the concept of semantic similarity as a generalization of positive and negative examples, our framework offers new insights into how contrastive learning can effectively utilize ambiguous supervisory information. • The loss derived from our framework is highly versatile and can be seamlessly integrated into a wide range of weakly-supervised learning settings, consistently leading to performance improvements. Notably, our approach shows substantial gains in challenging settings with high noise and partial label rates, achieving improvements of 6.8% and 7.8% , respectively, underscoring its robustness and effectiveness in addressing real-world weak supervision challenges. • Our theoretical analysis offers a rigorous performance guarantee for the proposed framework, showing that it can approximate supervised contrastive learning under mild conditions and elucidating how and to what extent weakly-supervised information can enhance the effectiveness of representation learning. 2 Weakly-Supervised Contrastive Learning We describe the setup and goal of weakly-supervised learning. Let \mathcal{X} denote instance space and \mathcal{Y}=\{y^{1},y^{2},\dots,y^{c}\} denote label space. \mathcal{D} denotes the joint distribution \left(\mathcal{X},\mathcal{Y}\right) . Furthermore, given \mathcal{Q}=\{q^{1},q^{2},\dots,q^{v}\} denotes weakly-supervised information space. We denote \mathcal{D}_{\mathcal{Q}} as the joint distribution (\mathcal{X},\mathcal{Q}) which generated form \mathcal{D} with process \mathcal{D}_{\mathcal{Q}}(x)=\mathcal{D}(x),\mathcal{D}_{\mathcal{Q}}(\boldsymbol{q}\mid x)=\boldsymbol{T}(x)\mathcal{D}(\boldsymbol{y}\mid x) , where \mathcal{D}_{\mathcal{Q}}(\boldsymbol{q}\mid x) and \mathcal{D}(\boldsymbol{y}\mid x) denote \left[\mathcal{D}_{\mathcal{Q}}(q^{1}\mid x),\dots,\mathcal{D}_{\mathcal{Q}}(q^{v}\mid x)\right]^{T} and \left[\mathcal{D}(y^{1}\mid x),\dots,\mathcal{D}(y^{c}\mid x)\right]^{T} , respectively and \boldsymbol{T}(x)\in\mathbb{R}^{v\times c} is the transition matrix with \boldsymbol{T}(x)_{i,j}=\mathcal{D}_{\mathcal{Q}}(q^{i}\mid x,y^{j}) . In this paper, we consider two popular weakly-supervised settings with different data generation processes, namely instance-independent and instance-dependent. The former satisfies the condition of \boldsymbol{T}(x) is independent of the samples, whereas the latter does not. The objective of learning with weak supervision is to derive a multi-class predictive model h from weakly-supervised training set D=\{\left(x_{i},q_{i}\right)\}_{i=1}^{m}\sim\mathcal{D}_{\mathcal{Q}}^{m} . For brevity, we denote \mathbb{P} as probability of joint distribution (\mathcal{X},\mathcal{Y},\mathcal{Q}) induced by \mathcal{D} and \mathcal{D}_{\mathcal{Q}} in the reminder of this paper. 2.1 A Graph-Theoretic View To investigate representation learning in weakly-supervised settings, we adopt a novel view of contrastive learning ( HaoChen et al., 2021 ) , framing

Read the complete text