SDSC:A Structure-Aware Metric for Semantic Signal Representation Learning

Jeyoung Lee, Hochul Kang · 2025

Read SDSC:A Structure-Aware Metric for Semantic Signal Representation Learning by Jeyoung Lee, Hochul Kang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-14516.txt.

Introduction

Jeyoung Lee and Hochul Kang propose a new score in 2025 for teaching machines to read signals over time. Common training scores look at the size gap between two signals. That gap can mislead: it ignores whether a wave points up or down, and it has no fixed top end.

Their score, called SDSC, checks how much two signals agree in shape, using signed heights. It can serve as a training loss, and a mixed form pairs it with the old score for steadier results. In tests on forecast and sorting tasks, training with the new score matched or beat the old one, most in low-data cases.

Catalog record

CREATORJeyoung Lee, Hochul Kang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-14516

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SDSC:A Structure-Aware Metric for Semantic Signal Representation Learning Jeyoung Lee, Hochul Kang Abstract We propose the Signal Dice Similarity Coefficient (SDSC), a novel structure-aware metric function for time series self-supervised representation learning. Most Self-Supervised Learning (SSL) methods for signals commonly adopt distance-based objectives such as mean squared error (MSE), which are sensitive to amplitude, invariant to waveform polarity, and unbounded in scale. These properties hinder semantic alignment and reduce interpretability. To the best of our knowledge, SDSC is the first similarity metric explicitly designed to capture structural alignment in temporal signals. SDSC addresses this by quantifying structural agreement between temporal signals based on the intersection of signed amplitudes, derived from the Dice Similarity Coefficient (DSC).Although SDSC is defined as a structure-aware metric, it can be used as a loss by subtracting from 1 and applying a differentiable approximation of the Heaviside function for gradient-based optimization. A hybrid loss formulation is also proposed to combine SDSC with MSE, improving stability and preserving amplitude where necessary. Experiments on forecasting and classification benchmarks demonstrate that SDSC-based pre-training achieves comparable or improved performance over MSE, particularly in in-domain and low-resource scenarios. The results suggest that structural fidelity in signal representations enhances the semantic representation quality, supporting the reconsideration of structure-aware metrics as viable alternatives to conventional distance-based methods. Introduction SSL enables representation learning from unlabeled data by formulating proxy objectives such as masked prediction or reconstruction. In Computer Vision (CV) and Natural Language Processing (NLP), SSL methods have demonstrated effective feature extraction capabilities. ( Gui et al. 2024 ) In time series modeling, SSL is also applied to extract semantic representations for downstream tasks, including forecasting and classification. ( Ma et al. 2024 ) In time-series signals such as EEG and EMG, task-relevant semantics are often encoded in structural features, including waveform shapes, phase alignment, and local frequency patterns. Signal-specific representations require attention to these temporal structures. However, most of the reconstruction-based SSL methods commonly adopt distance-based metrics such as MSE, which focus on amplitude differences and element-wise deviations. Distance-based metrics exhibit sensitivity to scale and are invariant to waveform polarity, resulting in reconstructions that minimize error without preserving structural consistency. In addition, distance-based metrics often assign low values to reconstructions that differ semantically from the target. Phase-inverted signals, amplitude-scaled signals, and zero-valued baselines produce similar MSE values despite large semantic deviations. Moreover, metric values are unbounded and non-normalized, which complicates interpretation and model selection. Therefore, the lack of interpretability and amplitude bias in MSE limit its reliability. To address these issues, a novel structure-aware metric, SDSC is introduced. The SDSC is inspired by the DSC ( Dice 1945 ; Sørensen 1948 ) widely used in semantic segmentation tasks and quantifies the structural agreement between two temporal signals. The metric is bounded in [0, 1], reduces sensitivity to amplitude variation, and reflects alignment in waveform structure. In addition, the metric is implemented as a loss by subtracting values from 1 and a differentiable approximation of the Heaviside function is applied to enable gradient-based optimization. Lastly, a hybrid loss that combines SDSC and MSE is introduced to enhance stability during training. Experiments on forecasting and classification benchmarks show that SDSC-based pre-training achieves comparable or improved performance relative to MSE, particularly when encoders are fixed. Performance gains are observed in in-domain and low-resource settings, where structural fidelity in the representations contributes to downstream accuracy. Self-supervised learning for time series signals typically consists of two components: reconstruction-based and contrastive learning. While contrastive objectives explicitly enforce instance discrimination, reconstruction-based objectives aim to recover the signal content. In this context, the choice of reconstruction loss directly influences the quality of the learned representation. Despite their widespread use, distance-based losses do not reflect the semantic structure and amplify the sensitivity to signal amplitude. The empirical similarity in downstream performance between MSE and SDSC indicates that MSE-based models achieve competitive results not due to accurate semantic preservation but due to incidental alignment with signal structure. These observations indicate that distance-based metrics might not fully capture the semantic structure of signals, motivating consideration of a shift towards structure-aware representation learning paradigms. Related Work This paper is related to DSC ( Dice 1945 ; Sørensen 1948 ) , and the broader field of time series modeling (TSM), specifically time series pre-training modelings (TS-PTM). Evaluation Metrics Traditional TS-PTM research widely used reconstruction metrics such as MSE or MAE. However, these metrics do not consider temporal misalignments between signals, which present significant limitations for analyzing various time series data. To overcome this, Dynamic Time Warping (DTW) was proposed in ( Sankoff and Kruskal 1983 ) , effectively addressing misalignment issues. Despite its effectiveness, DTW suffers from computational inefficiency. To mitigate this, ( Salvador and Chan 2007 ) introduced Fast DTW, significantly reducing computation time but remaining unsuitable for training due to its non-differentiability. Soft DTW ( Cuturi and Blondel 2017 ) addressed this limitation by providing a differentiable approximation suitable for training. However, these metrics are fundamentally distance-based. The Dice Score Coefficient (DSC) ( Dice 1945 ; Sørensen 1948 ) is commonly used in CV, especially semantic segmentation. This paper investigates applying DSC to time series rather than computer vision datasets. Specifically, our proposed SDSC adapts DSC for time series, enabling overlap-based evaluations sensitive to signal structure rather than amplitude. Time Series Modeling According to ( Gui et al. 2024 ) , SSL has advanced in various domains, typically involving a two-stage process of unsupervised pre-training followed by task-specific fine-tuning. SSL has notably improved performance across diverse time series tasks, becoming a critical step in contemporary research. Several notable TS-PTM studies have sought to enhance performance through various strategies ( Ma et al. 2024 ) . TS2Vec ( Yue et al. 2022 ) proposed an architecture for contextual representations. CoST ( Woo et al. 2022 ) adopted contrastive learning to improve TS-PTM. TmesNet ( Wu et al. 2022 ) addressed general time series analysis and ( Eldele et al. 2023 ) investigated semi-supervised time series learning using contrastive methods. TI-MAE ( Li et al. 2023 ) leveraged masked autoencoders for improved representation learning, and SimMTM ( Dong et al. 2023 ) further simplified the masked TS-PTM frameworks effectively. In addition, iTransformer ( Liu et al. 2023 ) introduced inverted transformers for efficient forecasting, and Unified Transformer ( Woo et al. 2024 ) generalized a single training approach to multiple downstream tasks. TIMER ( Liu et al. 2024 ) developed generative pre-trained transformers for large-scale time series modeling. Furthermore, TimeSiam ( Dong et al. 2024 ) proposed a Siamese network-based pre-training framework, and TimeDiT ( Cao et al. 2024 ) suggested diffusion-based TS-PTM. Cross-domain research on large-scale data was conducted by ( Prabhakar Kamarthi and Prakash 2024 ) , while ( He et al. 2025 ) investigated universal knowledge representation for general TS-PTM. Although these works contributed significantly to the progress of TSM, most focused on architectural innovations or adopted contrastive strategies, which can be limiting to learning structural representations. To the best of our knowledge, no prior work has proposed a structure-aware metric for signal representation learning. To address this, we introduce a structure-aware metric tailored to time-series data. SimMTM ( Dong et al. 2023 ) is selected as our experimental baseline for its simplicity,

Read the complete text