Data-driven assessment of optimal spatiotemporal resolutions for information extraction in noisy time series data

Domiziano Doria, Simone Martino, Matteo Becchi, Giovanni M. Pavan · 2024

Read Data-driven assessment of optimal spatiotemporal resolutions for information extraction in noisy time series data by Domiziano Doria, Simone Martino, Matteo Becchi, Giovanni M. Pavan (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-13741.txt.

Introduction

Domiziano Doria, Simone Martino, Matteo Becchi, and Giovanni Pavan present a data-driven way to pick the best space and time resolutions for noisy time series, in a research paper from 2024. Any complex system looks different at each scale of view. The right scale to study it is rarely known ahead, yet it decides how much information the data can yield.

Their unsupervised method scans all particle distances and all time splits in the data. Correlations at each scale reveal the lengths and times of the key events. The resolution that extracts the most information is then chosen by the data itself. Tests span systems from atomic to macroscopic scale, with varied internal complexity. The tool suits simulation and lab trajectories alike.

Catalog record

CREATORDomiziano Doria, Simone Martino, Matteo Becchi, Giovanni M. Pavan
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-13741

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Data-driven assessment of optimal spatiotemporal resolutions for information extraction in noisy time series data Domiziano Doria, Simone Martino, Matteo Becchi, Giovanni M. Pavan Abstract In general, comprehension of any type of complex system depends on the resolution used to examine the phenomena occurring within it. However, identifying a priori , for example, the best time frequencies/scales to study a certain system over-time, or the spatial distances at which correlations, symmetries, and fluctuations are, most often non-trivial. Here we describe an unsupervised approach that, starting solely from the data of a system, allows learning the characteristic length scales of the dominant key events/processes and the optimal spatiotemporal resolutions to characterize them. We tested this approach on time series data obtained from simulation or experimental trajectories of various example many-body complex systems ranging from the atomic to the macroscopic scale and having diverse internal dynamic complexities. Our method automatically analyzes the system data by analyzing correlations at all relevant inter-particle distances and at all possible inter-frame intervals in which their time series can be subdivided, namely, at all space and time resolutions. The optimal spatiotemporal resolution for studying a certain system thus maximizes information extraction and classification from the system’s data, which we prove to be related to the characteristic spatiotemporal length scales of the local/collective physical events dominating it. This approach is broadly applicable and can be used to optimize the study of different types of data (static distributions, time series, or signals). The concept of “optimal resolution” has a general character and provides a robust basis for characterizing any type of system based on its data, as well as to guide data analysis in general. Introduction Understanding the physics of complex many-body systems with rich internal dynamics is typically a challenging task ten Wolde and Frenkel 1997 ; Baletto 2019 ; Gasparotto et al. 2020 ; Bochicchio et al. 2019 ; de Marco et al. 2021 ; Cioni et al. 2023 ; Crippa et al. 2023a . This holds true across various scales Cho et al. 2021 , from complex phenomena at the molecular level, such as nucleation events, phase transitions and ensemble dynamic adaptations in complex molecular systems ten Wolde and Frenkel 1997 , to non-trivial collective behaviors in complex scale systems such as fish schools Porfiri 2018 ; Butail, Mwaffo, and Porfiri 2016 , bird flocks Cavagna et al. 2010 ; Attanasi et al. 2014 ; Nagy et al. 2010 and socioeconomic or stock market systems Liu, Ungar, and Kording 2021 ; Mantegna and Stanley 1999 ; Duan et al. 2022 . Typically, the first challenge in studying such complex systems is to extract relevant information about the natural dynamical behavior of their constituent units, a fundamental step in reconstructing the complex internal physics that characterize them Martino et al. 2024 . The study of a complex system typically begins with the acquisition of trajectories, such as the positions and velocities of the individual units composing the system, obtained either through experiments or simulations. An efficient method is required to extract physically relevant information from these trajectories. A common approach involves using descriptors that convert raw trajectories into time series that can represent functions of positions (e.g. mutual arrangements) and / or velocities of the constituent units over time Kathirgamanathan and Cunningham 2020 ; Schmidt et al. 2023 . The choice of descriptor is critical, as different descriptors enable the extraction of different types of physical information about the system’s behavior Caruso et al. 2023 ; Crippa et al. 2022 ; Martino et al. 2024 . Among the various available descriptors, a distinction can be made between physics-inspired descriptors and "abstract" or general ones. Physics-inspired descriptors are tailored to study specific systems by leveraging the prior knowledge of their physics. Although they can be highly effective for investigating particular types of systems, they are typically less transferable to others. Furthermore, these descriptors may suffer from inherent biases and potentially overlook important and unforeseen information. To address these limitations, more general “abstract" descriptors – such as correlation functions or relative distances, to name a few commonly used examples – can be employed. More advanced and complex abstract descriptors, such as the Smooth Overlap of Atomic Positions (SOAP) Bartók, Kondor, and Csányi 2013 and Atomic Cluster Expansions (ACE) Drautz 2019 have also proven to be highly useful. Unlike system-specific descriptors, these general approaches are not tailored ad hoc to any particular system, making them applicable to virtually any system type. Their unbiased nature, stemming from the lack of reliance on prior knowledge of the system’s physics, allows them to be broadly applicable and transferable for studying a wide range of complex molecular systems. Pattern recognition approaches for analyzing datasets, such as those from ACE or SOAP, have successfully provided valuable insights into the physics of systems across scales, from molecular to macroscopic, including aqueous, metallic, and other complex systems Fitzner et al. 2019 ; Capelli, Muniz-Miranda, and Pavan 2022 ; Lionello et al. 2023 ; Cioni et al. 2023 ; Donkor, Laio, and Hassanali 2023 ; Cioni et al. 2023 ; Crippa et al. 2023b ; Cioni et al. 2024 ; Donkor et al. 2024 ; Martino et al. 2024 ; Perrone et al. 2024 ; Cheng et al. 2019 ; Rapetti et al. 2023 , and large-scale phenomena such as wave propagation Becchi, Fantolino, and Pavan 2024 ; Caruso et al. 2024 . Data-mining approaches often rely on identifying high-density peaks (dominant microscopic structural motifs) in datasets, treating the data as an ensemble in which time correlations are ignored. This can potentially lead to loss of information Martino et al. 2024 ; Lionello et al. 2024 . Conversely, it has been demonstrated that studying data, acquired over time series (thus accounting for their time-correlation) allows decouple temporal from spatial information, which may provide more rich information than typical pattern-recognition approaches, including details on rare events, local or collective events that originate and amplify dynamically over time, etc Caruso et al. 2023 ; Crippa et al. 2023a ; Butler, Fijan, and Glotzer 2024 ; Crippa et al. 2023b ; Becchi, Fantolino, and Pavan 2024 ; Cioni et al. 2024 ; Perrone et al. 2024 ; Martino et al. 2024 ; Caruso et al. 2024 ; Lionello et al. 2024 ; Husic and Pande 2018 . For example, descriptors such as timeSOAP Caruso et al. 2023 or Local Environments and Neighbors Shuffling (LENS) Crippa et al. 2023a track how much and in what way the environment surrounding each unit in the system changes over time. These approaches shift the focus to identifying relevant fluctuations in noisy time series. An efficient method for this is Onion Clustering, an unsupervised and parameter-free algorithm that systematically detects statistically significant fluctuations in noisy time series of any type. It classifies these fluctuations based on their similarity, determining the number of distinct microscopic domains (clusters) can be identified in a time series as a function of the length of the signal intervals used in the analysis. Recent results from Onion clustering have revealed non-trivial dependencies on the temporal resolution used in the analysis. These findings show that, for a given system studied with a specific descriptor, there exists an optimal temporal resolution that maximizes the information

Read the complete text