De-Biasing Structure Function Estimates From Sparse Time Series of the Solar Wind: A Data-Driven Approach

Daniel Wrench, Tulasi N. Parashar · 2024

Read De-Biasing Structure Function Estimates From Sparse Time Series of the Solar Wind: A Data-Driven Approach by Daniel Wrench, Tulasi N. Parashar (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-10053.txt.

Introduction

Daniel Wrench and Tulasi Parashar address in 2024 a data problem in solar wind studies: gaps in the records. Craft that watch the wind often miss stretches of data. Gaps bend a key tool that tracks how rough the wind is at each scale.

The pair fills gaps in real records from the Parker Solar Probe on purpose and tracks the error. Straight-line filling makes the tool read too low each time. From the tests they build a fix factor learned from one craft. The fix also works on data from a new wind regime and helps most when gaps pass a quarter of the record. They then apply it to old Voyager data from far out in the solar system.

Catalog record

CREATORDaniel Wrench, Tulasi N. Parashar
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-10053

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

De-Biasing Structure Function Estimates From Sparse Time Series of the Solar Wind: A Data-Driven Approach Daniel Wrench, Tulasi N. Parashar Abstract Structure functions (SFs), which quantify the moments of increments of a stochastic process, are essential complementary statistics to power spectra for analyzing the self-similar behavior of a time series. However, many real-world datasets, such as those from spacecraft monitoring the solar wind, contain gaps, which inevitably corrupt the statistics. The nature of this corruption for SFs remains poorly understood—indeed, often overlooked. In this study, we simulate gaps in a large set of Parker Solar Probe magnetic field intervals to characterize how missing data affects SFs of solar wind turbulence. We find that linear interpolation systematically underestimates the true structure function, and we introduce a simple, empirically-derived correction factor to address this bias. Learned from data from a single spacecraft, the correction generalizes well to solar wind measured elsewhere in the heliosphere. Compared to conventional gap handling methods, our approach reduces the mean error for missing data fractions above 20%, and the overall error is reduced by nearly 50% when averaged across all missing fractions tested. We apply the correction to Voyager intervals from the inner heliosheath and local interstellar medium (60-85% missing) and recover spectral indices consistent with previous studies. The correction factor is released as an open-source Python package, enabling more accurate analysis of scaling in gapped solar wind datasets. I Introduction I.1 Gaps in solar wind time series The solar wind is a supersonic plasma that continuously flows outward from the Sun [ 84 ] . As well as playing a key part in our understanding of space weather, the solar wind has a special role in astrophysics more broadly. It is the only system in which we can study in situ , using spacecraft, the cosmically ubiquitous phenomenon of weakly collisional plasma turbulence [ 15 , 71 ] . Unfortunately, as with countless other datasets in the Earth and space sciences, time series of the solar wind are often plagued by data gaps. Telemetry constraints, instrument failures and data filtering/conditioning all result in time series of plasma and magnetic field measurements that are variably incomplete. For example, data from the two Voyager spacecraft, which provide our only measurements of the outer heliosphere and interstellar medium, have daily gaps of 12-16 hours due to the limited communication with ground stations from such distances [ 47 , 70 ] . Our record of the solar wind at Mars is also regularly contaminated by multi-hour gaps, during the periods in which the MAVEN spacecraft passes inside the planet’s bow shock [ 2 ] . These and other significantly fragmented datasets are highlighted in Table 1 . Dataset Distance from the Sun Typical % of magnetic field data missing Reference Helios 1 & 2 0.3-1 au 50-60% [ 99 ] OMNI 1 au 67% until 1995, 8% thereafter [ 63 ] MAVEN 1.5 au (Mars orbit) 80% [ 49 ] Voyagers 1 & 2 1-140 au 70% in the outer heliosphere Fraternale et al. [44] Table 1: Description of solar wind datasets that are particularly affected by missing data (au = astronomical units). Note that OMNI is a compilation of data from a range of spacecraft at 1 au; the increase in availability after 1995 was due to the Wind spacecraft coming online [ 81 ] . The aforementioned causes of gaps in solar wind datasets are such that, generally speaking, we can treat the data in these gaps as ‘‘missing at random’’. 1 1 1 I.e., the presence of gaps is unrelated to the variables of interest—but is related to external factors, such as the time of day in the case of periodic gaps [ 62 ] . While this reduces some potential for bias in the corresponding statistics, large amounts of missing data remain a challenge for various heliophysical analyses. For example, gaps hinder our ability to forecast space weather events [ 54 , 92 ] , to understand the coupling of the solar wind with planetary magnetospheres [ 66 , 63 , 2 ] , or to study plasma turbulence using scale-dependent statistics [ 47 , 42 , 35 ] . These statistics are also needed for the validation of turbulence transport models, which are essential for understanding processes such as the propagation of cosmic rays through the heliosphere [ 7 , 39 , 40 , e.g.,] . Therefore, it is crucial to investigate whether we can increase the amount of reliable information that can be extracted from such sparse yet scientifically invaluable datasets. In this study we focus on the extraction of robust turbulence statistics—specifically, the structure function, which we now describe. I.2 Structure functions: intuition and advantages The statistic most synonymous with turbulence studies is the power spectrum E(k) , and in particular, the scaling-law prediction of E(k)\propto k^{-5/3} made by Kolmogorov [56] for the inertial range. However, in that paper, Kolmogorov also introduced the moments of the increments \langle|\Delta x|^{p}\rangle of a turbulent quantity x . These statistics, later termed structure functions (SFs) [ 108 , 79 ] , were also predicted to follow specific scaling-laws for turbulent signals, and since Burlaga et al. [21] have also been used extensively to study fluctuations in the solar wind, especially with regards to the phenomenon of intermittency [ 97 , 9 , 25 , 88 , e.g.] . Before describing intermittency and the theoretical properties of SFs in this context, we first highlight the three main practical advantages that establish their role alongside power spectra in scaling analyses. The first advantage offered by the SF is that it allows for direct identification of the range of scales (in time or space) that contribute to the variation of a fluctuating quantity, without needing to translate to or from the frequency domain [ 108 , 91 , 89 , 37 ] . The SF clearly visualizes the change in distributional properties (e.g., increasing variance, in the case of the second-order SF) of fluctuations as the separation between measurements increases. The second advantage is that the SF is less sensitive to violations of stationarity [ 89 , 98 ] , compared with the power spectrum and autocorrelation function. This is particularly important for studying the solar wind, where transients such as co-rotating interaction regions and shocks regularly cause non-stationarity of the data [ 53 ] . Thirdly, unlike with the power spectrum, the SF can be straightforwardly calculated from irregularly-sampled time series [ 30 ] . This final point, while mathematically true, says nothing of the robustness of SFs to data gaps—a property that, as we describe in the next section, has received little attention. In light of this, in this paper we investigate, and demonstrate a method of addressing, the effect of data gaps on the second-order SF. In the remainder of this section, we provide the formal mathematical definition for the SF and its interpretation in a turbulence context, followed by a review of gap-handling methods in the solar wind literature. I.3 SFs: definition and turbulence theory The p th order SF at lag \tau gives the p th moment of the distribution of increments at that lag, \mathcal{P}(\Delta x_{\tau}) , where \Delta x_{\tau}(t)=x(t+\tau)-x(t) is the increment

Read the complete text