How to make CLEAN variants faster? Using clustered components informed by the autocorrelation function

Hendrik Müller, Sanjay Bhatnagar · 2025

Read How to make CLEAN variants faster? Using clustered components informed by the autocorrelation function by Hendrik Müller, Sanjay Bhatnagar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-16058.txt.

Introduction

Hendrik Müller and Sanjay Bhatnagar speed up radio image cleaning in twenty twenty-five. Radio interferometers produce data that must be deconvolved to form images. The classic algorithm for this is CLEAN, the de facto standard. New telescopes bring far larger data, higher resolution, and wider dynamic range, straining existing pipelines.

Multiscale CLEAN variants beat the classic on quality but cost much more compute. The authors combine ideas into a new algorithm, Autocorr-CLEAN. It fits clusters of CLEAN components rather than single points. The autocorrelation function informs how those clusters are shaped. The goal is variant-level quality at closer to classic speed. Readers who reduce radio data get a deconvolution built for the coming data flood.

Catalog record

CREATORHendrik Müller, Sanjay Bhatnagar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-16058

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

How to make CLEAN variants faster? Using clustered components informed by the autocorrelation function Hendrik Müller, Sanjay Bhatnagar Abstract Context. Deconvolution, imaging and calibration of data from radio interferometers is a challenging computational (inverse) problem. The upcoming generation of radio telescopes poses significant challenges to existing, and well proven data reduction pipelines due to the large data sizes expected from these experiments, and the high resolution and dynamic range. Aims. In this manuscript, we deal with the deconvolution problem. A variety of multiscalar variants to the classical CLEAN algorithm (the de-facto standard) have been proposed in the past, often outperforming CLEAN at the cost of significantly increasing numerical resources. In this work, we aim to combine some of these ideas for a new algorithm, Autocorr-CLEAN , to accelerate the deconvolution and prepare the data reduction pipelines for the data sizes expected by the upcoming generation of instruments. Methods. To this end, we propose to use a cluster of CLEAN components fitted to the autocorrelation function of the residual in a subminor loop, to derive continuously changing, and potentially non-radially symmetric, basis functions for CLEANing the residual. Results. Autocorr-CLEAN allows for the superior reconstruction fidelity achieved by modern multiscalar approaches, and their superior convergence speed. It achieves this without utilizing any substep of super-linear complexity in the minor loops, keeping the single minor loop and subminor loop iterations at an execution time comparable to CLEAN . Combining these advantages, Autocorr-CLEAN is found to be up to a magnitude faster than the classical CLEAN procedure. Conclusions. Autocorr-CLEAN fits well in the algorithmic framework common for radio interferometry, making it relatively straightforward to include in future data reduction pipelines. With its accelerated convergence speed, and smaller residual, Autocorr-CLEAN may be an important asset for the data analysis in the future. 1 Introduction In radio interferometry the signal recorded by an antenna pair observing the same source simultaneously is correlated. This correlation product (referred to as visibility) is approximated by the Fourier transform of the true sky brightness distribution with a spatial frequency determined by the baseline projected to the sky plane. While the Earth is rotating, the relative position of the antennas to the sky plane is changing, and the Fourier domain (also called the uv-domain) gets filled swiftly, a procedure usually referred to as aperture synthesis ( Thompson et al. 2017 ) . The imaging problem, i.e. deriving an image from the observed visibilities, is a challenging ill-posed inverse problem. The challenges arise from the fact that only a subset of all possible Fourier coefficients is measured on a non-Euclidean grid, the observations are disturbed by instrumental noise, and a variety of calibration effects need to be corrected, e.g. atmospheric delays described by station-based gains, radio frequency interference (RFI), or wide-field and wide-band effects. In the usual algorithm architecture that is adopted by almost all major radio interferometers in the world, this problem is solved by a sequential application of loops and projections, nested around each other. For instance, the problem of recovering a model from sparse measurements of the visibilities is typically reformulated as a deconvolution algorithm (i.e. the minor loop) solved by an iterative matching pursuit known as CLEAN deconvolution ( Högbom 1974 ) . The gridding/degridding step (i.e. grid visibilities on a regular grid and apply the inverse Fast Fourier Transform) is usually called the major loop. The overall procedure calls the major loop multiple times, and internally the minor loop as first proposed by Schwab 1984 . The minor/major loop cycles are itself looped in outer self-calibration loops (solving for gains), wide-field and wide-band projections, and RFI mitigation procedures. Currently, for most experiments the gridding is the biggest bottleneck in the data analysis, especially for the data sizes that may be expected by the next generation of radio interferometers such as the ngVLA ( Bhatnagar et al. 2021 ) . The ngVLA is a project proposed to replace the VLA, and will combine (following its current plans) a dense core of stations allowing for wide field of view, with intermediate baselines and continental baselines as currently only available with Very Long Baseline Interferometry (VLBI) experiments. There is significant progress to scale the major loops up to the performance needed for future arrays by the efficient parallelization of this step on GPUs on major computing facilities ( Bhatnagar et al. 2022 ; Kashani et al. 2023 ) . Since the numerical cost for the deconvolution scales with the number of pixels (and the number of pixels with relevant intensity information is expected to be large for the upcoming generation of radio telescopes due to the combination of short and long baselines and an increased sensitivity) the time performance of the deconvolution step becomes a secondary focus area of pipeline acceleration again. This is since, as outlined above, the actual deconvolution is the innermost loop and is thus an operation that is called multiple times throughout the data analysis pipeline. Any solution that allows to clean deeper at every minor cycle at the cost of an acceptable time increase will be of great importance to reduce overall computational time, at least by reducing the number of major loops. Moreover, it has been noted that the minor loop may dominate the major loop for some experiments that deal with exceptionally large image cubes again, for example for spectral reductions in ALMA data ( Kepley et al. 2023 , see e.g. for the latest run-time performance benchmarks) . This situation that may get worse when the size of data cubes increases with the wide-band sensitivity upgrade. The de-facto standard to solve the deconvolution problem is CLEAN ( Högbom 1974 ; Clark 1980 ; Schwab 1984 ) . CLEAN is a matching pursuit approach that iteratively searches for the peak in the current residual, and substitutes a shifted and rescaled version of the point spread function from the residual. CLEAN remains the fastest, and one of the most robust imaging algorithms. This is mainly caused by the fact that in a single CLEAN iteration no convolution operation needs to be performed, but rather simple substitution steps only. Moreover, CLEAN fits well in the proven, current data processing pipelines, while most novel approaches still need to demonstrate that they can handle all necessary calibration steps and imaging modes in their respective paradigms. In this manuscript, we focus on the numerical performance of the minor loop. We develop a version of the CLEAN algorithm that fits well in current data processing pipelines, and primarily exceeds classical CLEAN approaches in terms of convergence speed and depths of the CLEANing. CLEAN has been adapted over the years to a variety of settings, most remarkably to multiscale versions ( Bhatnagar & Cornwell 2004 ; Cornwell 2008 ; Rau & Cornwell 2011 ; Offringa et al. 2014 ; Offringa & Smirnov 2017 ; Müller & Lobanov 2023b ) in which extended, multiscalar functions are fitted to the data rather than point sources. Multiscalar versions of CLEAN correct successfully for the biggest limitation of the CLEAN algorithm: The spatial correlation between pixels is not taken into account. MS-CLEAN versions usually perform superior to standard CLEAN , particularly when extended, diffuse emission is present in the data. Moreover, while a single

Read the complete text