VIPCALs : A fully-automated calibration pipeline for VLBI data

D. Álvarez-Ortega, C. Casadio, F. M. Pötzl, A. Kumar, M. Janssen · 2025

Read VIPCALs : A fully-automated calibration pipeline for VLBI data by D. Álvarez-Ortega, C. Casadio, F. M. Pötzl, A. Kumar, M. Janssen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-13282.txt.

Introduction

Álvarez-Ortega and four co-authors present VIPCALs, software that calibrates radio telescope data with no human in the loop, in this two thousand twenty-five paper. Very long baseline interferometry links distant dishes into one sharp eye, but its raw data need painstaking, expert calibration.

Existing tools are only partly automatic. VIPCALs runs the whole standard workflow unsupervised: it picks reference antennas, finds calibrator sources, and produces diagnostics for a quick human glance afterward. Tested on one thousand sources from a lens-hunting project, it calibrated nine hundred fifty-five successfully across frequency bands. Most datasets achieved solid fringe fitting, and the median data kept was eighty-seven percent. Such automation is what lets surveys grow to thousands of archival sources.

Catalog record

CREATORD. Álvarez-Ortega, C. Casadio, F. M. Pötzl, A. Kumar, M. Janssen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE73 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-13282

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

VIPCALs : A fully-automated calibration pipeline for VLBI data D. Álvarez-Ortega, C. Casadio, F. M. Pötzl, A. Kumar, M. Janssen Abstract Context. Very long baseline interferometry (VLBI) is a powerful observational technique that can achieve sub-milliarcsecond resolution. However, it requires complex and often manual post-correlation calibration to correct for instrumental, geometric, and propagation-related errors. Unlike connected-element interferometers, VLBI arrays typically provide raw visibilities rather than science-ready data, and existing pipelines are largely semi-automated and reliant on user supervision. Aims. We aim to develop and validate a fully automated, end-to-end calibration pipeline for continuum VLBI data, that operates without human intervention or prior knowledge of the dataset. The pipeline must be scalable to thousands of sources and suitable for heterogeneous archival observations, as required by initiatives such as the Search for Milli-Lenses (SMILE) project. Methods. We present VIPCALs (VLBI Pipeline for automated data Calibration using AIPS ). Implemented in Python using ParselTongue , VIPCALs reproduces the standard AIPS calibration workflow in a fully unsupervised mode. The pipeline carries out data import, retrieval of system temperature and gain curve data, ionospheric and geometric corrections, fringe fitting, as well as amplitude and bandpass calibration steps. VIPCALs performs automatic reference antenna selection, calibrator identification, and generates diagnostic outputs for inspection. It can be easily used through a simple graphical user interface. We validated it on a representative sample of Very Long Baseline Array (VLBA) data corresponding to 1 000 sources from the SMILE project. Results. VIPCALs successfully calibrated observations of 955 of the 1 000 test sources across multiple frequency bands. Over 91% of the calibrated datasets achieved successful fringe fitting on target in at least half of the solutions attempted. The median ratio of calibrated visibilities to initial total visibilities was 0.87. The average processing time was below 10 minutes per dataset using a single-core configuration, demonstrating both efficiency and scalability. Conclusions. VIPCALs enables robust, reproducible, and fully automated calibration of VLBI continuum data, significantly lowering the entry barrier for VLBI science and making large-scale projects like SMILE feasible. 1 Introduction Very long baseline interferometry (VLBI) is a powerful radio interferometric technique that combines signals from widely separated radio telescopes to achieve up to sub-milliarcsecond angular resolution. In VLBI, each antenna independently records the incoming radio signal along with precise timing information, usually provided by a hydrogen maser clock. These signals are brought together and cross-correlated in pairs of antennas, referred to as baselines, using specialized software or hardware correlators. The result is a set of complex values, known as visibilities, that sample the Fourier transform of the source’s brightness distribution in the sky. However, the measured visibilities are affected by a range of systematic effects that arise from both the different signal propagation path and the instrumentation at each station. Although modern VLBI correlators apply corrections based on accurate physical and geometrical models, significant residual errors remain that must be addressed through post-correlation calibration. The process of post-correlation calibration in VLBI is inherently complex and requires both domain expertise and proficiency with specialized calibration software. The most widely used packages for calibration are the Astronomical Image Processing System ( AIPS , Greisen 2003 ), the Common Astronomy Software Applications package ( CASA , McMullin et al. 2007 ), the Haystack Observatory Post-processing System ( HOPS , Whitney et al. 2004 ), and PIMA ( Petrov et al. 2011 ) . In contrast to some connected-element interferometers, such as the Karl G. Jansky Very Large Array (VLA) and the Atacama Large Millimeter Array (ALMA), where principal investigators (PIs) can request science-ready data products, VLBI projects typically provide only raw, correlated visibilities to the PI. Although the delivery of calibrated data products is a goal for next-generation facilities like the Square Kilometre Array (SKA) and the next-generation VLA (ngVLA), it is not yet the norm within the VLBI community. A partial exception is the European VLBI Network (EVN), which offers an automated calibration pipeline ( Reynolds et al. 2002 ) . However, the resulting datasets are explicitly labeled as not science-ready. Although several semi-automated VLBI calibration pipelines exist, such as VLBARUN in AIPS and rPICARD in CASA ( Janssen et al. 2019 ) , none operate in a fully unsupervised manner. These algorithms typically require user interaction to identify calibrator sources, validate fringe-fitting results, or adjust calibration parameters. Such manual oversight becomes a critical bottleneck for large-scale VLBI surveys involving thousands of radio sources. This is the case for the Search for Milli-Lenses (SMILE) project ( Casadio et al. 2021 ) , which aims to identify strong gravitational lensing systems at milliarcsecond angular scales using archival Very Long Baseline Array (VLBA) observations. The SMILE sample consists of nearly 5 000 radio-loud sources, observed over multiple decades with diverse frequency setups and observing strategies. This level of heterogeneity renders the use of semi-automated pipelines impractical. To address these limitations, we have developed the VLBI Pipeline for automated data Calibration using AIPS (in the SMILE framework) - VIPCALs . Although originally motivated by the requirements of the SMILE project, the pipeline is designed as a general-purpose tool capable of unsupervised calibration across a wide range of continuum VLBI datasets. It operates end-to-end without manual intervention or prior information on the data, from the initial data loading to the generation of science-ready visibility products. To validate its performance, the pipeline has been applied to a representative sample of VLBA observations of 1 000 different sources, encompassing a wide range of observational configurations and signal-to-noise conditions. This paper describes the pipeline’s implementation, its automated calibration workflow, and its performance on this large and heterogeneous dataset. In Section 2 we introduce the data calibration process in VLBI and more specifically in AIPS . Section 3 provides a thorough description of the calibration workflow followed by VIPCALs . In Section 4 we describe the VLBA sample used for validation, while the results and their discussion are presented in Section 5 . Section 6 gives an overview on future development and, finally, summary and conclusions are presented in Section 7 . 2 VLBI data calibration The objective of VLBI data calibration is to correct for instrumental, geometric, and propagation-induced effects that affect both the phase and amplitude of the observed complex visibilities. These corrections are essential to allow for coherent averaging of the signals of different antennas, and finally to recover accurate astronomical data. Phase calibration focuses on correcting residual phase errors that remain after initial geometric modeling during correlation. These residuals manifest primarily as group delays and fringe rates, corresponding to the derivatives of phase with respect to frequency (group delay) and time (fringe rate). Such errors arise from several sources, including mismodeling of the geometric delay due to imperfect knowledge of antenna positions or Earth orientation parameters, unmodeled atmospheric propagation effects, and clock or local oscillator instabilities at each station, among others. The final goal is to produce phase-stable data over time and frequency, thereby enabling coherent averaging and enhancement of the signal-to-noise ratio (S/N). On the other hand, amplitude calibration is performed to correct for variations in system gain, system temperature, and instrumental bandpass response on each antenna. These corrections ensure that the visibilities are on a consistent flux scale and can be reliably interpreted in subsequent analysis

Read the complete text