LenghuSky-8: An 8-Year All-Sky Cloud Dataset with Star-Aware Masks and Alt-Az Calibration for Segmentation and Nowcasting

Yicheng Rui, Xiao-Wei Duan, Licai Deng, Fan Yang, Zhengming Dang, Zhengjun Du, Junhao Peng, Wenhao Chu, Umut Mahmut, Kexin Li, Yiyun Wu, Fabo Feng · 2026

Read LenghuSky-8: An 8-Year All-Sky Cloud Dataset with Star-Aware Masks and Alt-Az Calibration for Segmentation and Nowcasting by Yicheng Rui, Xiao-Wei Duan, Licai Deng, Fan Yang, Zhengming Dang, Zhengjun Du, Junhao Peng, Wenhao Chu, Umut Mahmut, Kexin Li, Yiyun Wu, Fabo Feng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16429.txt.

Introduction

Rui and co-authors release LenghuSky-8, eight years of all-sky images from the Lenghu site. Observatories need minute-by-minute cloud awareness at their own site. Older sets are short, daylight-heavy, or lack calibration. This set holds 429,620 frames, mostly at night. Star-aware masks mark clouds, and each pixel carries altitude-azimuth values. A probe on DINOv3 features reached about 93% segmentation accuracy. Calibration error stays near 0.37 degrees at zenith and 1.34 degrees low in the sky.

Catalog record

CREATORYicheng Rui, Xiao-Wei Duan, Licai Deng, Fan Yang, Zhengming Dang, Zhengjun Du, Junhao Peng, Wenhao Chu, Umut Mahmut, Kexin Li, Yiyun Wu, Fabo Feng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53046
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.16429

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LenghuSky-8: An 8-Year All-Sky Cloud Dataset with Star-Aware Masks and Alt-Az Calibration for Segmentation and Nowcasting Yicheng Rui, Xiao-Wei Duan, Licai Deng, Fan Yang, Zhengming Dang, Zhengjun Du, Junhao Peng, Wenhao Chu, Umut Mahmut, Kexin Li, Yiyun Wu, Fabo Feng Abstract Ground-based time-domain observatories require minute-by-minute, site-scale awareness of cloud cover, yet existing all-sky datasets are short, daylight-biased, or lack astrometric calibration. We present LenghuSky-8 , an eight-year (2018–2025) all-sky imaging dataset from a premier astronomical site, comprising 429,620 512 × 512 512{\times}512 frames with 81.2% night-time coverage, star-aware cloud masks, background masks, and per-pixel altitude–azimuth (alt–az) calibration. For robust cloud segmentation across day, night, and lunar phases, we train a linear probe on DINOv3 local features and obtain 93.3 % ± 1.1 % 93.3\%\pm 1.1\% overall accuracy on a balanced, manually labeled set of 1,111 images. Using stellar astrometry, we map each pixel to local alt–az coordinates and measure calibration uncertainties of ≈ 0.37 ∘ \approx 0.37^{\circ} at zenith and ≈ 1.34 ∘ \approx 1.34^{\circ} at 30 ∘ 30^{\circ} altitude, sufficient for integration with telescope schedulers. Beyond segmentation, we introduce a short-horizon nowcasting benchmark over per-pixel three-class logits (sky/cloud/contamination) with four baselines: persistence (copying the last frame), optical flow, ConvLSTM, and VideoGPT. ConvLSTM performs best but yields only limited gains over persistence, underscoring the difficulty of near-term cloud evolution. We release the dataset, calibrations, and an open-source toolkit for loading, evaluation, and scheduler-ready alt–az maps to boost research in segmentation, nowcasting, and autonomous observatory operations. 1 Introduction Figure 1 : Samples from the dataset. First column represents the raw images that is augmented for cloud segmentation; Second column is the annotation of clear sky (blue), cloudy region (orange) and contamination region (pink); Third column is the mask for background; Forth column is the overlay of the first three columns; Last two columns are the astrometric calibration results for altitude and azimuth of the image. Ground-based time-domain surveys such as the Zwicky Transient Facility (ZTF) 2 , the Vera C. Rubin Observatory 17 , and the Tianyu Project 11 are transforming our understanding of the dynamic Universe. To maximize scientific return, these facilities rely on cloud-aware schedulers that continuously adapt pointing and exposure plans to local, rapidly evolving weather. Achieving this requires a realistic, high-resolution cloud model that ingests recent observations and supports short-horizon predictions suitable for real-time decision making 25 . Building cloud models with such granularity demands long-duration, all-sky imaging datasets collected at fixed sites, with accurate geometric calibration and night-time cloud annotations. However, existing all-sky fisheye datasets exhibit at least one of the following limitations: (i) short temporal coverage (months rather than years), preventing seasonal modeling; (ii) manual masking that does not scale; (iii) daytime bias, limiting astronomy use; (iv) missing astrometric calibration, making it difficult to map pixels to altitude–azimuth coordinates for effective telescope scheduling; (v) selective to easy-to-mark images that cannot depict the complicated scenario in the real world. In this work, we introduce LenghuSky-8, an eight-year, all-sky cloud dataset with star-aware masks and alt–az calibration, collected at Lenghu, Qinghai, China—a premier astronomical site 5 —spanning 2018–2025. The dataset contains 429,620 images at resolution of 512 \times 512, covering nights/days across 8 years, with 81.2% night-time frames. For segmentation, we use DINOv3 local features with a linear probe, enabling robust, label-efficient separation of cloud and sky under diverse illumination, including moonlit conditions, at overall accuracy of 0.933_{-0.011}^{+0.011} on a small manually annotated dataset containing 1,111 images. Night-time star fields are used for astrometric calibration, yielding per-pixel altitude–azimuth coordinates with the uncertainty of 0.37^{\circ} at zenith. Samples from the dataset are shown in Fig. 1 . Our contributions are twofold: 1. Dataset: an eight-year, all-sky, day–night imaging dataset with star-aware cloud masks, background annotation and alt–az calibration, suitable for both cloud nowcasting and domain-specific pretraining model; a manually labeled dataset containing 1,111 images that can be used to evaluate cloud segmentation algorithms. 2. Tools: a DINOv3 linear-probe segmenter for all-sky camera, a all-sky camera calibrator based on star fields, and an open evaluation toolkit with loaders, calibration maps, and scripts. Figure 2 : Workflow of this paper. Solid arrows denote dependencies among product data; dashed arrows denote potential dependencies not considered in our experiments. Workflow of this paper is shown in Fig. 2 . Code, data, and documentation are available in https://github.com/ruiyicheng/LenghuSky-8 . The remainder of the paper covers related work (Section 2 ), dataset establishment (Section 3 ), benchmark and baseline (Section 4 ), conclusion and discussion (Section 5 ). 2 Related Work 2.1 All-sky cloud datasets Despite growing adoption, publicly available all-sky fisheye image datasets remain limited in both duration and scope. For example, Dev et al . introduced the SWIMSEG daytime and nighttime cloud segmentation databases, comprising approximately 1,000 and 100 images respectively, captured in the tropical urban region of Singapore 6 ; 9 . These small-scale collections lack sufficient temporal coverage to represent seasonal or interannual cloud variability. Similarly, Li et al . 22 collected about 5,000 images with an all-sky camera during a site-testing campaign for the Thirty Meter Telescope (TMT) in Xinjiang. In 2019, Dev et al . released SWINySEG, a dataset of 6,768 daytime and nighttime images annotated by human experts 7 . More recently, the Eye2Sky dataset 26 provided continuous all-sky imagery from 11 stations in northwestern Germany, including one site with observations spanning from April 2022 to March 2023. Nevertheless, even these larger efforts generally cover only a few months to a year and often omit detailed per-pixel cloud masks or precise geometric calibration. Consequently, the field still lacks large-scale, long-term, and well-annotated all-sky datasets necessary for robust modeling and generalizable cloud characterization. 2.2 Cloud segmentation in all-sky camera images Ground-based all-sky cameras have been studied for cloud segmentation for over two decades. Early work relied on simple color heuristics that exploit the different scattering behavior of air molecules and cloud droplets. Fixed or adaptive thresholds on red–blue ratios, their normalized variants, and saturation/difference cues were widely used to separate cloud from clear sky in daytime scenes 23 ; 13 ; 21 . These methods are attractive for their robustness and real-time efficiency but can be sensitive to camera calibration, aerosol load, circumsolar saturation, thin clouds near boundaries, and star field. Learning-based approaches reduced the need for hand-tuned thresholds by modeling sky/cloud appearance across color spaces. Dev et al . introduced a supervised framework using partial least squares, which catalyzed reproducible evaluation across cameras and conditions 6 . Deep convolutional networks now dominate all-sky cloud segmentation. Encoder–decoder architectures (e.g., CloudSegNet) improved accuracy, especially in challenging regions near the Sun and horizon 7 . U-Net variants tailored to sky imagery (CloudU-Net and SegCloud) extended segmentation across the full day and night using specialized attention modules and training on mixed day/night corpora such as SWINySEG 27 ; 32 . General-purpose image segmentation archiecture like SegMAN 12 are also feasible for cloud segmentation tasks. In recent years, large-scale self-supervised pre-training has become a dominant paradigm for visual representation learning, offering powerful features that generalize across diverse visual domains. Methods such as MAE 16 , MoCo v3 4 , iBOT 36 , and DINOv2 24 have demonstrated strong transferability to downstream tasks ranging from semantic segmentation to fine-grained recognition. These models

Read the complete text