Intensity-guided pose-free multiview fusion for single photon sensing Journal: opticajournal Publication type: Research Article

Jinyi Liu, 1 Lijun Liu, 2* Shuming Cheng 1,3**, Xiaomin Hu 4,5, Yiguang Hong 1,3 and Weiping Zhang, 1,6*** · 2026

Read Intensity-guided pose-free multiview fusion for single photon sensing Journal: opticajournal Publication type: Research Article by Jinyi Liu, 1 Lijun Liu, 2* Shuming Cheng 1,3**, Xiaomin Hu 4,5, Yiguang Hong 1,3 and Weiping Zhang, 1,6*** (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-25666.txt.

Introduction

Liu and five colleagues present GIC-Reg, a coupled registration frame for pose-free pairwise registration in single-photon multi-view sensing. Single-photon point clouds are sparse and corrupted by outliers and depth distortions, making registration hard when poses are poorly known. The frame joins intensity-guided preprocessing, grid aggregation, global matching, and local disambiguation to estimate rigid transformations. On a synthetic benchmark it posts the lowest rotation, translation, and root mean square errors. Under the most degraded dropout it cuts rotation error from about 13 degrees to about 8 degrees.

Catalog record

CREATORJinyi Liu, 1 Lijun Liu, 2* Shuming Cheng 1,3**, Xiaomin Hu 4,5, Yiguang Hong 1,3 and Weiping Zhang, 1,6***
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40680
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.25666

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Intensity-guided pose-free multiview fusion for single photon sensing Journal: opticajournal Publication type: Research Article Jinyi Liu, 1 Lijun Liu, 2* Shuming Cheng 1,3**, Xiaomin Hu 4,5, Yiguang Hong 1,3 and Weiping Zhang, 1,6*** Abstract Single-photon light detection and ranging (LiDAR) extends active three-dimensional sensing at the fundamental level and has found applications in extreme environments involving long-range operation, low-reflectance targets, and adverse visibility. However, the acquired measurements often give rise to single-photon point clouds that are sparse, spatially non-uniform, and corrupted by outliers and depth distortions, making multi-view registration challenging especially when sensor poses are not accurately known. In this work, we present a geometry-intensity coupled registration framework (GIC-Reg) of pose-free multi-view fusion for single-photon sensing. It is established by combining physical-aware preprocessing, joint geometry-intensity grid feature aggregation, global matching, and local ambiguity disambiguation to estimate inter-view rigid transformations and hence to construct a globally consistent reconstruction. On the synthetic benchmark, it admits the lowest relative rotation error (RRE), relative translation error, and root mean square error across all background-noise and dropout rates, in comparison to baselines. Notably, under the most degraded dropout, it reduces the RRE from 13.167 ∘ 13.167^{\circ} to 8.459 ∘ 8.459^{\circ} compared with the learning-based baseline. Furthermore, experimental results on real multi-view data acquired at about 80 m show that it achieves more reliable global orientation and local alignment. Our results show that photon intensity provides an effective physical cue for stabilizing multiview registration in single-photon point cloud, and thus our work aids significant progress in exploring practical utility of single-photon sensing . 1 Introduction Active light detection and ranging (LiDAR) systems have become a cornerstone for acquiring three-dimensional (3D) spatial information in emerging areas such as autonomous driving [ 45 , 24 , 3 , 31 , 2 ] , remote-sensing mapping [ 21 , 4 , 23 , 42 ] , and digital-twin modeling [ 28 , 6 ] . By measuring photon time-of-flight (ToF), they estimate range and reconstruct scene geometry when sufficient return photons are collected under typical illumination and reflectance conditions [ 40 , 35 ] . As applications push toward extreme environments, the echo level tends to enter into the photon-starved regime where conventional systems are limited by sensitivity and signal-to-noise ratio [ 11 , 16 , 10 , 37 ] . Therefore, single-photon LiDAR systems have appealed great attention for weak-signal ranging by using single-photon avalanche diodes (SPADs) with picosecond-scale temporal resolution [ 15 , 34 , 12 , 32 ] . Combined with time-correlated single-photon counting (TCSPC) [ 27 , 43 ] , they accumulate photon arrival times into time-of-flight histograms and enable depth recovery in extreme environments, such as long range [ 14 , 13 , 15 , 5 , 7 ] , dense fog [ 30 , 46 , 1 , 8 ] , and underwater [ 20 , 19 , 9 , 29 ] . Single-photon data are fundamentally governed by stochastic photon-counting statistics which usually suffer from distinctive geometric uncertainty [ 32 ] and is sensitive to the incidence angle of the probing beam [ 26 , 17 , 38 ] . Besides, under oblique illumination or near geometric boundaries, the return-photon time distribution can be broadened substantially and may even be overwhelmed by background counts, leading to non-negligible drift and error in depth estimates. Consequently, the single-view observation is inherently incomplete due to finite field of view, thus motivating multi-view 3D reconstruction to collect complementary geometric features from different observation angles. One possible approach to multi-view processing of single-photon data is to expand the effective field of view by stitching 2D depth maps and to merge multiple narrow-FOV observations into a panoramic representation [ 41 ] . The other assumes known sensor poses and models raw photon-count histograms using neural radiance fields for transient rendering and view synthesis [ 22 , 18 ] . These methods require pose estimation as a prerequisite, however, the accurate pose information of single-photon point cloud may be difficult to obtain in extreme environments, leaving pose-free multi-view registration insufficiently addressed. To address the above issue, we present an intensity-guided pose-free multi-view fusion framework for single-photon sensing, by estimating inter-view transformations directly from single-photon point data rather than relying on externally calibrated poses or traditional geometry-only pipelines. Particularly, it follows a geometry-intensity coupled coarse-to-fine registration pipeline tailored to single-photon measurements. First, photon intensity extracted from the photon histogram is assigned to each denoised point as a confidence cue. Then, coarse node descriptors are extracted by a KPConv-based backbone [ 36 ] and further aggregated by an XY-grid strategy, so that both local geometry and intensity-related reliability are preserved for coarse correspondence selection. Finally, transformer-based global matching and optimal-transport-based local refinement are used to estimate pairwise rigid transformations, and the aligned views are fused into a unified 3D reconstruction. Essentially, it utilizes photon intensity as an effective physical prior, and together with geometric registration, it is able to distinguish reliable surface returns from pseudo-structures caused by background photons and dark counts. Extensive experimental on both synthetic and real-world datasets are implemented to validate the effectiveness of the proposed method. On the synthetic benchmark, it achieves the lowest relative rotation error, relative translation error, and root mean square error across all background-noise and dropout rates, in comparison to Fast-adpgicp [ 44 ] and the learning-based GeoTransformer [ 25 ] as baselines. Furthermore, experimental results on real multi-view data acquired at about 80 m show that it admits more reliable global orientation and local alignment. These results demonstrate that photon intensity is an effective physical cue for pose-free multi-view registration and enables more robust 3D fusion in photon-limited scenes. The rest of this work is organized as follows. Sec. 2 formulates the problem of pose-free multi-view fusion. Sec. 3 presents the geometry-intensity coupled registration framework for this fusion task. Sec. 4 describes the synthetic and real single-photon datasets and evaluation metrics, while Sec. 5 reports the experimental results. Finally, Sec. 6 concludes the paper. 2 Problem formulation: multi-view fusion with single-photon data 2.1 Photon counting and histogram A typical single-photon LiDAR system comprises a pulsed laser source, a SPAD detector, and a TCSPC module [ 32 , 35 , 7 ] . During acquisition, the laser emits a sequence of periodic pulses to illuminate the target scene, the SPAD detects returned photons, and the TCSPC module records the ToF information of these collected photons. Additionally, micro-electro-mechanical systems (MEMS) mirrors switch angles to detect different pixels, acousto-optic modulators (AOMs) can be integrated to reduce transmission noise, and the FPGA module acts as the central processor to control each component. A complete single-photon imaging system is illustrated in Fig. 1 . Figure 1 : Illustration of the single-photon imaging system. In the photon-starved regime where at most one photon is detected within one pulse interval [ 32 ] , the photon-detection process can be modelled as follows. For each pixel (u,v) with u=1,\cdots,W and v=1,\cdots,H , the photon acquisition is carried out over a time horizon T that is evenly divided into N pulse intervals, with interval duration \Delta=T/N . Within each interval n=1,\ldots,N , a single laser pulse is emitted, the SPAD detects returned photons and records the photon number a_{uv}[n] , and

Read the complete text