Hyperbolic Cycle Alignment for Infrared-Visible Image Fusion

Timing Li, Bing Cao, Jiahe Feng, Haifang Cao, Qinghua Hu, Pengfei Zhu · 2025

Read Hyperbolic Cycle Alignment for Infrared-Visible Image Fusion by Timing Li, Bing Cao, Jiahe Feng, Haifang Cao, Qinghua Hu, Pengfei Zhu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-23508.txt.

Introduction

Timing Li and five co-authors line up heat and light images in curved space to fuse them well. Heat images show warm forms, light images show fine grain, and a fusion needs the pair in true line first. Past line-up methods work in flat space and slip when the two kinds clash. Their 2025 network, Hy-CycleAlign, is the first to line up in hyperbolic space, whose bend fits rank and branching in a scene.

A twin path runs the line-up forward, then back to the source image, which locks the pair in a loop of true shape. A curved-space matching block forces the two kinds to agree by rank, which trims clash noise. Tests on offline pairs beat past methods on line-up truth and fusion grade both.

Catalog record

CREATORTiming Li, Bing Cao, Jiahe Feng, Haifang Cao, Qinghua Hu, Pengfei Zhu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-23508

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Hyperbolic Cycle Alignment for Infrared-Visible Image Fusion Timing Li, Bing Cao, Jiahe Feng, Haifang Cao, Qinghua Hu, Pengfei Zhu Abstract Image fusion synthesizes complementary information from multiple sources, mitigating the inherent limitations of unimodal imaging systems. Accurate image registration is essential for effective multi-source data fusion. However, existing registration methods, often based on image translation in Euclidean space, fail to handle cross-modal misalignment effectively, resulting in suboptimal alignment and fusion quality. To overcome this limitation, we explore image alignment in non-Euclidean space and propose a Hyperbolic Cycle Alignment Network (Hy-CycleAlign). To the best of our knowledge, Hy-CycleAlign is the first image registration method based on hyperbolic space. It introduces a dual-path cross-modal cyclic registration framework, in which a forward registration network aligns cross-modal inputs, while a backward registration network reconstructs the original image, forming a closed-loop registration structure with geometric consistency. Additionally, we design a Hyperbolic Hierarchy Contrastive Alignment (H 2 CA) module, which maps images into hyperbolic space and imposes registration constraints, effectively reducing interference caused by modality discrepancies. We further analyze image registration in both Euclidean and hyperbolic spaces, demonstrating that hyperbolic space enables more sensitive and effective multi-modal image registration. Extensive experiments on misaligned multi-modal images demonstrate that our method significantly outperforms existing approaches in both image alignment and fusion. Our code will be publicly available. August 24, 2026 1 Introduction Multi-modal image fusion integrates complementary information from heterogeneous sensors and has become a key technology for enhancing visual perception and analytical capabilities across various domains. By integrating the advantages of different modalities, such as the thermal radiation sensitivity of infrared imaging and the high-resolution texture details of visible, fusion technology generates comprehensive scene representations, enabling applications ranging from all-weather surveillance to search and rescue in harsh environments. The key to the success of such a fusion system lies in accurate multi-modal image alignment, a process that establishes pixel-level spatial correspondences between modalities. Even minor misalignments, such as a displacement of thermal signatures in infrared images relative to visible edges, can lead to ghosting artifacts or misinterpretations. For example, in security surveillance, an unregistered fusion of infrared and visible feeds might erroneously overlay a human heat signature onto a nearby object, compromising threat identification accuracy. Despite its importance, achieving reliable registration between infrared and visible images remains a challenge. The primary causes of multi-modal image misalignment include several factors. The positions of different sensors cannot be perfectly identical, resulting in displacement deviations in the captured images. Secondly, infrared imaging relies on thermal radiation while visible imaging relies on light reflection, and this difference in imaging mechanisms can lead to the mismatch of edge features. Additionally, complex factors such as viewpoint changes, motion blur, and rotational variations in real-world dynamic scenes further exacerbate the misalignment problem in multi-modal images. Unfortunately, mainstream fusion algorithms typically assume that the input images are pre-aligned, overlooking the inherent connection between registration and fusion. This idealized assumption limits their adaptability to partially aligned or noisy multi-modal data. Considering the difference in imaging mechanisms, the misalignment between infrared and visible images represents a nonlinear disparity, which is further exacerbated in dynamic scenes. To address the difficulty of cross-modal pixel alignment of infrared and visible images in Euclidean space, we have realized pixel-level multimodal image alignment in hyperbolic space for the first time. We propose a Hyperbolic Space-based Cyclic Consistency Alignment Network to realize it, termed as Hy-CycleAlign. The main contributions are summarized as follows: • A Hyperbolic Space-based Cyclic Consistency Alignment Network is proposed, which introduces a dual-path cross-modal cyclic registration framework. By coordinating registration and inverse registration, the framework establishes a closed-loop registration structure. • We introduce a Hyperbolic Hierarchical Contrastive Alignment, which first maps the input images into Poincaré space to guide the alignment process within hyperbolic geometry. This design effectively mitigates the impact of nonlinear cross-modal discrepancies by leveraging the structural properties of hyperbolic space. • We provide a theoretical analysis demonstrating that hyperbolic space, particularly within the Poincaré model, exhibits greater sensitivity to distance variations. Extensive experiments on misaligned infrared-visible image fusion tasks validate the effectiveness of our method. Figure 1: Comparison of different modalities in Euclidean and hyperbolic spaces: the background is shown in magenta, humans in cyan, vehicles in yellow, and object edges in black. In Euclidean space, edge maps tend to appear more scattered and lack hierarchical structure, whereas in hyperbolic space, edge features exhibit more pronounced clustering and hierarchy. 2 Related Works This section briefly reviews representative deep learning-based methods for multi-modal image alignment and fusion, as well as relevant foundational studies on non-Euclidean space. 2.1 Infrared-visible images alignment and fusion These fusion methods fundamentally depend on the availability of strictly aligned input images. Any misalignment between the source images can significantly degrade the quality of the fused output. Broadly, these techniques can be categorized into three main types based on their underlying architectures: convolutional neural network (CNN)-based methods [ 1 ] , hybrid CNN-Transformer-based methods [ 2 ] , and Generative Adversarial Network (GAN)-based methods [ 3 ] . These methods improve the final fusion results through a series of carefully designed components, including feature extraction modules, reconstruction modules, and fusion modules. Fusion methods based on unaligned images are specifically designed to address misalignment and image degradation issues that arise when existing approaches attempt to fuse unaligned image pairs. In recent years, to better achieve fusion of misaligned images, several studies such as ReCoNet [ 4 ] , SuperFusion [ 5 ] , MURF [ 6 ] , UMF [ 7 ] , and IMF [ 8 ] have been conducted to address this challenge. In existing registration-fusion methods rely on image translation modules which not only introduce additional noise but also make image registration heavily dependent on the performance of the translation modules. Therefore, how to improve image registration performance without introducing additional noise remains a critical challenge to be addressed. 2.2 Hyperbolic Deep Learning Due to its negative curvature, hyperbolic space can more efficiently capture hierarchical and tree-like structures in data. Therefore, it has been widely adopted in fields such as graphs [ 9 , 10 , 11 , 12 , 13 , 14 ] , text [ 15 , 16 , 17 , 18 , 19 ] , and vision [ 20 , 21 , 22 , 23 ] tasks to address the limitations of Euclidean space in modeling hierarchical data. In this work, we build upon these foundations and take a step toward pixel-level multi-modal image registration by applying constraints in hyperbolic space to reduce nonlinear modality discrepancies. Existing research has already demonstrated the substantial potential of hyperbolic space in effectively handling problems characterized by hierarchical structures. GhadimiAtigh et al. [ 23 ] verified that embedding pixels into hyperbolic space can accurately map the interiors and edges of an object, thereby achieving precise image segmentation. Khrulkov et al. [ 22 ] treated image degradation as a hierarchy, embedding it into hyperbolic space to achieve better re-identification performance. Fu et al. [ 24 ] introduced hyperbolic space to the object detection task and achieved weak alignment at the feature level. Li et al. [ 21 ] used hyperbolic distance metrics to represent the distance between features, enabling anomaly detection in hyperbolic space.

Read the complete text