Lorentz Framework for Semantic Segmentation
Zahid Hasan, Masud Ahmed, Nirmalya Roy · 2026
Read Lorentz Framework for Semantic Segmentation by Zahid Hasan, Masud Ahmed, Nirmalya Roy (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16836.txt.
Introduction
Hasan, Ahmed and Roy propose a semantic segmentation framework in the hyperbolic Lorentz model. Curved space models hierarchical structure tightly with built-in uncertainty measure, unlike the shaky P-ball model. Text codes with meaning and visual cues guide layered pixel-level representations in Lorentz space. Optimization stays stable and fast without a curved-space tuner, and the tool fits with old flat architectures. Beyond cutting, the way gives free doubt guess, trust maps, edge drawing, recall and zero-shot results.
Catalog record
| CREATOR | Zahid Hasan, Masud Ahmed, Nirmalya Roy |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81223 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.16836
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Lorentz Framework for Semantic Segmentation Zahid Hasan, Masud Ahmed, Nirmalya Roy Abstract Semantic segmentation in hyperbolic space enables compact modeling of hierarchical structure while providing inherent uncertainty quantification. Prior approaches predominantly rely on the Poincaré ball model, which suffers from numerical instability, optimization, and computational challenges. We propose a novel, tractable, architecture-agnostic semantic segmentation framework (pixel-wise and mask classification) in the hyperbolic Lorentz model. We employ text embeddings with semantic and visual cues to guide hierarchical pixel-level representations in Lorentz space. This enables stable and efficient optimization without requiring a Riemannian optimizer, and easily integrates with existing Euclidean architectures. Beyond segmentation, our approach yields free uncertainty estimation, confidence map, boundary delineation, hierarchical and text-based retrieval, and zero-shot performance, reaching generalized flatter minima. We introduce a novel uncertainty and confidence indicator in Lorentz cone embeddings. Further, we provide analytical and empirical insights into Lorentz optimization via gradient analysis. Extensive experiments on ADE20K, COCO-Stuff-164k, Pascal-VOC, and Cityscapes, utilizing state-of-the-art per-pixel classification models (DeepLabV3 and SegFormer) and mask classification models (mask2former and maskformer), validate the effectiveness and generality of our approach. Our results demonstrate the potential of hyperbolic Lorentz embeddings for robust and uncertainty-aware semantic segmentation. Code is available at https://github.com/mxahan/Lorentz_semantic_segmentation . 1 Introduction Semantic segmentation, which assigns a semantic label to every pixel in an image, is a fundamental task in computer vision. State-of-the-art architectures formulate this problem either as per-pixel classification [ 9 ] , or as mask classification, where a set of binary masks is predicted and each mask is associated with a single class label [ 11 , 10 ] . Despite these structural differences, both paradigms typically treat semantic segmentation as a flat classification task, relying on one-hot encoded labels and modeling categories as mutually exclusive and independent [ 60 ] . This formulation overlooks the rich semantic relationships and hierarchical structures inherent in object categories—for instance, “vehicle” as a parent concept of “car,” “bus,” and “truck.” By disregarding such dependencies, existing approaches fail to incorporate meaningful inductive biases, thereby limiting their generalization capability. Recent advances have attempted to overcome this limitation by integrating visual and textual information through Vision–Language Models (VLMs) such as CLIP [ 47 ] . Several studies extend this paradigm to semantic segmentation via text-guided supervision, including mask-level vision–language alignment [ 14 ] , pixel–text score maps [ 48 ] , and text-supervised segmentation frameworks [ 58 , 64 ] , resulting in improved zero-shot and open-vocabulary performance. Nevertheless, these approaches, along with most contemporary methods, embed both image and text representations in Euclidean space. Such geometry is inherently limited in modeling hierarchical structures [ 15 ] , as it treats all points uniformly and fails to efficiently capture the exponential growth of concept subtypes characteristic of semantic taxonomies [ 43 , 22 ] . Hyperbolic spaces provide a geometrically principled alternative, as their negative curvature and exponential volume growth constitute a continuous analogue of tree-like structures [ 22 , 44 ] . This property enables efficient representation of hierarchical relationships: general parent concepts (e.g., “animal”) can be positioned near the origin, while increasingly specific child concepts (e.g., “dog,” “cat”) are embedded farther away, naturally encoding is-a relations and yielding interpretable, semantically consistent embeddings [ 43 , 15 , 28 , 44 ] . Despite their promise, existing hyperbolic approaches in computer vision [ 15 , 28 , 30 ] predominantly focus on global, image-level representations. Extending hyperbolic modeling to dense prediction tasks remains non-trivial: per-pixel classification requires computationally intensive manifold operations at scale, and mask-classification architectures introduce additional structural complexities that further complicate integration within hyperbolic spaces. Pioneering studies [ 2 , 7 , 56 ] have investigated hyperbolic semantic segmentation using the Poincaré ball model, primarily within per-pixel classification frameworks. However, these approaches are prone to numerical instability and gradient approximation errors [ 44 ] . The Lorentz (hyperboloid) model in Minkowski space provides a mathematically equivalent yet more numerically stable and computationally efficient alternative, particularly in low-dimensional settings, offering closed-form expressions for key operations such as distance computation and exponential maps [ 44 ] . Despite these advantages and its suitability for large-scale, text-guided segmentation, the Lorentz model remains largely underexplored in dense prediction tasks. Existing Lorentz-based methods predominantly focus on embedding entire images or global features, leaving unresolved the challenge of learning efficient, pixel-wise hyperbolic representations guided by semantic structure. Moreover, current hyperbolic segmentation approaches are limited to per-pixel classification models, due to the relative simplicity of replacing the final Euclidean classification layer with hyperbolic operations. In contrast, mask-classification architectures, despite consistently outperforming per-pixel counterparts, have been largely overlooked in hyperbolic settings. This reveals a clear research gap: the absence of a unified, efficient, and stable hyperbolic framework that systematically supports both pixel-classification and mask-classification paradigms for semantic segmentation. To address this gap, [ 25 ] develops a hyperbolic Lorentz framework for per-pixel segmentation architectures. Building upon this foundation, the present work proposes a generalized text-guided hyperbolic semantic segmentation framework in the Lorentz model that supports both per-pixel and mask-classification architectures. We leverage rich textual descriptions to encode semantic and visual priors as class prototypes embedded in hyperbolic space, grounded in the insight that image pixels represent specific instances of abstract concepts described by language, forming an inherent semantic hierarchy. We capture this structure by leveraging the order embeddings [ 53 ] within the Lorentz manifold and extend the entailment loss formulation [ 22 , 15 ] to the dense prediction setting. This constrains each pixel-level feature to lie within the convex entailment cone induced by its corresponding textual embedding, enforcing a geometrically consistent visual–semantic hierarchy and enabling structured representation learning for segmentation. Our main contributions are as follows. (i) We propose a Novel Text-Guided Hierarchical Hyperbolic Semantic Segmentation Framework grounded in the numerically stable Lorentz model, enabling scalable pixel-wise training on large datasets while preserving interpretability via Poincaré projection. We extend the entailment loss to pixel-level embeddings, constraining visual features within the entailment cone of their corresponding concept, to maintain semantic hierarchy and consistency in hyperbolic space. We further provide an analytic gradient analysis to characterize the learning dynamics within the Lorentz model and offer theoretical insight into its optimization behavior. (ii) Our architecture-agnostic approach introduces Minimal Overhead and Architecture Compatibility Across both per-pixel and mask-classification segmentation models in the Lorentz model. For per-pixel classification, we adopt a hyperbolic sample-to-prototype formulation for per-pixel architectures. For mask-classification architectures, we propose a hyperbolic sample-to-prototype formulation to align mask queries with class prototypes, and a sample-to-sample formulation for semantic mask generation. (iii) Empirical Validation and Geometric Analysis. We validate our approach on multiple benchmarks, including ADE20K, COCO-Stuff-164k, Cityscapes, and Pascal VOC, demonstrating state-of-the-art performance across both per-pixel and mask-classification models. Furthermore, the Lorentz-space geometry provides a novel pixel-level uncertainty estimation by quantifying deviations from euclidean prototype setting, enabling confidence assessment and boundary localization without additional training or post-processing. Extensive ablation studies confirm the effectiveness and robustness of the proposed framework. 2 Related Works Semantic Segmentation Architectures : Semantic segmentation architectures generally fall into two paradigms: per-pixel classification and mask classification. Per-pixel approaches assign a class label to each pixel by applying a classification loss at every spatial location, thereby implicitly partitioning the image into semantic regions. Representative models in this paradigm include