HyDAR-Pano3D: A Hybrid Disentangled Anatomical Recovery Framework for Panoramic-to-3D Reconstruction

Yaoyao YUE, Jérôme Schmid, Xiaoshuang Li, Eduardo Delamare, Jinman KIM · 2026

Read HyDAR-Pano3D: A Hybrid Disentangled Anatomical Recovery Framework for Panoramic-to-3D Reconstruction by Yaoyao YUE, Jérôme Schmid, Xiaoshuang Li, Eduardo Delamare, Jinman KIM (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20827.txt.

Introduction

Yaoyao Yue and four colleagues present HyDAR-Pano3D, a hybrid design for recovering 3D craniofacial anatomy from panoramic dental radiographs. A panoramic X-ray gives only a 2D projection of complex 3D anatomy, and direct regression of cone-beam CT volumes mixes shared anatomy with patient-specific variation. Their two-stage design recasts rebuilding as disentangled anatomical recovery, avoiding over-smoothed results with blurred edges. Stage one fuses X-ray traits with SAM-derived meaning priors in a dual-encoder network.

Catalog record

CREATORYaoyao YUE, Jérôme Schmid, Xiaoshuang Li, Eduardo Delamare, Jinman KIM
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47007
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.20827

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

HyDAR-Pano3D: A Hybrid Disentangled Anatomical Recovery Framework for Panoramic-to-3D Reconstruction Yaoyao YUE, Jérôme Schmid, Xiaoshuang Li, Eduardo Delamare, Jinman KIM Abstract Panoramic radiograph (PR) is fundamentally used in routine dental care, but it inherently provides only a two-dimensional (2D) projection of complex three-dimensional (3D) craniofacial anatomy. Most existing learning-based methods attempt to computationally recover this 3D information by directly regressing native cone-beam computed tomography (CBCT) volumes from PR. However, this direct mapping requires the model to simultaneously learn common anatomical structures and patient-specific morphological variations. This entangled formulation makes the ill-posed 2D-to-3D inverse problem highly ambiguous, often producing over-smoothed reconstructions with blurred anatomical boundaries. To address this, we propose HyDAR-Pano3D, a two-stage framework that reformulates PR-to-CBCT reconstruction as a disentangled anatomical recovery problem. In Stage 1, a dual-encoder network integrates radiographic features with SAM-derived semantic priors to reconstruct an arch-normalized canonical volume. In Stage 2, an Anatomical Restoration Network predicts a prior-constrained structured deformation field to map this canonical volume back to the native space, restoring individual morphological variations. Experiments on three large-scale datasets show that HyDAR-Pano3D significantly outperforms baseline methods ( p < 0.05 p<0.05 ), achieving a 25.76 dB PSNR, 85.70% SSIM, and an 83.83% overall anatomical Dice score. The synthesized volumes successfully support downstream segmentation of whole teeth (82.4% Dice) and the inferior alveolar canal (72.2% Dice), demonstrating that our disentangled approach preserves clinically relevant structures to enable robust anatomy-aware assessment when CBCT data is unavailable. I Introduction Panoramic radiograph (PR) is a fundamental dental imaging modality for diagnosis and treatment planning. PR provides a comprehensive overview of the upper and lower jaws with low radiation dose, low cost, and high acquisition efficiency [ 23 , 27 , 13 ] . Due to these advantages, PR is widely adopted for initial evaluation in orthodontics, implant planning, and maxillofacial screening. However, PR is inherently a two-dimensional (2D) projection of complex three-dimensional (3D) anatomy acquired along a curved dental arch trajectory. This imaging mechanism introduces non-linear geometric distortion, depth compression, and severe anatomical superposition, particularly in the buccolingual direction [ 40 ] . As a result, substantial spatial information is irreversibly lost during projection, limiting the reliability of PR for volumetric analysis and precise anatomical localization [ 2 , 41 , 22 ] . Cone-beam computed tomography (CBCT) alleviates these limitations by providing isotropic 3D volumetric representations of dental anatomy, allowing an accurate assessment of tooth morphology, alveolar bone structure, and critical neurovascular anatomy [ 19 , 35 ] . Nevertheless, CBCT acquisition is associated with higher radiation exposure and increased cost compared to conventional radiograph [ 42 ] . According to the ALARA principle, clinical guidelines recommend CBCT only when 2D imaging is insufficient to support diagnostic decisions [ 14 ] . This clinical trade-off motivates the development of computational approaches capable of estimating patient-specific 3D anatomical information from a single panoramic radiograph, thus extending the clinical utility of PR without additional radiation burden. Recent advances in deep learning have demonstrated the feasibility of 2D-to-3D reconstruction from PR [ 39 , 26 , 16 , 29 ] . However, most existing methods formulate this task as a direct mapping from a single 2D projection to a full 3D volume in the native anatomical space. This direct regression approach is fundamentally limited because it forces the network to simultaneously overcome two distinct and severe challenges. First, the network must hallucinate missing depth cues and resolve severe projection overlap (information loss). Second, it must account for massive patient-specific morphological variations in dental arch geometry caused by the non-linear PR acquisition process [ 40 , 36 ] . This entangled formulation—attempting to jointly model fine-grained volumetric appearance and large-scale, arch-dependent spatial deformation—makes the inverse mapping highly ambiguous. As a consequence, the variance of the target distribution increases significantly, causing these networks to produce population-averaged, over-smoothed reconstructions with blurred anatomical boundaries and loss of critical structural details. To address this core contradiction, we propose HyDAR-Pano3D, a novel framework that reformulates PR-based 3D reconstruction from an ill-posed direct mapping into a disentangled anatomical recovery problem. Our core insight is to decouple the recovery of high-fidelity volumetric density from the large-scale spatial deformation introduced by individualized arch geometry. We realize this divide and conquer strategy through a highly constrained two-stage pipeline. In the first stage, rather than struggling with patient-specific geometric variance, we focus entirely on resolving depth ambiguity by synthesizing the 3D volume in a standardized, arch-normalized canonical space. To achieve this, we introduce a dual-encoder architecture with an Adaptive Cross-attention Fusion (ACF) mechanism. This allows us to inject high-level semantic priors from domain-adapted vision foundation models directly into the radiographic feature space, effectively recovering the fine structural details lost to 2D projection overlap. In the second stage, with the high-fidelity canonical anatomy established, an Anatomical Restoration Network (AR-Net) utilizes a prior-guided structured deformation field to warp the canonical volume back into the patient’s native CBCT space, thus restoring individualized morphological variation. By explicitly separating prior-guided anatomy synthesis from individualized morphology restoration, HyDAR-Pano3D drastically reduces the cognitive load on the network, enabling high-fidelity, patient-specific 3D reconstructions. The main contributions of this work are as follows: • A Disentangled Paradigm for PR-to-CBCT Inversion: We formulate the severely ill-posed PR reconstruction task by decoupling volumetric density estimation from arch-dependent geometric distortion. Our two-stage approach significantly constrains the inverse mapping: resolving complex density inference within an arch-normalized space, while capturing patient-specific morphology through robust geometric deformation. • Bridging 2D Semantic Priors to 3D Volumetric Recovery: To overcome the inherent depth ambiguity and information loss of a single 2D projection, we introduce a dual-encoder architecture with an Adaptive Cross-attention Fusion (ACF) mechanism. This design propagates robust structural priors from vision foundation models to guide the recovery of fine anatomical details. • Unprecedented Anatomical Fidelity for Downstream Utility: We extensively validate HyDAR-Pano3D across three large-scale datasets, demonstrating state-of-the-art performance. The synthesized volumes successfully drive critical downstream clinical tasks—achieving high accuracy in both whole-tooth and inferior alveolar canal (IAC) segmentation—proving the framework’s viability as a low-dose surrogate for anatomy-aware clinical screening. II Related Work II-A Cross-Modality 2D-to-3D Reconstruction Reconstructing 3D volumetric data from limited 2D projections is a long-standing problem in dental medical imaging, motivated by the need to reduce radiation exposure and acquisition costs. Early approaches addressed this linear inverse problems using analytical methods such as filtered back-projection, which typically require multiple angular views. With the advent of deep learning, data-driven methods have been developed to tackle highly ill-posed sparse-view reconstruction problems. Ying et al. [ 44 ] proposed X2CT-GAN to synthesize CT volumes from biplanar PR using generative adversarial networks. More recently, implicit neural representations, including Neural Radiance Fields, have been adapted to medical imaging (e.g., MedNeRF [ 7 , 38 ] ), enabling continuous volumetric estimation from sparse projections. However, most general-purpose X-ray-to-CT frameworks assume linear perspective projection geometry or rely on multi-view consistency constraints, such as orthogonal or biplanar acquisitions. These assumptions break down in PR, where a single projection is acquired along a non-linear, curved tomographic trajectory [ 27 ] . As a result, conventional cross-modality reconstruction paradigms fail to model the focal trough distortion and complex anatomical superposition inherent to panoramic imaging, necessitating specialized reconstruction strategies. Fig. 1: HyDAR-Pano3D Overview. The framework factorizes

Read the complete text