Depth to Anatomy: Learning Internal Organ Locations from Surface Depth Images DOI: 10.59275/j.melba.2024-AAAA Volume: 2

\firstname Eytan \surname Kats \aff 1, \firstname Kai \surname Geissler \aff 2, \firstname Jochen G. \surname Hirsch \aff 2, \firstname Daniel \surname Mensing \aff 2, \firstname Stefan \surname Heldman \aff 2, \firstname Mattias P. \surname Heinrich \aff 1 · 2026

Read Depth to Anatomy: Learning Internal Organ Locations from Surface Depth Images DOI: 10.59275/j.melba.2024-AAAA Volume: 2 by \firstname Eytan \surname Kats \aff 1, \firstname Kai \surname Geissler \aff 2, \firstname Jochen G. \surname Hirsch \aff 2, \firstname Daniel \surname Mensing \aff 2, \firstname Stefan \surname Heldman \aff 2, \firstname Mattias P. \surname Heinrich \aff 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-18260.txt.

Introduction

Eytan Kats and co-authors teach a model to locate organs inside the body from a photo of its surface. Their 2026 preprint deals with depth images of the patient's outside. Automated patient positioning matters in medical scanning. A well-placed patient shortens the scan and improves throughput and comfort. If a system can infer where organs sit from the surface shape, the scanner can be set up before any imaging dose is spent.

Learning that inside-outside map is the paper's core task. Surface depth is cheap and safe to capture. Organ position varies with body shape, so the map must be learned, not ruled. The work joins computer vision with radiology workflow.

Catalog record

CREATOR\firstname Eytan \surname Kats \aff 1, \firstname Kai \surname Geissler \aff 2, \firstname Jochen G. \surname Hirsch \aff 2, \firstname Daniel \surname Mensing \aff 2, \firstname Stefan \surname Heldman \aff 2, \firstname Mattias P. \surname Heinrich \aff 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-18260

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Depth to Anatomy: Learning Internal Organ Locations from Surface Depth Images DOI: 10.59275/j.melba.2024-AAAA Volume: 2 \firstname Eytan \surname Kats \aff 1, \firstname Kai \surname Geissler \aff 2, \firstname Jochen G. \surname Hirsch \aff 2, \firstname Daniel \surname Mensing \aff 2, \firstname Stefan \surname Heldman \aff 2, \firstname Mattias P. \surname Heinrich \aff 1 Abstract Automated patient positioning plays an important role in optimizing scanning procedure and improving patient throughput. Leveraging depth information captured by RGB-D cameras presents a promising approach for estimating internal organ positions, thereby enabling more accurate and efficient positioning. In this work, we propose a learning-based framework that directly predicts the 3D locations and shapes of multiple internal organs from single 2D depth images of the body surface. Utilizing a large-scale dataset of full-body MRI scans, we synthesize depth images paired with corresponding anatomical segmentations to train a unified convolutional neural network architecture. Our method accurately localizes a diverse set of anatomical structures, including bones and soft tissues, without requiring explicit surface reconstruction. Experimental results demonstrate the potential of integrating depth sensors into radiology workflows to streamline scanning procedures and enhance patient experience through automated patient positioning. The implementation and pretrained models are publicly available at https://github.com/EytanKats/orgloc . \melbaid YYYY:NNN \melbaauthors Kats and Heinrich \firstpageno 1337 \melbayear YYYY \datesubmitted yyyy-m1-d1 \datepublished yyyy-m2-d2 \melbaspecialissue German Conference on Medical Image Computing (BVM) 2025 \melbaspecialissueeditors Andreas Maier, Thomas Deserno, Heinz Handels, Klaus Maier-Hein, Christian Palm, Thomas Tolxdorff, Katharina Breininger \ShortHeadings Depth to AnatomyKats et al. \affiliations \num 1 \addr Institute of Medical Informatics, University of Luebeck, Luebeck, Germany \num 2 \addr Fraunhofer Institute for Digital Medicine MEVIS, Bremen, Germany keywords Radiology workflow, Organs localization 1 Introduction \enluminure The growing demand for radiology examinations underscores the need to optimize scanning procedures to reduce patient wait times and improve operational efficiency. A critical, yet time-intensive, aspect of this process is the patient preparation and planning phase, which is essential for optimizing image quality and diagnostic accuracy ( 24 ) . This phase typically involves manual positioning of the patient followed by scout imaging to facilitate detailed geometric planning for subsequent diagnostic scans. In standard clinical practice, a radiologic technologist initially aligns the patient on the table, often relying on external anatomical landmarks or laser positioning guides to approximate the region of interest. Once the patient is positioned inside the bore, a set of low-resolution, multi-planar scout images is acquired. These images are then used to visually confirm the patient’s position and to manually plan the geometry of the diagnostic sequences, such as slice orientation, field-of-view, and scan range ( 18 ) . Despite recent advances in radiology hardware and software, the automation of patient positioning remains a largely underexplored area compared to other aspects of scan acceleration or reconstruction ( 21 ; 10 ) . Traditional workflows still rely heavily on the experience and judgment of technologists. This manual planning process is both operator-dependent and time-consuming, particularly in complex examinations involving multiple regions or when precise anatomical targeting is required. Furthermore, variability in technologist expertise and patient anatomy can lead to inconsistent positioning, necessitating repeat localizers or even additional diagnostic scans, thereby increasing overall examination time and reducing scanner throughput ( 4 ) . Figure 1: Overview of the proposed automated patient positioning workflow. A depth sensor installed above the scanner bore captures a depth image of the patient lying on the table. This image is processed by a trained model that predicts the 3D bounding box of the target organ. The scanner table is then automatically adjusted to align the organ of interest with the center of the imaging field-of-view, reducing the need for manual repositioning and scout scans. Automated patient positioning systems, capable of accurately identifying and localizing the anatomical region of interest, hold considerable promise for streamlining radiology workflows by automatically adjusting the patient table to the optimal position. By reducing reliance on manual table adjustments and anatomical landmark estimation, these systems can minimize inter-operator variability, decrease setup time, and mitigate the risk of positioning errors, improving both imaging efficiency and diagnostic consistency across radiology departments. Among the emerging technological approaches in this area, RGB-D camera-based systems have shown notable potential in enhancing patient setup and positioning ( 3 ; 2 ) . These integrated systems use depth-sensing to generate surface maps of the patient’s body. By analyzing these surface contours, it becomes possible to detect and localize key anatomical landmarks, which serve as proxies for internal anatomical regions of interest. This information can then be used to infer the optimal imaging volume and adjust the patient table position automatically prior to scan acquisition, without the need for scout imaging. For example, 12 demonstrated the utility of RGB-D sensors in automatically localizing target regions such as the head and thorax with high spatial accuracy. Similarly, 14 employed depth-aware landmark detection models to support robust, contactless patient positioning in MRI and CT workflows. In the proposed workflow, a depth sensor is integrated into the room above the scanner bore to capture a depth image of the patient lying on the table. This depth image is then processed by the trained model, which outputs the 3D coordinates of the bounding box enclosing the organ of interest. Based on this prediction, the scanner table can be automatically adjusted to ensure that the relevant anatomy is optimally centered within the imaging field-of-view, minimizing the need for manual repositioning or iterative scout imaging (Figure 1 ). This approach offers a contactless, fast, and standardized method of patient localization, which could be particularly beneficial in high-throughput clinical environments or for procedures requiring precise anatomical targeting. To ensure robust performance across a wide range of anatomical variations and body types, we train our model on a large-scale dataset consisting of approximately 10,000 whole-body MRI scans from the German National Cohort (NAKO) study ( 1 ) . This dataset includes subjects of diverse ages, body sizes, and physiological characteristics, enabling the model to generalize effectively across different patient populations. Our experimental evaluation demonstrates the effectiveness of the proposed method in accurately localizing 41 distinct internal anatomical structures, including bones and soft tissue organs, using only depth images. The key contributions of this work are as follows: 1. We demonstrate the feasibility and effectiveness of a learning-based framework for estimating 3D locations of internal anatomical structures solely from depth images of the patient’s body surface. 2. We introduce a convolutional neural network architecture, Pixel-to-Voxel (Pix2Vox), which maps 2D depth images to 3D volumetric segmentation masks, enabling organ localization from a single surface view. 3. We validate the generalizability of our model across a wide range of body types and anatomical variations by training and evaluating on a large-scale, population-level dataset comprising approximately 10,000 whole-body MRI scans. 2 Related Works The prediction of internal anatomical structures from external body surface representations has gained increasing attention due to its potential to enable non-invasive, efficient, and patient-specific modeling. Early work by 26 introduced a learning-based framework that generates volumetric anatomical phantoms of skeletal and pulmonary structures from triangulated meshes of the patient’s external surface. This study demonstrated the feasibility of inferring detailed 3D internal anatomy from external geometry using deep models trained on co-registered body surface and internal organ data. Intermediate

Read the complete text