Evaluation of Intra-operative Patient-specific Methods for Point Cloud Completion for Minimally Invasive Liver Interventions
Nakul Poudel, Zixin Yang, Kelly Merrell, Richard Simon, Cristian A. Linte · 2025
Read Evaluation of Intra-operative Patient-specific Methods for Point Cloud Completion for Minimally Invasive Liver Interventions by Nakul Poudel, Zixin Yang, Kelly Merrell, Richard Simon, Cristian A. Linte (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-11969.txt.
Introduction
Nakul Poudel and co-authors tested in 2025 six leading methods for completing the partial surface scans that laparoscopic liver surgery actually produces. Surgeons must align a pre-operative liver model with what the camera sees, but the view is patchy and noisy. The team asked which completion method best fills the gaps for a specific patient.
A transformer-based method won clearly when the partial scan sat in the standard pose. Rotate the liver, or add noise, and every method degraded badly. The authors say the failure modes matter more than the winner. Real operating data will not pose politely. They call for completion methods hardened to pose and noise before clinics can lean on them. The study doubles as a warning label for the field.
Catalog record
| CREATOR | Nakul Poudel, Zixin Yang, Kelly Merrell, Richard Simon, Cristian A. Linte |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-11969
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evaluation of Intra-operative Patient-specific Methods for Point Cloud Completion for Minimally Invasive Liver Interventions Nakul Poudel, Zixin Yang, Kelly Merrell, Richard Simon, Cristian A. Linte Abstract The registration between the pre-operative model and the intra-operative surface is crucial in image-guided liver surgery, as it facilitates the effective use of pre-operative information during the procedure. However, the intra-operative surface, usually represented as a point cloud, often has limited coverage, especially in laparoscopic surgery, and is prone to holes and noise, posing significant challenges for registration methods. Point cloud completion methods have the potential to alleviate these issues. Thus, we explore six state-of-the-art point cloud completion methods to identify the optimal completion method for liver surgery applications. We focus on a patient-specific approach for liver point cloud completion from a partial liver surface under three cases: canonical pose, non-canonical pose, and canonical pose with noise. The transformer-based method, AdaPoinTr, outperforms all other methods to generate a complete point cloud from the given partial liver point cloud under the canonical pose. On the other hand, our findings reveal substantial performance degradation of these methods under non-canonical poses and noisy settings, highlighting the limitations of these methods, which suggests the need for a robust point completion method for its application in image-guided liver surgery. a]Center for Imaging Science, Rochester Institute of Technology, Rochester, NY 14623, USA b]Biomedical Engineering, Rochester Institute of Technology, Rochester, NY 14623, USA keywords Point cloud completion, image-guided liver surgery, registration. † † authorinfo: Further author information: Nakul Poudel: E-mail: [email protected] Zixin Yang: E-mail: [email protected] Kelly Merrell: E-mail: [email protected] Richard Simon: E-mail: [email protected] Cristian A. Linte: E-mail: [email protected] 1 INTRODUCTION To help surgeons locate critical surgical targets and structures, such as tumors and vessels, various registration methods have been developed [ 1 , 2 , 3 ] . Different registration approaches can be applied depending on the chosen intra-operative imaging modality. This study focuses on 3D-3D registration, where pre-operative data from CT or MRI, represented as a point cloud or mesh, is aligned with intra-operative data acquired through 3D sensors and reconstruction techniques [ 4 ] , typically represented as a point cloud. However, this registration process is challenging due to partial intra-operative visibility of the liver, noise in the data, and liver deformation [ 5 , 6 ] . Point cloud completion (PCC) methods aim to generate complete point clouds from partial point clouds, which can potentially improve registration accuracy by generating a cleaner and more complete intra-operative surface. Moreover, if these methods can directly recover the complete liver model from the intra-operative point cloud, they may even eliminate the need for traditional registration techniques. To our knowledge, only a few research studies have been conducted on liver intra-operative point cloud completion. Xi et al. [ 7 ] primarily focused on recovering dense 3D point clouds from monocular depth estimation methods. However, Xi et al. employed an affine transformation to deform the liver, which does not accurately capture realistic deformations. Whether point cloud completion methods can effectively handle realistic tissue deformations, such as those generated from biomechanical models, remains uncertain. In the framework proposed by Foti et al. [ 8 ] , manual identification is still required to roughly select a region from the pre-operative model corresponding to the visible intra-operative surface. However, this manual identification process is not trivial and is prone to errors. Lastly, neither of the above two methods is publicly available, hence hindering the understanding of the performance of point cloud completion methods toward applications in image-guided liver surgery. This study examines and evaluates several state-of-the-art point cloud completion methods for liver surgery applications under different cases. Specifically, we currently focus on the patient-specific approach to evaluate their performances, where simulated intra-operative point clouds are generated by deforming the single liver model. This simplification allows us to focus on other factors influencing completion results, such as visibility ratio and noise. In addition, a patient-specific approach could offer high accuracy. We perform experiments that cover three main cases: canonical pose, non-canonical pose, and noisy data in the canonical pose. During surgical procedures, the camera field of view and patient positioning may lead to the intra-operative liver being captured from various poses. Point cloud completion methods are expected to generalize well to those arbitrary liver poses to be effective in the surgical environment. Thus, we evaluate the methods at canonical and non-canonical poses. The point clouds exhibit consistent positions and orientations in the canonical pose, whereas they have arbitrary positions and orientations in the non-canonical pose. To account for noisy intra-operative point cloud data from 3D sensors, we also simulated the noisy data condition by adding Gaussian noise to the canonical point clouds. 2 Methodology 2.1 Problem Definition Given a partial intra-operative point cloud, we aim to find the optimal point cloud completion method to generate a complete point cloud accurately and robustly. The intra-operative liver point clouds obtained by deforming and cropping the pre-operative liver model in different ways are input to the six well-established learning-based point cloud completion methods: FoldingNet, PCN, GRNet, TopNet, PoinTr, and AdaPoinTr. 2.2 FoldingNet FoldingNet [ 9 ] is an auto-encoder network that performs folding operations on the decoder. The encoder consists of two graph layers that promote local structural information. The encoder’s output is a high-dimensional embedding of an input point cloud called codewords. Folding operations start by augmenting 2D grid points with codewords. The surface structure is reproduced by combining multiple folding operations. 2.3 PCN PCN [ 10 ] is also an encoder-decoder network. The encoder outputs feature vectors generated from a partial input point cloud. The decoder comprises a multi-stage point generation pipeline incorporating both fully connected and folding-based decoders. The former is responsible for generating a sparse point set that represents the global geometry of a shape. The latter is responsible for generating a more smooth surface that represents the local geometry of a shape. This combination enables PCN to effectively reconstruct an incomplete point cloud by balancing global structure and local detail. 2.4 TopNet TopNet [ 11 ] introduced a novel rooted tree-structure decoder to model arbitrary structure/topology on a point cloud. The root node of the tree receives feature vectors as input from the encoder. Multi-layer perceptrons (MLPs) are arranged in a tree structure to produce feature vectors for their child nodes. The leaf nodes of the tree output the final 3D points. 2.5 GRNet To fully capture structural and contextual information, GRNet [ 12 ] introduces three key components: gridding, gridding reverse, and cubic feature sampling. The gridding layer creates 3D grids as intermediate representations to capture spatial relationships in the point cloud using 3D convolution. The gridding reverse layer generates the coarse point cloud from the 3D grid. Using feature maps from the 3D CNN layers, cubic feature sampling produces features for coarse point clouds. Finally, the MLP layer takes the coarse point cloud and the features to produce the final completed point cloud. 2.6 PoinTr and AdaPoinTr PoinTr [ 13 ] leverages a transformer encoder-decoder architecture to capture more detailed structural information. It converts the point cloud completion task into a set-to-set translation task, where point proxies of the partial point cloud are input and point proxies of the missing part are output.