ParCo-SDF: Learning Prior-Free Partial-to-Complete Signed Distance Fields of Deformable Objects

Deokmin Hwang, Minseok Song, Daehyung Park · 2026

Read ParCo-SDF: Learning Prior-Free Partial-to-Complete Signed Distance Fields of Deformable Objects by Deokmin Hwang, Minseok Song, Daehyung Park (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29417.txt.

Introduction

Deokmin Hwang presents ParCo-SDF, a two-stage method for partial-to-complete signed distance field reconstruction of soft objects. Recent methods use hidden neural codes for smooth shapes, but rely on shape priors that fail on new objects. ParCo-SDF instead mixes time shape coding with FiLM-tuned forecasts, with no shape priors. The time encoder captures likeness across runs, for prior-free training, while FiLM tuning preserves range and reduces size. Against a rival on a rubber band dataset, it shows robust rebuilds when much is hidden.

Catalog record

CREATORDeokmin Hwang, Minseok Song, Daehyung Park
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27232
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.29417

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ParCo-SDF: Learning Prior-Free Partial-to-Complete Signed Distance Fields of Deformable Objects Deokmin Hwang, Minseok Song, Daehyung Park Abstract This study addresses the partial-to-complete geometry reconstruction of deformable objects (DOs) from point-cloud observations toward precise DO manipulation. Recent DO reconstruction approaches often adopt implicit neural representations (INRs) to model continuous surfaces as well as capture structural variability. However, these methods typically rely on object-specific shape priors that improve training stability and limit generalization. To figure it out, we introduce ParCo-SDF, a two-stage partial-to-complete signed distance field (SDF) reconstruction framework consisting of temporal geometry encoding followed by FiLM-conditioned SDF prediction. The temporal encoder captures structural similarity across DO sequence, enabling prior-free stable training. FiLM-based conditioning preserves reconstruction expressivity while reducing network complexity. We evaluate the proposed method against a state-of-the-art DO surface reconstruction baseline on a rubber band manipulation dataset, demonstrating robust and high-fidelity reconstruction under severe occlusions. I Introduction Deformable object manipulation (DOM) is a fundamental yet challenging problem in robotics [ 32 , 11 , 20 ] . Unlike rigid objects, deformable objects (DOs) exhibit infinite degrees of freedom (DoF), undergoing continuous geometric and topological changes during interaction. These properties frequently cause severe self-occlusions and robot-induced occlusions, obscuring critical state information required for manipulation. The occluded structures and their surface representations play a critical role in downstream manipulation and control tasks [ 12 , 19 , 13 ] by characterizing deformation, contact interactions, and physical responses [ 2 , 10 ] . Consequently, recovering complete object geometry from partial sensory observations has become a central problem in deformable object manipulation. Early approaches rely predominantly on explicit representations, such as point clouds and meshes [ 6 , 9 ] . Point cloud representations suffer from finite sampling and undesired point distributions. Further, the absence of explicit structural connectivity makes them vulnerable to severe overlap and occlusion [ 14 ] . Mesh-based representations explicitly encode surface topology; however, capturing fine-grained deformations requires dense discretization, which introduces computational cost [ 33 ] . Recent advances in implicit neural representations (INRs) offer a compelling alternative by modeling geometry as continuous functions over space, allowing resolution-independent and topology-agnostic surface reconstruction [ 34 , 23 ] . In particular, signed distance fields (SDFs) encode not only surface geometry but also surface normals via spatial gradients. This property allows SDF-based models to represent severe deformations with self-contact, making them well-suited for DO representation [ 34 ] . Despite their effectiveness, INR-based approaches often focus on memorizing a single DO, thereby limiting their ability to generalize to unseen deformation scenarios. Fig. 1: Comparison of partial-to-complete reconstruction performances under severe deformation and occlusion of the rubber band (yellow). (a) A sequence of rubber band manipulation scenes illustrating the acquisition of partial observations (i.e., point clouds) used for temporal geometry encoding. Note that the last scene at time step t exhibits severe occlusion, resulting in highly partial observations. (b) Reconstructed geometry at time step t with and without temporal geometry encoding, visualized from seven viewpoints. The proposed method, ParCo-SDF, infers the complete geometry from temporal observations, enabling occlusion-robust reconstruction. To extend INRs beyond single-instance reconstruction, prior works introduce conditioning mechanisms that inject instance-specific information into a shared implicit network [ 26 ] . A common strategy, input concatenation , augments implicit network query by concatenating an instance-specific latent code [ 21 ] . However, as the number of instances increases, the limited scalability of the shared implicit network constraints its representational capacity, thereby restricting the expressiveness across diverse instances. Hypernetwork-based methods alleviate this limitation by predicting implicit network parameters from latent codes [ 24 , 31 ] , but introduce significant computational overhead and training instability due to the quadratic growth of predicted parameters with network width [ 1 ] . This highlights the need for a conditioning mechanism that jointly models continuously evolving deformation states while maintaining both expressive capacity and stable training. Beyond representation and conditioning challenges, reconstructing complete object geometry from partial observations is inherently ill-posed [ 8 , 4 ] . Researchers often rely on shape priors, such as predefined templates or geometric symmetry, to achieve occlusion-robust reconstruction [ 23 , 17 , 25 ] . However, such assumptions restrict generalization to unforeseen structures or deformations that do not conform to these priors. Alternatively, multi-view approaches mitigate single-frame ambiguities by aggregating observations from multiple viewpoints [ 29 ] . However, under large deformations such as twisting, object parts may collapse or self-occlude, resulting in the loss of reliable geometric cues. In this context, we propose ParCo-SDF, a partial-to-complete implicit SDF reconstruction framework leveraging temporal geometry encoding. ParCo-SDF consists of two stages: (1) temporal geometry encoding and (2) modulation-based SDF prediction. The temporal geometry encoder aggregates a sequence of partial observations into a latent code via self-attention [ 28 ] , capturing structural information without imposing explicit shape priors (see Fig. 1 ). Conditioned on the code, the modulation-based SDF predictor then reconstructs an implicit SDF network to complete the full DO geometry via feature-wise linear modulation (FiLM) [ 22 ] . This modulation structure helps increasing the implicit network size while preserving training stability. We evaluate ParCo-SDF on a rubber band manipulation dataset. The results show that our method consistently outperforms a baseline in geometric fidelity and robustness to previously unseen deformation states, demonstrating occlusion-robust reconstruction across diverse structures and deformations. Fig. 2: Overview architecture of ParCo-SDF for reconstructing signed distance functions (SDFs) of deformable objects from a sliding window of partial point-cloud observations \{{\mathcal{P}}^{t-T+1},\ldots,{\mathcal{P}}^{t}\} . The temporal geometry encoder {\mathcal{E}} aggregates a sequence of partial point clouds through Fourier-feature mapping \gamma , DGCNN-based local geometry encoding, and attention-based temporal aggregation to produce a latent code \mathbf{z}^{t} . Given \mathbf{z}^{t} , a modulator {\mathcal{G}} predicts layer-wise shift parameters, which modulate a shared implicit network f_{\boldsymbol{\theta}} that returns the signed distance d_{\mathbf{x}} at a queried spatial coordinate \mathbf{x} . Here, \oplus denotes the element-wise sum. II Method We address the partial-to-complete geometry reconstruction of DOs from temporally ordered partial point-cloud observations acquired during manipulation. At each time step t , a fixed external depth sensor captures a partial point cloud {\mathcal{P}}^{t}\subset\mathbb{R}^{3} of the DO. Note that due to self-occlusion and robot-induced occlusion, each observation alone lacks sufficient geometric cues to reconstruct the complete structure of the deformation state. We represent the complete object geometry as the zero level-set of an implicit signed distance function defined over a bounded spatial domain {\mathcal{Q}}\subset\mathbb{R}^{3} . Given a query point \mathbf{x}\in{\mathcal{Q}} , an implicit neural network f_{{\boldsymbol{\theta}}}:{\mathcal{Q}}\rightarrow\mathbb{R} , parameterized by {\boldsymbol{\theta}} , predicts a signed distance value to the object surface, where positive and negative values indicate the exterior and interior of the object, respectively. To model the evolving geometry with a single shared implicit network, we condition the network on a latent code extracted from a sliding window of temporally ordered partial observations, \{{\mathcal{P}}^{t-T+1},\ldots,{\mathcal{P}}^{t}\} , where T denotes the window length. As illustrated in Fig. 2 , the overall architecture consists of two stages: (1) temporal geometry encoding (see Sec. II-A ) and (2) modulation-based SDF prediction (see Sec. II-B ). The encoder {\mathcal{E}} maps the observation window to a latent code \mathbf{z}^{t}\in\mathbb{R}^{d} , where d denotes the latent dimensionality. Conditioned on \mathbf{z}^{t} , the implicit SDF reconstructor f_{{\boldsymbol{\theta}}}(\mathbf{x};\mathbf{z}^{t}) predicts the

Read the complete text