UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image
Mohamed El Amine Boudjoghra, Ivan Laptev, Angela Dai, [0.5em] Technical University of Munich · 2026
Read UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image by Mohamed El Amine Boudjoghra, Ivan Laptev, Angela Dai, [0.5em] Technical University of Munich (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30608.txt.
Introduction
Mohamed El Amine Boudjoghra, Ivan Laptev and Angela Dai present UnfoldArt, a system that rebuilds articulated 3D objects from a single text prompt or image. Articulated objects, things with moving parts like drawers and laptops, are vital for robotics and virtual worlds. Rebuilding them is hard because hinges, hidden surfaces and inner structure cannot be seen in one still view, and training data is scarce.
UnfoldArt lets software agents debate the answer. High-level agents reason about meaning and motion using vision-language and video models. Low-level agents estimate joint parameters and contact points. Two debate rounds first exploit disagreements, then ground claims in freely generated video. Video driven by the agreed motion then swings parts open, exposing interiors no still image shows. The result is a complete object with geometry, inner structure and motion-consistent states.
Catalog record
| CREATOR | Mohamed El Amine Boudjoghra, Ivan Laptev, Angela Dai, [0.5em] Technical University of Munich |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.30608
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image Mohamed El Amine Boudjoghra, Ivan Laptev, Angela Dai, [0.5em] Technical University of Munich Abstract Articulated 3D objects are essential for interactive environments in embodied AI, robotics, and virtual reality, but reconstructing their structure and motion from sparse observations remains challenging. Existing approaches remain largely constrained by lack of supervised data or lack the priors needed to reliably recover articulation, hidden geometry, and internal object structure. We present the first debate-driven agentic approach to articulated 3D object reconstruction from text or image inputs that both grounds articulation reasoning in concrete motion and exposes the occluded geometry revealed under articulation. High-level agents reason about object semantics and motion using knowledge from vision-language and video models, while low-level agents estimate articulation parameters and interaction points; together, they engage in a two-round structured debate that first exploits global–local disagreement and then grounds the agents in freely generated video. The same video prior, conditioned on the agreed articulation, then drives each part through its motion to expose occluded interiors and geometry that cannot be inferred from a single static view. By combining agentic reasoning with a video generative prior, our approach jointly infers articulation and reconstructs complete 3D articulated objects, producing high-fidelity geometry, internal structure, and motion-consistent states beyond directly observed surfaces. Figure 1: UnfoldArt generates articulated 3D objects from a single text or image input, recovering both the external part structure and the high-fidelity interior geometry that becomes visible only under articulation. To achieve this, we propose a debate-driven agentic approach to articulated 3D reconstruction, combining hierarchical agent debate with a video generative prior that grounds articulation reasoning in concrete motion and exposes occluded interior geometry. 1 Introduction Articulated 3D objects form basic building blocks in interactive virtual worlds, underpinning applications across embodied AI, robotic simulation, and virtual reality. Generating them from text or image inputs would enable the creation of complex, manipulable scenes in which each object exposes not only its external form but also the hidden interior structures that become visible as its components are articulated. Realizing this requires jointly recovering an object’s part decomposition, articulation parameters, and the occluded structure revealed through motion. Due to their important role in enabling interactivity, significant efforts have recently been devoted to modeling articulated 3D objects. Most efforts have focused on training supervised models 1 ; 21 directly on articulated 3D datasets such as PartNet-Mobility 37 ; 28 ; 3 ; this achieves strong in-domain results but struggles to generalize broadly, as available ground-truth data remains small in scale (on the order of 2k objects). Existing ground-truth data also typically models only exterior structure, omitting interior components, which further limits applicability. A more recent line of work reduces this reliance on articulated supervision by exploiting pre-trained generative priors 4 ; 17 ; 25 , yet each such method depends on a signal unavailable in the single-image, single-state setting we target: multi-view observations across articulation states 4 , a critic grounded in a fixed asset library with exact reference geometry 17 , or a video prior fine-tuned on articulation-specific data 25 . We defer a detailed discussion to Sec. 2 ; the key observation is that the mechanisms making these approaches reliable, namely extra views, a trusted critic, and a fine-tuned prior, are each absent in our setting. Our approach addresses these challenges by recognizing that modern vision-language models (VLMs) and video generative models already encode rich knowledge about how objects articulate, and can be orchestrated in an agentic framing that deliberates over their predictions to recover robust, complete articulated 3D object structures. In particular, VLMs can supply high-level semantic reasoning about parts and plausible motion families, while video models can realize how these motions actually unfold, producing generated videos that ground the debate in concrete visual evidence about articulation parameters while also revealing occluded geometry that is often unrecoverable from a static view alone. Crucially, only two signals in our pipeline are specific to articulation: local-global agreement among agents, which resolves articulation parameters, and a frozen video prior, which serves the pipeline twice, first as external motion evidence grounding the debate and then as the means to expose occluded geometry. Every other component we build on (the 3D, image, and video priors) is a general-purpose pretrained model carrying no articulation supervision. We thus propose a debate-driven agentic approach for articulated 3D object reconstruction from text or image inputs. From the input prompt or image, we first obtain a TRELLIS 38 mesh that provides an initial 3D estimate of the object, giving the agents a grounded representation to reason over. A hierarchy of agents then divides labor between global and local reasoning: a Decomposer identifies parts and their plausible motions, a Grounder translates this into a local segmentation strategy on the mesh, and an Articulator predicts joint type, axis, and pivot for each part. Because low-level predictions are the most error-prone, the Articulator’s output triggers a two-round debate between the global and local agents that first exploits their disagreement and then grounds the proposed motions in freely generated video to resolve articulation ambiguity. Once the debate converges, the agreed-upon articulation conditions a guided video inpainting pass that exposes the hidden geometry behind each movable part, which we reconstruct into an interactable URDF with complete interior geometry, ready for downstream use. Our contributions are: • The first debate-driven agentic approach to articulated 3D reconstruction; our approach turns whole-object and part-level disagreement into the corrective signal for joint parameters, grounded in freely generated video of the proposed motion. • Recovery of complete articulated objects, including occluded interiors, via 3D latent inpainting driven by articulation-conditioned generated video. 2 Related works 3D shape and part generation. Recent 3D generative models produce high-fidelity static geometry from text or image inputs 43 ; 44 ; 45 ; 39 , leveraging large 3D repositories such as Objaverse 8 ; 7 . A complementary line decomposes shapes into parts, either generatively 33 ; 42 ; 20 ; 40 ; 27 or through segmentation 41 ; 24 . These methods target static surface geometry. We build on these foundations, specifically TRELLIS 39 ; 38 , and extend the generative paradigm to articulation and to the occluded interior structure such geometry omits. Articulation prediction for existing geometry. A first family predicts articulation parameters for geometry that is already given, either estimating joints from RGB video 30 or fine-tuning vision-language models 11 on articulated datasets such as PartNet-Mobility ( {\sim}2 K objects). These approaches recover only kinematics for pre-existing parts; we instead jointly generate geometry, articulation, and interior structure from a single image or text prompt. Articulated reconstruction from observations. A second family jointly recovers geometry, parts, and kinematics, but remains tied to costly input signals. Per-instance optimization approaches 22 ; 35 ; 29 ; 32 ; 36 fit NeRF, SDF, or Gaussian representations to multi-view captures of an object in two or more articulation states. Feed-forward methods 23 ; 21 ; 5 ; 6 ; 31 ; 10 ; 19 ; 1 instead learn priors over articulated structure from supervised data such as PartNet-Mobility; these include generative variants such as PhysX-Anything 1 , which fine-tunes a VLM to output simulation-ready assets, yet still draws