Prox ⋅ \cdot E: Fine-Grained 3D Shape Editing via Primitive-Based Abstractions 835 Journal: TOG Conference: Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers; July 19–23, 2026; Los Angeles, CA, USA Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers (SIGGRAPH Conference Papers ’26), July 19–23, 2026, Los Angeles, CA, USA DOI: 10.1145/3799902.3811141 ISBN: 979-8-4007-2554-8/2026/07 CCS: Computing methodologies Computer graphics

Etai Sella, Hao Phung, Nitay Amiel, Or Litany, Or Patashnik, Hadar Averbuch-Elor · 2026

Read Prox ⋅ \cdot E: Fine-Grained 3D Shape Editing via Primitive-Based Abstractions 835 Journal: TOG Conference: Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers; July 19–23, 2026; Los Angeles, CA, USA Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers (SIGGRAPH Conference Papers ’26), July 19–23, 2026, Los Angeles, CA, USA DOI: 10.1145/3799902.3811141 ISBN: 979-8-4007-2554-8/2026/07 CCS: Computing methodologies Computer graphics by Etai Sella, Hao Phung, Nitay Amiel, Or Litany, Or Patashnik, Hadar Averbuch-Elor (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-23774.txt.

Introduction

Sella, Phung, Amiel, Litany, Patashnik, and Averbuch-Elor present Prox-E, a training-free framework for fine 3D shape edits via primitives. It first abstracts a 3D shape into a compact set of simple shapes. A vision-language model edits this shape set to specify local structural changes. These edits then guide a 3D generative model while preserving untouched regions. Tests show it beats rivals at keeping identity, shape quality, and prompt match.

Catalog record

CREATOREtai Sella, Hao Phung, Nitay Amiel, Or Litany, Or Patashnik, Hadar Averbuch-Elor
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65326
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.23774

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Prox ⋅ \cdot E: Fine-Grained 3D Shape Editing via Primitive-Based Abstractions 835 Journal: TOG Conference: Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers; July 19–23, 2026; Los Angeles, CA, USA Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers (SIGGRAPH Conference Papers ’26), July 19–23, 2026, Los Angeles, CA, USA DOI: 10.1145/3799902.3811141 ISBN: 979-8-4007-2554-8/2026/07 CCS: Computing methodologies Computer graphics Etai Sella, Hao Phung, Nitay Amiel, Or Litany, Or Patashnik, Hadar Averbuch-Elor Abstract . Text-based 2D image editing models have recently reached an impressive level of maturity, motivating a growing body of work that heavily depends on these models to drive 3D edits. While effective for appearance-based modifications, such 2D-centric 3D editing pipelines often struggle with fine-grained 3D editing, where localized structural changes must be applied while strictly preserving an object’s overall identity. To address this limitation, we propose Prox ⋅ \cdot E, a training-free framework that enables fine-grained 3D control through an explicit, primitive-based geometric abstraction. Our framework first abstracts an input 3D shape into a compact set of geometric primitives. A pretrained vision–language model (VLM) then edits this abstraction to specify primitive-level changes. These structural edits are subsequently used to guide a 3D generative model, enabling fine-grained, localized modifications while preserving unchanged regions of the original shape. Through extensive experiments, we demonstrate that our method consistently balances identity preservation, shape quality, and instruction fidelity more effectively than various existing approaches, including 2D-based 3D editors and training-based methods. Teaser figure in a grid: rows of 3D objects with primitive-based abstractions. Middle and lower rows show edited proxy shapes, with original geometry and edited or added super-quadric parts highlighted in blue and purple, alongside text prompts for each edit, illustrating global, parametric, part, and appearance edits. Figure 1. We introduce Prox \cdot E, a training-free 3D editing framework that operates on a primitive-based geometric abstraction. By editing this proxy representation (second and bottom rows; edited primitives shown in blue , added ones shown in purple ) and using it to guide 3D generation, Prox \cdot E enables precise, fine-grained edits while preserving the object’s identity. As illustrated above, our method supports a wide range of text-guided edits, spanning global and localized geometric transformations (edits 1 and 2) including parametric edits (edits involving a numeric parameter, i.e. edit 2), addition and removal of object parts (edit 3), and stylistic appearance-based modifications (edit 4). † † cc-license: by 1. Introduction Recent years have seen a Cambrian explosion of methods capable of generating novel 3D shapes directly from text. However, practical 3D creation workflows are far more often defined by the need for fine-grained modification rather than wholesale generation. Designers often seek to precisely alter existing geometry—such as lengthening a table’s legs by a fixed factor, introducing gentle ornamental details along a teapot’s spout, or turning a vehicle’s wheels as illustrated in Figure 1 —while strictly preserving the object’s overall identity. However, achieving this level of localized control remains challenging for modern 3D editors, which struggle to faithfully execute such fine-grained edits. Figure 2. Editing 3D objects with 2D generative models. Given an input image of a chair (left), state-of-the-art open and closed source image editors (Flux-Kontext ( 32 ) and Nano-Banana ( 22 ) ) successfully perform appearance-based edits and semantic insertions (right). In contrast, they struggle with fine-grained geometric instructions that require metric reasoning about existing structure (center). These failures reveal a fundamental mismatch between the capabilities of pixel-based editors and the requirements of of fine-grained, controllable 3D editing. The remarkable capabilities of modern 2D generative models have recently given rise to a 3D editing paradigm that shifts much of the editing work to image-based generators, treating 3D structure primarily as a scaffold for multi-view synthesis and aggregation ( 33 ; 62 ; 57 ; 21 ) . Implicit in this paradigm are two key assumptions: (i) that a pretrained 2D diffusion model can produce a semantically and geometrically correct edit of the underlying 3D asset from a projected view, and (ii) that a single, or a small set of, edited views is sufficient to faithfully propagate the modification to the full 3D shape. For fine-grained 3D edits, where success hinges on subtle geometric or localized stylistic nuances, the validity of these assumptions remains unclear. Consider the image edits produced by two state-of-the-art 2D image editing model, as illustrated in Figure 2 . While these models readily succeed at introducing new semantic content—(e.g., placing a bunny on the chair) or appearance-based modifications, they are challenged by instructions targeting fine-grained manipulations of existing geometry. Such structural edits require an explicit understanding of metric properties in 3D space, which is largely absent from pixel-based diffusion models. This gap challenges the assumption that pretrained 2D models can reliably support fine-grained edits of a 3D asset from projected views, highlighting a fundamental mismatch between image-based editors and the requirements of controllable 3D editing. In this work, we propose a training-free 3D editing framework that bridges image-based editors and fine-grained 3D controllability through an explicit, primitive-based shape abstraction. Rather than operating directly in pixel space, our framework decomposes an input 3D asset into a small set of interpretable geometric primitives. A pretrained vision–language model (VLM) operates on this abstraction to specify precise primitive-level edits, which are then used to guide a state-of-the-art 3D generative model ( 58 ) in producing fine-grained, localized modifications of the underlying 3D shape. By exposing structure and metric relationships explicitly, our framework unlocks the ability of VLMs to reason about fine-grained 3D edits that are difficult to express in pixel space alone. To accurately guide the 3D generative process, we introduce a proxy-induced denoising strategy that uses the primitive-based edits to determine where geometry should be preserved, transformed, or newly synthesized, and enforces these constraints directly in the latent space of a 3D diffusion model. At its core, our strategy employs a blending mechanism that composites inverted latent representations originating from both the input shape and the edited proxy, allowing the generative process to follow the specified structural edits while preserving the identity of the original shape. Finally, after generating a coherent edited structure, we refine appearance using 2D image editors, leveraging their strong visual priors to apply stylistic modifications and output a high-quality 3D shape. We conduct extensive experiments comparing our method against a broad range of 3D editing paradigms, including training-based 3D editors and image-based 3D editing approaches. We evaluate performance using metrics that quantify preservation of structural identity, quality of the generated shapes, and fidelity to the edit text prompt. Our results demonstrate that our approach achieves a superior balance among these criteria, enabling precise 3D edits while reliably preserving the original shape’s identity. 2. Related Work 2.1. Text-Guided 3D Editing Text-guided 3D manipulation has evolved rapidly, with recent surveys categorizing approaches into stylization, generation, and editing ( 9 ; 63 ) . Despite the remarkable fidelity of text-to-3D generative models, extending these capabilities to precise structural editing remains an unresolved challenge. Stylization, Deformation, and Optimization. Early works focused on stylizing geometry without topological changes. Methods like Text2Mesh ( 39 ) and Tango ( 13 ) leverage CLIP or depth-to-image diffusion for color and displacement optimization, with ( 14 ) adding part-level

Read the complete text