VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Space

Lin Li Zehuan Huang Haoran Feng Gengxiong Zhuang Rui Chen, Chunchao Guo Lu Sheng, Beihang University Renmin University of China Tsinghua University Tencent Hunyuan Project page: https://huanngzh.github.io/VoxHammer-Page/ · 2025

Read VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Space by Lin Li Zehuan Huang Haoran Feng Gengxiong Zhuang Rui Chen, Chunchao Guo Lu Sheng, Beihang University Renmin University of China Tsinghua University Tencent Hunyuan Project page: https://huanngzh.github.io/VoxHammer-Page/ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-19247.txt.

Introduction

Lin Li and colleagues present VoxHammer, a method with no training to edit three-dimensional objects with care in their native 3D space. Local 3D editing matters for games and for robot work. Past methods edit rendered multi-view images and then rebuild the model. But they fail to keep unedited regions exact. They also fail to keep the whole object coherent.

VoxHammer first predicts a model's inversion path. It captures its inverted latents and key-value tokens at each step. In denoising and editing, it swaps the traits of regions meant to stay untouched with those cached values. Kept areas are thus rebuilt in a steady way, while edited parts fit in well. To gauge this well, the team built Edit3D-Bench, a data set marked by humans. Tests show VoxHammer beats past methods by a lot.

Catalog record

CREATORLin Li Zehuan Huang Haoran Feng Gengxiong Zhuang Rui Chen, Chunchao Guo Lu Sheng, Beihang University Renmin University of China Tsinghua University Tencent Hunyuan Project page: https://huanngzh.github.io/VoxHammer-Page/
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-19247

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Space Lin Li Zehuan Huang Haoran Feng Gengxiong Zhuang Rui Chen, Chunchao Guo Lu Sheng, Beihang University Renmin University of China Tsinghua University Tencent Hunyuan Project page: https://huanngzh.github.io/VoxHammer-Page/ Abstract 3D local editing of specified regions is crucial for game industry and robot interaction. Recent methods typically edit rendered multi-view images and then reconstruct 3D models, but they face challenges in precisely preserving unedited regions and overall coherence. Inspired by structured 3D generative models, we propose VoxHammer, a novel training-free approach that performs precise and coherent editing in 3D latent space. Given a 3D model, VoxHammer first predicts its inversion trajectory and obtains its inverted latents and key-value tokens at each timestep. Subsequently, in the denoising and editing phase, we replace the denoising features of preserved regions with the corresponding inverted latents and cached key-value tokens. By retaining these contextual features, this approach ensures consistent reconstruction of preserved areas and coherent integration of edited parts. To evaluate the consistency of preserved regions, we constructed Edit3D-Bench, a human-annotated dataset comprising hundreds of samples, each with carefully labeled 3D editing regions. Experiments demonstrate that VoxHammer significantly outperforms existing methods in terms of both 3D consistency of preserved regions and overall quality. Our method holds promise for synthesizing high-quality edited paired data, thereby laying the data foundation for in-context 3D generation. Figure 1 : High-quality 3D assets edited by our method using text prompts. Our method uses a training-free approach to perform percise and coherent 3D local editing, transforming multiple 3D assets in the scene (left) into high-quality results (right). The bottom row shows a detailed comparison of each 3D asset before and after editing, as well as the conditioning texts. † † footnotetext: ∗ Equal contribution † Project lead ✉ Corresponding author 1 Introduction In recent years, the rapid advancement of generative AI has greatly facilitated the creation of 3D assets Poole et al. 2022 ; Liu et al. 2024d ; Hong et al. 2023 ; Zhang et al. 2024 ; Li et al. 2025f ; Xiang et al. 2025 , providing powerful production tools for industries such as gaming, robotics, and VR. Among these, 3D local editing Chen et al. 2023 ; Sella et al. 2023 ; Zhuang et al. 2024 ; Barda et al. 2024 ; Sella et al. 2025 ; Li et al. 2025a is a crucial task that enables partial modification of existing or AI-generated 3D assets while keeping other regions unchanged. It presents challenges in maintaining consistency in preserved regions and ensuring overall coherence in the edited model. Existing 3D editing methods can be broadly categorized into two pipelines. One approach Sella et al. 2023 ; Chen et al. 2023 ; Zhuang et al. 2024 ; Liu et al. 2024b ; Dong et al. 2024 ; Dinh et al. 2025 employs Score Distillation Sampling (SDS) Poole et al. 2022 to optimize 3D representations so that it aligns with input prompts, but per-scene editing typically takes minutes or even hours. Another approach Chen et al. 2024a ; Bar-On et al. 2025 ; Qi et al. 2024 ; Erkoç et al. 2024 ; Gao et al. 2024 ; Li et al. 2025b attempts to edit multi-view images Shi et al. 2023 ; Huang et al. 2024a rendered from the 3D model and then reconstruct the 3D model from the modified views. These techniques achieve higher efficiency through a feed-forward process. However, editing in 2D space instead of 3D space usually introduces position bias in the 3D reconstruction stage, making accurate local editing difficult. In addition, inconsistencies among edited multi-view images Cao et al. 2024 ; Barda et al. 2024 ; Erkoç et al. 2024 lead to artifacts in the edited 3D model, compromising quality and coherence Zheng et al. 2025 ; Li et al. 2025b . Recently, advanced 3D generative models Zhang et al. 2023 ; Zhang et al. 2024 ; Li et al. 2025f ; Wu et al. 2024b ; Li et al. 2024 ; Xiang et al. 2025 ; Li et al. 2025g , trained in native 3D space, can generate high-fidelity 3D content from text or image prompts. These models exhibit significant advantages in 3D consistency and quality, inspiring us to edit 3D assets in native 3D space. However, fine-tuning these models for editing is constrained by a critical data bottleneck: large-scale paired datasets for 3D local editing are exceptionally difficult to acquire. Therefore, our research focuses on unleashing the potential of pretrained 3D generative models for precise and coherent 3D editing, eliminating the need for additional training. We propose VoxHammer , a training-free framework for precise and coherent 3D editing. Our method is based on a pretrained structured 3D latent diffusion model Xiang et al. 2025 , and introduce a two-stage process: precise 3D inversion, and denoising and editing based on the inverted latents. Given a 3D model (mesh, NeRF Mildenhall et al. 2021 , or Gaussian Splat Kerbl et al. 2023 ), VoxHammer first predicts its inversion trajectory of 3D diffusion process and caches its inverted latents and key-value tokens at each timestep. We demonstrate that the inversion can reconstruct the given model’s 3D geometry and texture with high precision. In the subsequent denoising and editing phase, we denoise the edited region, and replace the denoising features of preserved regions with the corresponding inverted latents and cached key-value tokens. By retaining these contextual features, our approach ensures consistent reconstruction of preserved areas and coherent integration of edited parts. This is achieved without training the base model and only through feature replacement at inference, allowing high-quality 3D local editing at minimal cost. The lack of labeled editing regions in existing datasets makes it challenging to objectively evaluate consistency in preserved areas. To address this, we constructed Edit3D-Bench , a human-annotated dataset comprising hundreds of samples with carefully labeled 3D editing regions. Quantitative and qualitative experiments on Edit3D-Bench show that VoxHammer significantly outperforms existing methods in terms of both editing accuracy and overall quality. Our training-free method also holds promise for synthesizing high-quality edited paired data, thereby laying the data foundation for in-context 3D generation. Our main contributions are summarized as follows: • We propose a training-free, native 3D local editing framework that leverages a pretrained 3D generative model for highly precise and coherent editing. • We introduce precise 3D inversion and denoising-based editing using inverted latents, where we replace inverted latents and key-value tokens in the 3D latent space to ensure consistent reconstruction of preserved regions and coherent editing. • We built Edit3D-Bench , a benchmark to thoroughly validate the superiority of VoxHammer in both editing accuracy and overall quality. Our method holds promise for synthesizing high-quality edited paired data, thereby laying the data foundation for in-context 3D generation. 2 Related Work Figure 2 : Pipeline. Given an input 3D model, a user-specified editing region, and a text prompt, the off-the-shelf models Labs 2024 ; Black Forest Labs 2024 are used to inpaint the rendered view from the 3D model. Subsequently, our VoxHammer , a training-free framework based on structured 3D diffusion models Xiang et al. 2025 , performs native 3D editing conditioned on the input 3D and the edited image. 3D generative models. Recent advances

Read the complete text