3DOT: Texture Transfer for 3DGS Objects from a Single Reference Image
Xiao Cao, Beibei Lin, Bo Wang, Zhiyong Huang, Robby T. Tan · 2025
Read 3DOT: Texture Transfer for 3DGS Objects from a Single Reference Image by Xiao Cao, Beibei Lin, Bo Wang, Zhiyong Huang, Robby T. Tan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-18853.txt.
Introduction
Xiao Cao and co-authors present 3DOT, a way to copy a texture from one photo onto a 3D object built from Gaussian splats, in work from 2025. Swapping surface texture makes 3D editing fast and flexible. Adapted photo editors must redo each view and drift apart, while text driven editors lose the look of the source photo.
The method edits one reference view first, then spreads the edit to nearby views step by step. Guidance terms reward views that agree and pull the result toward the reference texture. Splats keep the object's shape while its surface takes the new pattern. The result stays consistent as the object turns.
Catalog record
| CREATOR | Xiao Cao, Beibei Lin, Bo Wang, Zhiyong Huang, Robby T. Tan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-18853
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
3DOT: Texture Transfer for 3DGS Objects from a Single Reference Image Xiao Cao, Beibei Lin, Bo Wang, Zhiyong Huang, Robby T. Tan Abstract Image-based 3D texture transfer from a single 2D reference image enables practical customization of 3D object appearances with minimal manual effort. Adapted 2D editing and text-driven 3D editing approaches can serve this purpose. However, 2D editing typically involves frame-by-frame manipulation, often resulting in inconsistencies across views, while text-driven 3D editing struggles to preserve texture characteristics from reference images. To tackle these challenges, we introduce 3DOT , a 3D Gaussian Splatting O bject T exture Transfer method based on a single reference image, integrating: 1) progressive generation, 2) view-consistency gradient guidance, and 3) prompt-tuned gradient guidance. To ensure view consistency, progressive generation starts by transferring texture from the reference image and gradually propagates it to adjacent views. View-consistency gradient guidance further reinforces coherence by conditioning the generation model on feature differences between consistent and inconsistent outputs. To preserve texture characteristics, prompt-tuning-based gradient guidance learns a token that describes differences between original and reference textures, guiding the transfer for faithful texture preservation across views. Overall, 3DOT combines these strategies to achieve effective texture transfer while maintaining structural coherence across viewpoints. Extensive qualitative and quantitative evaluations confirm that our three components enable convincing and effective 2D-to-3D texture transfer. Our project page is available here: https://massyzs.github.io/3DOT_web/ . Figure 1 : Comparison of 2D and 3D image-based texture editing methods. Prompts are " moss-covered table " and " pink plastic bear ". 2D methods Plug-n-Play [ 36 ] suffers from view inconsistency problem; 3D text-driven editing methods IGS2GS [ 37 ] and GaussCtrl [ 41 ] struggle to preserve texture characteristics. Ours faithfully edit the texture, material appearance, and color. 1 Introduction Transferring texture from a 2D image to a 3D object is a valuable yet underexplored capability in 3D editing. It enables efficient texture manipulation and benefits applications such as virtual reality, CG films, and 3D games [ 2 , 31 , 40 , 23 , 28 , 39 , 34 , 5 ] . Despite advances in 2D texture and 3D editing techniques, transferring texture from a single 2D image to a 3D object remains challenging due to difficulties in ensuring view consistency and preserving texture characteristics, particularly for unseen views beyond the reference image. 2D image-based editing methods [ 36 , 46 , 25 , 32 , 14 , 51 , 24 , 42 ] perform texture transfer by finetuning a diffusion model (e.g., DreamBooth [ 30 ] , Textual Inversion [ 13 ] ) and editing images rendered from a 3D object to create a finetuning dataset. The resulting 3D object often suffers from view inconsistency and identity loss due to the absence of constraints enforcing multi-view coherence and identity preservation, as shown in Figure 1 . 3D editing methods [ 15 , 37 , 9 , 41 , 8 , 27 , 6 ] , especially text-driven ones, guide editing using prompts derived from reference images via visual language models or manual descriptions. However, these prompts are typically coarse and miss fine-grained features, resulting in identity mismatch and inconsistent appearance across views. Motivated by these challenges, we propose 3DOT , a novel framework for transferring texture from a single 2D reference image to a 3D object represented by 3D Gaussian Splatting [ 21 ] . 3DOT comprises three key components: 1) a progressive generation process, 2) view-consistency gradient guidance, and 3) prompt-tuning-based gradient guidance. The first two components enforce view consistency, while the third preserves texture characteristics. In the progressive generation process, we first obtain reference images either by directly pasting the reference image onto the 3D object or by generating candidate views using a depth-conditioned model [ 47 ] based on the unedited view’s depth. The image that best matches the target attributes is then selected. To facilitate prompt tuning and sparse cross-attention, we remove backgrounds from both the unedited training images and the reference images, and project them into the latent space for k-step partial diffusion. The generation begins from the reference view and progressively propagates to neighboring views, guided by sparse cross-attention on previously edited views. This strategy maximizes overlap between adjacent reference images to enforce view consistency. To enhance view consistency in 3D editing, we introduce view-consistency gradient guidance. The core idea is to guide the diffusion model toward view-consistent generation by minimizing texture inconsistency features in intermediate outputs. Specifically, we initialize two diffusion modules: one conditioned on reference views via cross-attention, and the other guided only by a text prompt. Since cross-attention is the only differing component, the discrepancy between their intermediate results captures view-consistency features. During each denoising step, these features are scaled and injected as gradient guidance, steering the generation toward consistent outputs across views. Since the reference image reveals no texture for unseen views, coarse text prompts often lead to inconsistency. To overcome this, we propose prompt-tuning-based gradient guidance that captures texture differences as additional prompt tokens. Specifically, we compute the difference between reference and unedited images in the CLIP feature space [ 11 ] , encoding the texture transformation direction. This signal is injected into the diffusion denoising process as gradient guidance, enabling consistent texture transfer across views. The fine-tuned prompt improves style coherence in unseen views while preserving details in the reference view. We evaluate our method on the face-forwarding [ 38 ] and 360-degree [ 3 ] datasets. Results show effective texture transfer with fine detail preservation and strong view consistency. Our key contributions: • 3DOT , an image-based 3D Guassian Splatting (3DGS) texture transfer framework that enables efficient and flexible texture editing. • A progressive generation process with view-consistency gradient guidance to address view inconsistency across novel views. • Prompt-tuning-based gradient guidance preserves texture characteristics in seen views and enforces style consistency in unseen views. • Extensive experiments demonstrate that 3DOT achieves state-of-the-art visual quality and quantitative performance. 2 Related Work 2D Diffusion-based Editing DragDiffusion [ 32 ] defines target edits using keypoints and replaces them with reference images. A-Tale-of-Two-Features [ 46 ] combines dense DINO [ 7 ] features and sparse diffusion features by merging reference-view semantics with target-view structures. Plug-and-Play [ 36 ] refines fine-grained details by injecting diffusion features into DINO features, while DiffEditor [ 25 ] improves 2D editing precision via differential equation-based sampling with regional gradient guidance. The most relevant work, SwapAnything [ 14 ] , leverages DreamBooth [ 30 ] and AdaIN [ 19 ] to encode source images and maintain style consistency during 2D edits. Although effective for image editing, these methods operate on individual views without enforcing view consistency, highlighting the need for 3D-aware texture editing techniques. 3D Editing Most 3D editing methods leverage 2D diffusion models for guidance and adopt dataset-updating strategies to finetune pretrained 3D scenes. Instruct-NeRF2NeRF [ 15 ] and Instruct-GS2GS [ 37 ] use instruct-pix2pix [ 4 ] to guide updates for NeRF or Gaussian Splatting. GaussianEditor [ 9 ] introduces hierarchical representations for more stable edits under stochastic guidance. Direct Gaussian Editor (DGE) [ 8 ] addresses view consistency via epipolar cross-attention, but its initial independent generation introduces artifacts. GaussCtrl [ 41 ] injects features from unedited views to preserve consistency, but