3D Stylization via Large Reconstruction Model Conference: Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers ; August 10–14, 2025; Vancouver, BC, Canada Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Paper

Ipek Oztas, Duygu Ceylan, Aysegul Dundar · 2025

Read 3D Stylization via Large Reconstruction Model Conference: Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers ; August 10–14, 2025; Vancouver, BC, Canada Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Paper by Ipek Oztas, Duygu Ceylan, Aysegul Dundar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-21836.txt.

Introduction

Ipek Oztas, Duygu Ceylan, and Aysegul Dundar present a training-free method to restyle 3D objects after a reference image, in a 2025 paper. Users of 3D generators increasingly want style control, not just shape. The styled result must look consistent from every angle. Two-dimensional stylizers offer a clue: attention blocks inside big image models carry style.

The team probed large reconstruction models used for 3D generation. Certain attention blocks there also captured appearance features. By injecting features from a style image into those blocks, they transferred the look onto a 3D asset. No training or per-asset tuning was needed. The trick reuses what generative models already know about appearance.

Catalog record

CREATORIpek Oztas, Duygu Ceylan, Aysegul Dundar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-21836

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

3D Stylization via Large Reconstruction Model Conference: Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers ; August 10–14, 2025; Vancouver, BC, Canada Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers (SIGGRAPH Conference Papers ’25), August 10–14, 2025, Vancouver, BC, Canada DOI: 10.1145/3721238.3730636 ISBN: 979-8-4007-1540-2/2025/08 CCS: Computing methodologies Shape modeling Ipek Oztas, Duygu Ceylan, Aysegul Dundar Abstract . With the growing success of text or image guided 3D generators, users demand more control over the generation process, appearance stylization being one of them. Given a reference image, this requires adapting the appearance of a generated 3D asset to reflect the visual style of the reference while maintaining visual consistency from multiple viewpoints. To tackle this problem, we draw inspiration from the success of 2D stylization methods that leverage the attention mechanisms in large image generation models to capture and transfer visual style. In particular, we probe if large reconstruction models, commonly used in the context of 3D generation, has a similar capability. We discover that the certain attention blocks in these models capture the appearance specific features. By injecting features from a visual style image to such blocks, we develop a simple yet effective 3D appearance stylization method. Our method does not require training or test time optimization. Through both quantitative and qualitative evaluations, we demonstrate that our approach achieves superior results in terms of 3D appearance stylization, significantly improving efficiency while maintaining high-quality visual outcomes. Code and models are available via our project website: https://github.com/ipekoztas/3D-Stylization-LRM . Figure 1. Given a 3D neural radiance field reconstructed by a large reconstruction model (top row), our approach enables the visual stylization based on a target style image (left column). Our method does not require any fine-tuning or test-time optimization. † † cc-license: by 1. Introduction In recent years, there has been notable success in 3D generation methods that can create 3D objects from as little input as possible, such as a text prompt or a single image ( Hong et al. 2023 ; Zhang et al. 2024 ; Li et al. 2023 ; Liu et al. 2024a ; Liu et al. 2023a ; Wei et al. 2024 ; Xu et al. 2024a ) . With such powerful generators in place, users demand more control over the generation process, such as stylizing the appearance of generated 3D content. Stylizing 3D objects traditionally requires a unique blend of creativity and technical skill, especially when adapting a specific visual style to a three-dimensional form. For example, taking a reference image, such as one painted by Monet, and applying that distinctive style to a 3D generated object introduces several challenges. Unlike in 2D, where the artist can directly control the application of color, texture, and brush strokes, 3D stylization must consider how appearance and texture details should evolve with the underlying surface details. This is necessary to preserve the visual essence of the reference while generating a coherent and aesthetically pleasing appearance from every viewing angle. In the context of 3D stylization, typically radiance fields ( Mildenhall et al. 2021 ) are explored. Given a set of multi-view images of a 3D object and a reference style image, a complex optimization has proven effective in rendering realistic 3D scenes and applying the desired visual style ( Zhang et al. 2022a ; Liu et al. 2023b ; Sun et al. 2024 ) . However, being a per-object optimization process, this is computationally expensive and time consuming. This hinders the adoption of such methods in conjunction with 3D generators where an interactive generation and stylization pipeline is desired. To tackle the aforementioned challenge, we are inspired by the progression of 2D stylization methods where deep learning made it possible to automate the stylization of images. More specifically, diffusion-based large image generators, such as Stable Diffusion ( Rombach et al. 2022 ) and DALL·E ( Ramesh et al. 2021 ) , not only offer high-quality image generation, but also complex style transfer capabilities. A key feature of these models is the use of attention mechanisms, which allow them to focus on the most relevant content and style features, enabling more nuanced and precise stylization ( Jeong et al. 2024 ; Hertz et al. 2024 ; Chung et al. 2024 ) . Inspired by the natural ability of image generators in the stylization task, we ask if a similar capability also emerges in the context of 3D generators where similar attention mechanisms are adapted in 3D reconstruction models. Our goal in this work is to enable appearance stylization in the context of 3D generation by exploiting the prior knowledge of large reconstruction models ( Hong et al. 2023 ; Li et al. 2023 ; Xu et al. 2024a ) that use a sparse set of multi-view input images to generate 3D models. Specifically, we investigate the architecture of these models and discover that the various attention mechanisms that capture the relation between the 3D form and input images implicitly model geometry and appearance specific features. By injecting features from a reference style image to the relevant attention modules, we show that it is possible to achieve high-quality 3D stylization without any training or per-asset optimization. We also show that the degree of stylization can be controlled by blending attention outputs with respect to original and style reference images. We evaluate our approach on a wide variety of 3D objects and style reference images and compare to several 2D and 3D stylization baselines. We show both quantitative and qualitative results that demonstrate our method achieves superior performance. The main contributions of this paper are as follows: • We introduce the use of large pre-trained reconstruction models for 3D stylization, providing a novel approach to transferring artistic styles to 3D objects. • Our method achieves 3D stylization without the need for training or test-time optimization. This makes our approach practical for interactive applications. • We provide a comprehensive evaluation with quantitative and qualitative results that demonstrate our method achieves superior 3D stylization performance compared to existing approaches. 2. Related Work 3D Reconstruction and Generation. 3D reconstruction of objects from images has long been a key research challenge. Early approaches focused on training encoder-decoder architectures to capture both shape and texture, often with networks trained for specific object categories, such as birds or cars ( Kanazawa et al. 2018 ; Chen et al. 2019 ; Goel et al. 2020 ; Li et al. 2020 ; Henderson et al. 2020 ; Bhattad et al. 2021 ; Dundar et al. 2023a ; Dundar et al. 2023b ) . Recently, large reconstruction models (LRMs) ( Hong et al. 2023 ) have been proposed, capable of reconstructing arbitrary objects in real-world settings. This is made possible by their scalable transformer-based architecture and training on vast datasets containing around 1 million objects. Such methods have been used to output 3D representations in the form of neural radiance fields (NeRF) ( Hong et al. 2023 ) , Gaussian splats ( Zhang et al. 2024 ) ( Tang et al. 2024 ) ( Xu et al. 2024b ) , and meshes ( Wei et al. 2024 ) . In a different area of research, pretrained text-based image generating diffusion models ( Rombach et

Read the complete text