Consistent Zero-shot 3D Texture Synthesis Using Geometry-aware Diffusion and Temporal Video Models

Donggoo Kang, Jangyeong Kim, Dasol Jeong, Junyoung Choi, Jeonga Wi, Hyunmin Lee, Joonho Gwon, Joonki Paik · 2025

Read Consistent Zero-shot 3D Texture Synthesis Using Geometry-aware Diffusion and Temporal Video Models by Donggoo Kang, Jangyeong Kim, Dasol Jeong, Junyoung Choi, Jeonga Wi, Hyunmin Lee, Joonho Gwon, Joonki Paik (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-20946.txt.

Introduction

Painting a texture onto a 3D model from separate viewpoints leaves seams and contradictions, because each view invents its own surface. Donggoo Kang and co-authors borrow the steadiness of video generators in a 2025 paper: sweep a virtual camera around the model and let the video model's memory hold the surface consistent. Cues from the model's shape guide the painting.

A spread-out strategy in the flat texture map fills hidden regions while keeping their meaning, smoothing the seams where views wrap around. Tests beat earlier methods on fidelity, seam blending, and stability across frames. The authors aim at live applications that need textures both pretty and steady.

Catalog record

CREATORDonggoo Kang, Jangyeong Kim, Dasol Jeong, Junyoung Choi, Jeonga Wi, Hyunmin Lee, Joonho Gwon, Joonki Paik
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-20946

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Consistent Zero-shot 3D Texture Synthesis Using Geometry-aware Diffusion and Temporal Video Models Donggoo Kang, Jangyeong Kim, Dasol Jeong, Junyoung Choi, Jeonga Wi, Hyunmin Lee, Joonho Gwon, Joonki Paik Abstract Current texture synthesis methods, which generate textures from fixed viewpoints, suffer from inconsistencies due to the lack of global context and geometric understanding. Meanwhile, recent advancements in video generation models have demonstrated remarkable success in achieving temporally consistent videos. In this paper, we introduce VideoTex, a novel framework for seamless texture synthesis that leverages video generation models to address both spatial and temporal inconsistencies in 3D textures. Our approach incorporates geometry-aware conditions, enabling precise utilization of 3D mesh structures. Additionally, we propose a structure-wise UV diffusion strategy, which enhances the generation of occluded areas by preserving semantic information, resulting in smoother and more coherent textures. VideoTex not only achieves smoother transitions across UV boundaries but also ensures high-quality, temporally stable textures across video frames. Extensive experiments demonstrate that VideoTex outperforms existing methods in texture fidelity, seam blending, and stability, paving the way for dynamic real-time applications that demand both visual quality and temporal coherence. Figure 1 : This paper presents VideoTex , a seamless texture synthesis approach that utilizes the temporal consistency of a video generation model. We also propose a component-based UV diffusion model to achieve semantic-aware UV diffusion. 1 Introduction Generating high-quality textures for 3D models is a core challenge in computer graphics and computer vision, with direct implications for visual realism in applications like video games, virtual reality, and animated films. Textures are key to realistic perception, providing intricate surface details that enrich users’ visual experience. However, achieving seamless textures across complex geometries while maintaining visual coherence from diverse viewpoints is particularly difficult. This challenge intensifies in dynamic models or environments where varying viewing angles can lead to visible artifacts, inconsistencies, and Janus problems. Figure 2 : Limitations of existing texture synthesis methods: (a) lack of contextual awareness, (b) misalignment and lack of geometric consistency, and (c) the Janus problem. Preceding texture synthesis methods [ 20 , 19 , 4 , 3 , 26 , 24 , 17 , 1 , 29 , 16 ] often suffer from limitations such as (a) lack of contextual awareness, (b) misalignment and lack of geometric consistency, and (c) the Janus problem. These issues stem from a reliance on fixed viewpoints, which constrains their ability to capture the global 3D context of models. As illustrated in Figure 2 , these limitations frequently lead to spatial inconsistencies, including visible seams and distortions, especially at the boundaries where UV maps are stitched. Such artifacts become more pronounced when models are viewed from diverse angles or applied in dynamic, real-time applications. Additionally, occluded or hidden regions of the model often lack sufficient texture information, resulting in incomplete or distorted results that reduce the overall visual fidelity. Recent advancements in video generation models [ 27 , 14 , 30 , 2 , 25 , 11 , 10 , 6 , 5 , 9 , 13 , 21 , 15 ] , which excel at capturing temporal dependencies between frames, provide a promising solution. These models have demonstrated the ability to ensure smooth transitions and consistent content across frames, making them highly effective for tasks that demand temporal stability. This inspires a novel approach of framing texture synthesis as a video generation problem, where each frame represents a different viewpoint or time step. To address the dual challenges of spatial and temporal inconsistencies in texture synthesis, we propose a method that leverages video generation models for texture synthesis. Our proposed method leverages the strengths of video generation models to address the temporal and spatial coherence challenges inherent in 3D texture synthesis. By conceptualizing texture synthesis as a video generation task, we map each component’s texture generation process to a series of frames, where each frame represents a discrete viewpoint or temporal step across the surface of the 3D model. Furthermore, a core challenge in 3D asset creation lies within the UV mapping domain , a critical process for converting 3D surfaces to 2D space for seamless texture application. However, UV mapping presents several challenges: (1) flattening intricate 3D shapes onto a 2D plane can introduce distortions and seams; (2) it causes a loss of spatial coherence , disrupting continuity in image processing; and (3) both artist-generated and automated UV maps struggle with these issues, making precise texture application difficult. Despite prior research, robust texture handling in the UV domain remains an open problem. To address this, we observed that most 3D assets are built from reusable components. This insight forms the basis for a component-based approach in the UV domain, providing solutions for occlusion and ensuring seamless texture synthesis across complex geometries. We propose a texture synthesis approach that operates in the UV domain by leveraging the component structure of 3D assets. Unlike traditional methods that generate a unified texture, our approach decomposes models into individual components, mapping each separately in UV space. This enables finer control over texture coherence and enhances the quality of synthesized textures. Our main contributions are as follows: • We introduce VideoTex , a novel texture synthesis framework that formulates texture generation as a video generation problem, ensuring high temporal and spatial consistency. • We employ geometry-aware conditional generation by leveraging 3D structure information, such as normal, depth, and edge maps, to align textures with complex geometries. • We propose a component-wise UV diffusion strategy that enhances texture quality across UV seams and occluded regions, maintaining fine details and semantic coherence. • Our method outperforms existing approaches in terms of texture fidelity, seam blending, and stability, paving the way for real-time applications that demand both high visual quality and dynamic adaptability. 2 Related Work 2.1 3D Texture Synthesis Recent advancements in texture synthesis for 3D meshes integrate diffusion models with text-based guidance. Despite improvements, most methods rely on fixed viewpoint inference, limiting spatial coherence across perspectives—crucial for realistic 3D applications. Text2Tex [ 4 ] employs a depth-aware diffusion model to generate textures from multiple fixed viewpoints, mitigating view inconsistencies through dynamic segmentation. However, independent viewpoint treatment leads to visible seams and artifacts from untrained angles. Similarly, TexFusion [ 3 ] uses a 3D-aware text-to-image model, but its fixed viewpoint approach causes texture misalignment on complex geometries. RoCoTex [ 17 ] enhances view consistency via symmetrical synthesis and regional prompts but struggles with seamless texture coherence across arbitrary viewpoints. Meta 3D TextureGen [ 1 ] improves efficiency by conditioning a text-to-image model on 3D semantics in 2D space, yet its reliance on fixed viewpoints limits robustness in dynamic environments. While these methods advance texture quality and consistency, their fixed viewpoint dependency restricts temporal stability. Our approach leverages video generation models to ensure seamless texture coherence across diverse perspectives. 2.2 Video Generation Model Recent advancements in diffusion models have positioned them at the forefront of generative frameworks for both image and video synthesis, due to their scalability and enhanced training stability [ 13 , 21 , 15 ] . However, video generation entails unique complexities that surpass those of static image synthesis, primarily due to the inherent temporal dynamics and continuity required across frames. Existing methods often address this challenge by either adapting pre-trained

Read the complete text