SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentation

Yonwoo Choi · 2025

Read SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentation by Yonwoo Choi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-05475.txt.

Introduction

Yonwoo Choi builds a way to turn one photo of a person into a moving three dimensional avatar, in work from twenty twenty-five. A single view hides most of the body, so full shape is hard to rebuild. Older tools need many views or a video, while video models can fake motion but lose the person's look.

The method first makes fake training video with a video model, then cleans it to keep face and form true. That data trains an avatar built from small three dimensional blobs that render fast. Tests beat prior single image tools on likeness and fine detail across new poses. The avatar can also play back in real time.

Catalog record

CREATORYonwoo Choi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-05475

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentation Yonwoo Choi Abstract Creating high-quality animatable 3D human avatars from a single image remains a significant challenge in computer vision due to the inherent difficulty of reconstructing complete 3D information from a single viewpoint. Current approaches face a clear limitation: 3D Gaussian Splatting (3DGS) methods produce high-quality results but require multiple views or video sequences, while video diffusion models can generate animations from single images but struggle with consistency and identity preservation. We present SVAD, a novel approach that addresses these limitations by leveraging complementary strengths of existing techniques. Our method generates synthetic training data through video diffusion, enhances it with identity preservation and image restoration modules, and utilizes this refined data to train 3DGS avatars. Comprehensive evaluations demonstrate that SVAD outperforms state-of-the-art (SOTA) single-image methods in maintaining identity consistency and fine details across novel poses and viewpoints, while enabling real-time rendering capabilities. Through our data augmentation pipeline, we overcome the dependency on dense monocular or multi-view training data typically required by traditional 3DGS approaches. Extensive quantitative, qualitative comparisons show our method achieves superior performance across multiple metrics against baseline models. By effectively combining the generative power of diffusion models with both the high-quality results and rendering efficiency of 3DGS, our work establishes a new approach for high-fidelity avatar generation from a single image input. Figure 1 : SVAD. Our method creates high-fidelity 3D avatars from a single image through synthetic data generation. We leverage video diffusion to generate pose-conditioned animations, enhance them with identity preservation and image restoration modules, then train a 3D Gaussian Splatting avatar. The resulting avatars maintain consistent identity across novel poses and viewpoints while enabling real-time rendering, outperforming state-of-the-art approaches. 1 Introduction The ability to generate animatable 3D human avatars from minimal input data, such as a single-image, has significant potential across a range of applications. Traditional methods, particularly those based on 3DGS, have demonstrated considerable success in producing high-quality avatars [ 34 , 68 , 86 , 77 , 69 , 93 , 87 , 110 , 14 , 121 ] . These methods rely on dense input data, typically monocular or multi-view video [ 68 , 34 , 77 , 86 , 93 , 14 , 121 ] , to achieve high fidelity across varied viewpoints and poses. This reliance on extensive video input complicates deployment in single-image scenarios, where ensuring viewpoint consistency and adaptability to novel poses becomes a key challenge. Recent advancements in video diffusion models offer a potential solution by enabling animation generation from a single static image [ 122 , 33 , 104 , 97 , 49 ] . These models use certain conditions in diffusion processes to create video sequences, demonstrating the powerful generative capabilities of diffusion for single-image-driven animation. However, diffusion models often struggle to maintain temporal coherence, leading to inconsistent features and identity drift across frames [ 90 , 31 , 5 , 19 ] . Additionally, their iterative denoising process for each frame introduces significant computational overhead, limiting their feasibility for real-time or interactive applications where rapid rendering across novel views is essential. To overcome these challenges, we propose SVAD, a novel synthetic data generation and avatar creation pipeline that synergizes the generative flexibility of diffusion models with the efficient rendering capabilities of 3DGS avatars. Our approach leverages video diffusion model [ 94 ] to generate diverse pose-conditioned synthetic training data from a single-image. This synthetic data is refined through an identity-preservation module and an image restoration module to ensure that perceptual identity consistency and structural fidelity are preserved across diverse poses and temporal sequences. The resulting high-quality synthetic dataset is then used to train a 3DGS avatar model [ 68 ] , which benefits from the rapid rendering capabilities inherent to 3DGS. By combining the generative strengths of diffusion for synthetic data creation with the efficiency of 3DGS for rendering, SVAD achieves consistent, high-quality 3D avatar animations from single-image input. In summary, our main contributions are: • We introduce a novel pipeline that generates high-quality synthetic training data from a single-image to create detailed, animatable 3D human avatars. • We develop a comprehensive data augmentation approach that combines identity preservation and image restoration to ensure consistent identity and fine details across diverse poses. • We demonstrate through extensive experiments that our synthetic data-driven approach significantly outperforms SOTA single-image avatar generation methods in identity preservation and novel pose adaptation while maintaining efficient real-time rendering. 2 Related Work Diffusion Model for Human Image Animation The use of diffusion models has led to significant advancements in human image animation, enabling the generation of realistic and temporally consistent animations from static images [ 117 , 1 , 6 , 9 , 22 , 35 , 41 , 75 , 79 , 84 , 88 , 89 , 107 , 109 , 114 ] . Early methods, such as PIDM [ 4 ] and DreamPose [ 47 ] , focused on improving texture fidelity by employing texture diffusion modules to align texture patterns between reference and target images. These methods, while enhancing detail preservation, still face challenges in maintaining temporal stability across frames. Recent works, including DisCo [ 97 ] and Animate Anyone [ 33 ] , have extended diffusion models to improve temporal consistency and fine-grained control in human animation tasks. DisCo leverages dual ControlNets [ 113 ] to separately control pose and background elements, providing more robust conditioning for complex motion sequences. Similarly, Animate Anyone integrates a ReferenceNet with temporal attention layers to ensure appearance consistency and smooth transitions across frames, thereby addressing flickering issues commonly observed in earlier models. Dynamic 3D Gaussian based Avatars The concept of Gaussian splatting for 3D avatars has emerged recently as an innovative approach to explicit scene representation [ 48 ] . This technique models a scene as a collection of 3D Gaussian elements, each containing photometric and geometric properties. During rendering, these Gaussian splats are projected onto the image plane, creating the final rendered output. The efficiency of 3DGS has been demonstrated in both static [ 37 , 44 , 57 ] and dynamic [ 20 , 46 , 55 , 66 , 58 ] scenes, making it a versatile tool for various applications. Recent advancements [ 13 , 18 , 36 , 39 , 59 , 76 , 77 , 96 , 123 , 7 , 8 ] have explored the use of 3DGS to create photorealistic human avatars across different scenarios. These methods commonly rely on multi-view data [ 61 , 72 , 119 ] or monocular video [ 34 , 39 , 68 , 59 , 77 ] as input to achieve high-quality, consistent results. The advantage of 3DGS lies in its ability to produce temporally stable animated avatars with superior quantitative metrics. 3 Method Figure 2 : Overall Pipeline of SVAD. Starting from a single input image, the diffusion model generates pose-conditioned animations, which are refined using an identity preservation module and an image restoration module. The refined outputs are then used to train the 3DGS avatar, enabling high-fidelity, animatable 3D avatars with consistent details across poses and viewpoints. Figure 3 : 3D Avatars trained by SVAD. SVAD generates

Read the complete text