3DreamBooth: High-Fidelity 3D Subject-Driven Video Generation Model

Hyun-kyu Ko ∗, Jihyeon Park ∗, Younghyun Kim, Dongheok Park, Eunbyung Park † · 2026

Read 3DreamBooth: High-Fidelity 3D Subject-Driven Video Generation Model by Hyun-kyu Ko ∗, Jihyeon Park ∗, Younghyun Kim, Dongheok Park, Eunbyung Park † (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-18524.txt.

Introduction

Ko and co-authors introduce 3DreamBooth for high-fidelity 3D subject-driven video generation. Past subject methods treat subjects as 2D, copying identity from single views or text. Novel views then invent details for unseen regions instead of keeping true 3D identity. Their one-frame optimization bakes a 3D prior into spatial features without heavy video training. A 3Dapter module adds fine texture and routes view-specific hints from a small reference set.

Catalog record

CREATORHyun-kyu Ko ∗, Jihyeon Park ∗, Younghyun Kim, Dongheok Park, Eunbyung Park †
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60092
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.18524

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

3DreamBooth: High-Fidelity 3D Subject-Driven Video Generation Model Hyun-kyu Ko ∗, Jihyeon Park ∗, Younghyun Kim, Dongheok Park, Eunbyung Park † Abstract Creating dynamic, view-consistent videos of customized subjects is highly sought after for a wide range of emerging applications, including immersive VR/AR, virtual production, and next-generation e-commerce. However, despite rapid progress in subject-driven video generation, existing methods predominantly treat subjects as 2D entities, focusing on transferring identity through single-view visual features or textual prompts. Because real-world subjects are inherently 3D, applying these 2D-centric approaches to 3D object customization reveals a fundamental limitation: they lack the comprehensive spatial priors necessary to reconstruct the 3D geometry. Consequently, when synthesizing novel views, they must rely on generating plausible but arbitrary details for unseen regions, rather than preserving the true 3D identity. Achieving genuine 3D-aware customization remains challenging due to the scarcity of multi-view video datasets. While one might attempt to fine-tune models on limited video sequences, this often leads to temporal overfitting. To resolve these issues, we introduce a novel framework for 3D-aware video customization, comprising 3DreamBooth and 3Dapter . 3DreamBooth decouples spatial geometry from temporal motion through a 1-frame optimization paradigm. By restricting updates to spatial representations, it effectively bakes a robust 3D prior into the model without the need for exhaustive video-based training. To enhance fine-grained textures and accelerate convergence, we incorporate 3Dapter , a visual conditioning module. Following single-view pre-training, 3Dapter undergoes multi-view joint optimization with the main generation branch via an asymmetrical conditioning strategy. This design allows the module to act as a dynamic selective router, querying view-specific geometric hints from a minimal reference set. Our framework achieves high-fidelity, 3D-conditioned video generation while maintaining computational efficiency, as demonstrated through quantitative and qualitative evaluations. † † footnotetext: ∗ Equal contribution † † footnotetext: † Corresponding author Figure 1 : 3D-aware video customization using our proposed framework. Given a few multi-view reference images (left) and a text prompt, our approach generates high-fidelity, view-consistent videos that seamlessly integrate customized 3D subjects into dynamic environments. 1 Introduction Imagine a product designer who wants to showcase a newly designed sneaker in a dynamic advertisement video, where the shoe rotates, walks on various terrains, and appears under different lighting conditions. Capturing such footage traditionally requires repeated, costly filming sessions across different environments. Ideally, one would simply capture the subject once and let a generative system handle the rest, placing it convincingly into any scene, from any viewpoint, and in any motion context. Or consider a game developer who needs to animate a custom character across dozens of diverse scenes while maintaining strict visual consistency. Such applications demand a generative system that not only understands what a subject looks like, but also grasps its underlying 3D structure well enough to render it faithfully across unseen viewpoints and novel scenarios. To realize such demanding applications, the generative AI community has actively explored subject-driven customization. While various structural conditioning frameworks [ 33 , 50 , 26 ] have been developed to control diffusion models [ 30 ] , subject-driven customization has emerged as a particularly pivotal branch. Early optimization-based approaches pioneered this field by binding a specific subject’s identity to a unique identifier [ 9 , 31 , 20 ] . However, these text-driven methods often struggle to capture high-frequency details due to the inherent information bottleneck of text embeddings. To address this, visual adapters were introduced to directly inject reference images into the diffusion process, which has become a widely adopted approach for preserving intricate structural and identity details in 2D generation [ 47 , 22 ] . Naturally, this customization paradigm has extended to customized Text-to-Video (T2V) generation, driven by the success of foundational video frameworks [ 5 , 10 ] . Recent studies have attempted to personalize video models for specific subjects or motions [ 45 , 17 , 43 ] . However, existing video customization methods predominantly rely on single-image references [ 7 , 52 ] or purely textual prompts [ 13 , 44 ] . Consequently, the generated subjects are inevitably bound to a rigid, 2D appearance and often fail to render consistently across drastically different and unseen viewpoints. This limitation reveals a lack of genuine understanding regarding the subject’s underlying 3D geometry. While 3D-aware spatial generation has been actively explored in the image domain [ 25 , 34 ] , the explicit injection of multi-view images of a 3D subject directly into video diffusion models to achieve robust 3D-consistent customization remains a largely unexplored frontier. In this work, we present a novel framework for 3D-aware customized video generation, unifying optimization-based personalization and adapter-based conditioning. We first introduce 3DreamBooth , which fine-tunes the generative backbone via LoRA [ 12 ] to internalize a subject’s 3D identity. Naïvely training on full video sequences often entangles spatial identity with temporal dynamics, causing the network to overfit to specific motion patterns. To avoid this, 3DreamBooth adopts a 1-frame training paradigm [ 44 , 13 ] . By restricting inputs to single frames, temporal attention pathways are naturally bypassed, confining learning to spatial attributes while preserving the model’s pre-trained motion priors. While 3DreamBooth successfully implants the 3D identity, relying solely on a single identifier V often leads to inefficient optimization and the loss of fine-grained textures. To address this, we introduce 3Dapter , a multi-view conditioning module integrated via a dual-branch architecture [ 51 , 37 ] . By utilizing LoRA, 3Dapter injects multi-view spatial features while preserving foundational weights. Following single-view pre-training for robust feature extraction [ 37 ] , 3DreamBooth and 3Dapter are jointly fine-tuned on multi-view images. During this phase, the main branch reconstructs a target view while 3Dapter provides conditioning from a minimal set of reference views. This synergy enables highly detailed, 3D-conditioned generation while maintaining significant computational efficiency. In summary, our main contributions are as follows: • We address the problem of 3D-aware video customization by introducing a multi-view conditioning framework that mitigates the entanglement of spatial identity and temporal dynamics in video diffusion models. • We propose 3DreamBooth , a 1-frame optimization strategy that integrates subject-specific 3D identity into the model without requiring multi-view video datasets, effectively leveraging the inherent 3D awareness of modern video models. • We introduce 3Dapter , a multi-view conditioning module trained through a two-stage pipeline, enabling efficient convergence and precise 3D-conditioned video generation. • We introduce 3D-CustomBench , a curated evaluation suite for 3D-consistent video customization. Through extensive experiments, we demonstrate that our framework outperforms existing single-reference baselines and ablation variants in generating 3D-aware and identity-preserving videos. 2 Related Works 2.1 3D-Conditioned Image and Video Generation While single-view image conditioned diffusion models [ 50 , 47 , 37 ] have demonstrated remarkable success, conditioning diffusion models on 3D assets or multi-view images remains largely unexplored. Recently, RefAny3D [ 14 ] fine-tuned FLUX [ 21 ] on a curated, pose-aligned object dataset to achieve 3D-asset conditioned image generation. Although promising, extending this approach to video generation remains challenging, as acquiring large-scale pose-aligned object-video pair datasets is non-trivial. Concurrently, MV-S2V [ 35 ] introduced a multi-view conditioned text-to-video framework. Unlike our proposed 3DreamBooth , MV-S2V trains the video diffusion model on large-scale synthetic video datasets with multi-view object references, resulting in significant computational costs. 2.2 Subject-Driven Customization Subject-driven

Read the complete text