Multi-view Consistent 3D Gaussian Head Avatars ‘without’ Multi-view Generation

Aviral Chharia, Fernando De la Torre · 2026

Read Multi-view Consistent 3D Gaussian Head Avatars ‘without’ Multi-view Generation by Aviral Chharia, Fernando De la Torre (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25220.txt.

Introduction

Aviral Chharia and Fernando De la Torre learn 3D Gaussian head avatars from randomly sampled 2D images alone. They use no multi-view data, 3D supervision, or intermediate view synthesis. Their MVCHead model enforces multi-view consistency in the 3D representation while regressing Gaussians. A hierarchical state space block refines Gaussians from coarse to fine. An SE(3) multi-view critic judges whether self-renders come from one underlying configuration. The result leads on perceptual quality, texture, and geometric consistency, and the team releases FaceGS-10K.

Catalog record

CREATORAviral Chharia, Fernando De la Torre
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38961
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.25220

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Multi-view Consistent 3D Gaussian Head Avatars ‘without’ Multi-view Generation Aviral Chharia, Fernando De la Torre Abstract High-fidelity 3D Gaussian head avatar generation is critical for applications such as AR/VR, telepresence, and digital humans. Existing methods depend on multi-view datasets, 3D captures, or intermediate 2D view synthesis. In contrast, we learn both conditional and unconditional 3D head models from randomly sampled 2D images alone, without using multi-view data, 3D supervision, or intermediate view generation. We introduce MVCHead, a single-shot state space model that enforces multi-view consistency (MVC) directly in the 3D representation while regressing 3D Gaussians under these constraints. At its core, we propose a Hierarchical State Space (HiSS) block that progressively refines Gaussians from coarse to fine, while capturing long-range dependencies. Within each HiSS block, we modify Mamba’s standard unidirectional scan with the proposed Hierarchical Bi-directional State Scan (HiBiSS) that aligns recurrence with the axes along which multi-view inconsistencies are strongest. Finally, we design an SE(3) Multi-view Critic that judges whether a set of self-renders arises from a single underlying 3D configuration, rewarding cross-view pixel alignment without observing real multi-view pairs. MVCHead achieves state-of-the-art perceptual quality, surpasses prior methods in both texture and geometric consistency, and maintains comparable shape consistency. To demonstrate scalability, we release FaceGS-10K, the first large-scale dataset of ready-to-use 3D Gaussian head assets for training and evaluation of 3D head models. Project Page and code: https://humansensinglab.github.io/MVCHead/ Figure 1 : MVCHead achieves state-of-the-art for unconditional generation of high fidelity, multi-view consistent 3D Gaussian head avatars in “minimal resource setting”, without requiring intermediate views, or even 3D data. The generated Gaussian heads capture complex textures and fine facial micro-structure, including wrinkles, hair wisps, ear rims, lip contours, skin blemishes, eyes, and accessories. 1 Introduction High-fidelity 3D Gaussian head avatars have become central to AR/VR, telepresence, digital characters, and large-scale content creation in film and games 83 ; 75 ; 79 ; 55 ; 36 ; 2 ; 45 ; 53 . These applications demand vast numbers of realistic yet non-identifiable 3D head avatars that are consistent across views but correspond to no real individual–avoiding privacy concerns and enabling rapid content creation. Generating such assets in a minimal-resource setting (e.g., from 2D images alone) is practically important, especially for studios that cannot afford dense multi-view capture rigs or high-end 3D scanning. Moreover, multi-view diffusion pipelines that first synthesize intermediate views are computationally heavy and often require additional training data. Motivated by these constraints, we explore this ‘minimal-resource setting’. Recent work on 3D Gaussian head avatar generation falls into three broad categories that differ primarily in supervision, data requirements, and scalability (see Fig. 2 ). First , multi-view optimization-based methods 3 ; 61 ; 26 ; 70 ; 71 ; 10 ; 20 reconstruct a full 3D head from high-resolution studio-captured sequences with dense multi-view coverage. These pipelines, using datasets such as NeRSemble 44 or RenderMe-360 60 (with \sim 10^{4} frames per subject), achieve impressive photorealism and strong MVC (see Fig. 2 (a)). However, reliance on costly capture setups and heavy per-subject optimization limits scalability. A second class of methods 54 ; 69 ; 84 ; 18 ; 19 ; 78 ; 24 ; 32 ; 31 ; 51 encompasses multi-view diffusion approaches that start from a single image and first synthesize intermediate views, typically including side views of the subject via off-the-shelf image or video diffusion models (see Fig. 2 (b)). A separate reconstructor then lifts these images into a 3DGS representation 41 . While fidelity is high, MVC becomes tightly coupled to intermediate view quality: pixel-aligned cross-view losses are not optimized since there is no end-to-end differentiability, and identity drift persists: tiny per-view deviations (e.g., subtle shifts in hair, ear contours, or jawline shading) may not correspond to any consistent 3D explanation. Moreover, generating dense intermediate views per asset is computationally prohibitive at scale. A third line of works 43 ; 38 ; 6 ; 5 includes feed-forward 3D generators that directly produce 3D Gaussian head avatars in an end-to-end differentiable manner. These methods aim for unconditional generation of 3D Gaussian heads from a learned prior, enabling the creation of diverse, non-existent identities while avoiding per-subject optimization. GGHead 43 , GS-GAN 38 , and CGS-GAN 6 improve stability, yet enforcing MVC without explicit multi-view supervision remains open, particularly in minimal-resource settings when the model never observes real multi-view pairs. In this work, we tackle this highly challenging minimal-resource setting (see Fig. 2 (c)): achieving large-scale, real-time synthesis of multi-view consistent 3D Gaussian head avatars via a single-shot, end-to-end differentiable model that operates (i) without generating intermediate views and (ii) without relying on 3D ground truth . Figure 2 : Motivation. Paradigms for 3D Gaussian head avatar generation. (a) Requires expensive studio captures; (b) Synthesizes intermediate views before reconstruction; (c) Learns an unconditional 3D Gaussian head directly from 2D images w/o intermediate generation or even 3D data. To address this, we introduce MVCHead , a novel state space model tailored to this setting. To the best of our knowledge, MVCHead is the first to leverage state space modeling for 3D Gaussian head generation. It takes a latent code and produces a complete set of 3D Gaussians in a single forward pass. MVCHead consists of a series of Hierarchical State Space (HiSS) blocks that organize Gaussians in a hierarchy and guide finer levels through offsets anchored to coarser parent Gaussians. Within each HiSS block, we apply the proposed Hierarchical Bi-directional State Scan (HiBiSS), which enforces grid-aligned coherence to reconcile typical view-to-view drift. Finally, we propose an SE(3) Multi-view Critic that rewards cross-view pixel alignment, inducing multi-view consistency by design. Taken together, MVCHead combines architectural improvements with a learned consistency critic to generate 3D Gaussian head avatars of high visual quality and strong multi-view consistency (see Fig. 1 ). Our main contributions include: • We highlight the challenge of MVC and analyze how it can be induced by design, arguing that intermediate view generation is counterproductive for scalability. We propose an SE(3) Multi-view Critic that rewards cross-view pixel alignment without real multi-view pairs. • We introduce MVCHead , the first to leverage visual Mamba for 3D Gaussian head generation: a fast, single-shot state space model that directly predicts Gaussians and improves MVC in unconditional 3D head synthesis. • We modify Mamba’s traditional unidirectional scan into a Hierarchical Bi-directional State Scan (HiBiSS) that aligns recurrence with principal axes of multi-view drift. • MVCHead surpasses the state-of-the-art in perceptual quality and along all three MVC axes, achieving superior texture and geometric consistency while maintaining comparable shape consistency. • We release FaceGS-10K, a large-scale dataset of ready-to-use 3D Gaussian heads for large-scale training, benchmarking, and evaluation of 3D-aware head models. 2 Related Works 2.1 3D Gaussian Head Avatars Multi-view optimization-based methods. A large body of work 3 ; 61 ; 26 ; 70 ; 71 ; 10 ; 20 reconstructs detailed 3D heads by optimizing Gaussians against dense, high-resolution studio-captured multi-view video sequences such as RenderMe-360 60 and NeRSemble 44 , which largely guarantee MVC. GaussianAvatars 61 rigs Gaussians to FLAME 50 ; SplattingAvatar 63 leverages monocular video; GaussianHeadAvatars 74 and MonoGaussianAvatar 12 exploit multi-view data but from relatively sparse or monocular views. These set an upper bound on quality but offer low scalability due

Read the complete text