TeGA: Texture Space Gaussian Avatars for High-Resolution Dynamic Head Modeling

Gengyan Li, Paulo Gotardo, Timo Bolkart, Stephan Garbin, Kripasindhu Sarkar, Abhimitra Meka, Alexandros Lattas, Thabo Beeler · 2025

Read TeGA: Texture Space Gaussian Avatars for High-Resolution Dynamic Head Modeling by Gengyan Li, Paulo Gotardo, Timo Bolkart, Stephan Garbin, Kripasindhu Sarkar, Abhimitra Meka, Alexandros Lattas, Thabo Beeler (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-05672.txt.

Introduction

Gengyan Li and co-authors build photoreal digital heads that move without losing detail in a 2025 paper. Gaussian-based avatars render beautifully from any angle, but animation usually blurs them because facial motion is hard to estimate, and memory caps keep the element count low. Their model anchors the head on a morphable mesh that handles coarse motion.

Fine appearance lives in Gaussian elements placed in the mesh's texture space, where they can be packed densely where detail matters. A new deformation field warps them to catch subtle, local movement. The result renders at 4K with far more elements than prior avatars. Reconstructed from multiview video, the heads target telepresence and entertainment, where viewers notice every lost wrinkle.

Catalog record

CREATORGengyan Li, Paulo Gotardo, Timo Bolkart, Stephan Garbin, Kripasindhu Sarkar, Abhimitra Meka, Alexandros Lattas, Thabo Beeler
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-05672

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TeGA: Texture Space Gaussian Avatars for High-Resolution Dynamic Head Modeling Gengyan Li, Paulo Gotardo, Timo Bolkart, Stephan Garbin, Kripasindhu Sarkar, Abhimitra Meka, Alexandros Lattas, Thabo Beeler Abstract . Sparse volumetric reconstruction and rendering via 3D Gaussian splatting have recently enabled animatable 3D head avatars that are rendered under arbitrary viewpoints with impressive photorealism. Today, such photoreal avatars are seen as a key component in emerging applications in telepresence, extended reality, and entertainment. Building a photoreal avatar requires estimating the complex non-rigid motion of different facial components as seen in input video images; due to inaccurate motion estimation, animatable models typically present a loss of fidelity and detail when compared to their non-animatable counterparts, built from an individual facial expression. Also, recent state-of-the-art models are often affected by memory limitations that reduce the number of 3D Gaussians used for modeling, leading to lower detail and quality. To address these problems, we present a new high-detail 3D head avatar model that improves upon the state of the art, largely increasing the number of 3D Gaussians and modeling quality for rendering at 4K resolution. Our high-quality model is reconstructed from multiview input video and builds on top of a mesh-based 3D morphable model, which provides a coarse deformation layer for the head. Photoreal appearance is modelled by 3D Gaussians embedded within the continuous UVD tangent space of this mesh, allowing for more effective densification where most needed. Additionally, these Gaussians are warped by a novel UVD deformation field to capture subtle, localized motion. Our key contribution is the novel deformable Gaussian encoding and overall fitting procedure that allows our head model to preserve appearance detail, while capturing facial motion and other transient high-frequency features such as skin wrinkling. 858 Journal: TOG Conference: Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers ; August 10–14, 2025; Vancouver, BC, Canada Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers (SIGGRAPH Conference Papers ’25), August 10–14, 2025, Vancouver, BC, Canada DOI: 10.1145/3721238.3730710 ISBN: 979-8-4007-1540-2/2025/08 CCS: Computing methodologies Point-based models CCS: Computing methodologies Animation CCS: Computing methodologies Rendering CCS: Computing methodologies Rasterization CCS: Computing methodologies Volumetric models Figure 1. We propose a novel method that builds photorealistic 3D head avatars for rendering at high resolution with controllable expressions and viewpoints. Given a deformable 3D mesh model, our method effective learns a sparse, expression-dependent volumetric texture for rendering via 3D Gaussian splatting. It effectively leverages densification where most needed, estimating up to 4 million 3D Gaussians within the continuous UVD tangent space of the mesh. In this figure, we show multiple high fidelity novel face expression reconstructions. This is the teaser figure for the article. † † cc-license: by 1. Introduction The photorealistic modeling of human faces has enjoyed widespread attention in graphics and computer vision communities, and its applications have been impactful in numerous industries, including telecommunications, media, gaming and medicine to name a few. Telepresence, once science fiction, appears closer and closer, as hardware and algorithms are making great strides. In the pursuit to bridge the uncanny valley, numerous recent works have achieved pleasing high-resolution human animation. However, when considering very high resolution rendering as a requirement, for example, in visual effects in contemporary movies, many challenges arise in the accurate reconstruction of details, which are paramount to achieve true likeness for a digital human. A seminal step towards head modeling was the introduction of 3D Morphable Models (3DMM) ( Blanz and Vetter, 1999 ) , which are still used over twenty years later. Controllable illumination capturing rigs ( Debevec, 2012 ) enabled the acquisition of high-quality and relightable facial appearance, though generation and manipulation has remained a challenge. With the introduction of Generative Adversarial Networks (GAN) ( Goodfellow et al., 2014 ) , and especially StyleGAN ( Karras et al., 2020 ) , the research community witnessed a big leap towards high-quality facial appearance modeling in camera-space ( Nagano et al., 2018 ) , UV-space ( Gecer et al., 2019 ) , or in 3D ( Chan et al., 2022 ) . In addition, Latent Diffusion Models ( Rombach et al., 2022 ) significantly improved such workstreams. At representation level, Neural Radiance Fields (NeRFs) ( Mildenhall et al., 2020 ) revolutionized the space, providing a flexible medium for holistic human reconstruction and animation ( Park et al., 2021 ; Zielonka et al., 2022 ; Hong et al., 2022 ; Sarkar et al., 2023 ) , but were restricted by slow speeds and their difficulty to be manipulated. 3D Gaussian Splatting (3DGS) ( Kerbl et al., 2023 ) recently filled these gaps, with an explicit representation with orders of magnitude faster optimization and unprecedented visual quality. Multiple works have since explored with increasing success the space of high-quality 3DGS head modeling, following mostly two different paradigms: a) 3DMM-attached Gaussians (e.g. ( Qian et al., 2024 ; Giebenhain et al., 2024 ) ), and b) CNN-based generated Gaussians (e.g. ( Saito et al., 2024b ; Teotia et al., 2024 ) ). Both approaches still underperform in producing sharp and detailed images when closely inspected. As such, an adequate exploration into the domain of very high resolution rendering is still needed. On one hand, 3DMM-based approaches are limited by the underlying linear model, or require the addition of expensive dense MLPs that learn to deform the Gaussians, and typically remain underconstrained and underperform in challenging cases. On the other hand, CNN-based methods generate a set number of Gaussians on a UV map of limited resolution, and cannot also adaptively allocate details, e.g. , for facial hair. As we show in our extensive experiments, both cases perform poorly when attempting to capture fine facial details in high resolution. Our work proposes a new hybrid approach for rendering digital head avatars at very high resolution (4K). To capture and animate fine facial details, our method effectively combines a 3DMM mesh, adaptive 3D Gaussian densification, and an expression-dependent deformation model that is agnostic to the number of 3D Gaussians. We achieve high-detail, 4K renderings without requiring super-resolution networks that operate on the camera image plane. Even though this is claimed by works similar to ours ( Qian et al., 2024 ; Saito et al., 2024b ) , our extensive qualitative and quantitative experiments showcase the importance of our improvements, especially around the faithful depiction of facial details. In summary: (1) We propose a simple approach for rigging 3D Gaussians within the continuous tangent space of 3DMM face models, allowing Gaussians to move freely across mesh triangles. (2) We propose a novel CNN-based deformation model that is agnostic to the number of 3D Gaussians, naturally enabling adaptively densification of the representation to improve detail where most needed, with expression-dependent shading. (3) We show significant improvements over baseline SOTA methods, and demonstrate the ability to render even extreme closeup images at high quality. 2. Related Work 2.1. Head Modeling Head modeling has been a very active field of research, arguably materialising with the seminal 3D Morphable Models work ( Blanz and Vetter, 1999 ; Egger et al., 2020 ) , a PCA-based model of 3D face shape and appearance. Numerous works have followed, extending the quality and generalization of 3DMMs ( Paysan et al., 2009 ; Booth

Read the complete text