OMG-Avatar: One-shot Multi-LOD Gaussian Head Avatar
Jianqiang Ren, Lin Liu, Steven Hoi · 2026
Read OMG-Avatar: One-shot Multi-LOD Gaussian Head Avatar by Jianqiang Ren, Lin Liu, Steven Hoi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-01506.txt.
Introduction
Jianqiang Ren, Lin Liu, and Steven Hoi build a way to turn one photo into a moving 3D head in this 2026 work. Fast, detailed head avatars matter for games, film, meetings, and virtual worlds. A single model should also serve both weak and strong hardware without losing key detail.
Their method, OMG-Avatar, stores the head as Gaussian blobs at several levels of detail. A transformer reads broad face traits, while sampled points add local detail, joined with depth cues to keep overlaps sane. Head and shoulders are built apart, then merged, which fixes a weak spot of older face models. The build takes a fraction of a second, and tests beat prior tools on rebuild quality, acting control, and speed.
Catalog record
| CREATOR | Jianqiang Ren, Lin Liu, Steven Hoi |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45936 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.01506
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
OMG-Avatar: One-shot Multi-LOD Gaussian Head Avatar Jianqiang Ren, Lin Liu, Steven Hoi Abstract We propose OMG-Avatar , a novel O ne-shot method that leverages a M ulti-LOD (Level-of-Detail) G aussian representation for animatable 3D head reconstruction from a single image in 0.2s. Our method enables LOD head avatar modeling using a unified model that accommodates diverse hardware capabilities and inference speed requirements. To capture both global and local facial characteristics, we employ a transformer-based architecture for global feature extraction and projection-based sampling for local feature acquisition. These features are effectively fused under the guidance of a depth buffer, ensuring occlusion plausibility. We further introduce a coarse-to-fine learning paradigm to support Level-of-Detail functionality and enhance the perception of hierarchical details. To address the limitations of 3DMMs in modeling non-head regions such as the shoulders, we introduce a multi-region decomposition scheme in which the head and shoulders are predicted separately and then integrated through cross-region combination. Extensive experiments demonstrate that OMG-Avatar outperforms state-of-the-art methods in reconstruction quality, reenactment performance, and computational efficiency. 1 Introduction Reconstructing an animatable 3D head avatar from a single image is a crucial and rapidly evolving research area in computer vision and graphics. This technology has great potential for applications across various domains, including the game and video production industries, virtual meetings, and the emerging Metaverse. To facilitate the widespread adoption of this technology, several key features are essential: high-efficiency reconstruction and inference, rich facial details, and precise controllability over expressions and head poses. In recent years, numerous methods have been developed to tackle this task, which can be divided into 2D-based and 3D-based approaches. Early 2D-based methods Siarohin et al. 2019 ; Wang et al. 2021 ; Guo et al. 2024 predict deformation flows to warp the latent features of a source portrait and employ GANs (Generative Adversarial Networks) Goodfellow et al. 2014 to synthesize the reenacted output. With the rise of latent diffusion models Rombach et al. 2022 , recent approaches Tian et al. 2024 ; Jiang et al. 2024 ; Zhao et al. 2025 have adopted cross-attention mechanisms conditioned on driving signals, achieving superior image quality and better appearance preservation. However, both GAN-based and diffusion-based methods require substantial computational resources, limiting their applicability in real-time scenarios. Furthermore, due to the lack of 3D constraints, these approaches often struggle to maintain multi-view consistency under large pose or viewpoint variations. In the 3D avatar domain, NeRF and Gaussian Splatting have emerged as prominent approaches due to their high-quality representation and rendering capabilities. Compared to NeRF-based methods Bai et al. 2023a ; Gafni et al. 2021 ; Ki et al. 2024 ; Li et al. 2023a ; Ma et al. 2023 ; Park et al. 2021a ; Yu et al. 2023 ; Zheng et al. 2023 , 3D Gaussian Splatting has become the prevailing choice owing to its significantly fast rendering speed. Unlike approaches that require extensive per-individual optimization or multi-view inputs Xu et al. 2024b ; Wu et al. 2024 ; Tang et al. 2025 ; Zheng et al. 2025 ; Xiang et al. 2024 , recent methods such as Chu and Harada 2024 ; He et al. 2025 ; Kirschstein et al. 2025 ; Zhang et al. 2025 generate 3D avatars from a single image, significantly enhancing generalization capabilities. Despite these advancements, key challenges persist in efficiency, computational cost, and compatibility. For instance, GAGAvatar Chu and Harada 2024 primarily utilizes Gaussian points sampled from the dual-lifting planes of backgrounds, leading to redundancy and inefficiency. LAM He et al. 2025 employs subdivided vertices as queries in its cross-attention mechanism, and its computational complexity grows exponentially with the number of subdivision levels. Avat3r Kirschstein et al. 2025 relies on an additional 3D GAN for 3D lifting to enable single-image reconstruction, which introduces error accumulation. Moreover, they all fail to dynamically adjust computational complexity to accommodate diverse hardware capabilities and inference speed requirements. To address these challenges, we propose a novel one-shot method for generating multi-LOD 3D Gaussian head avatars using a unified model. Rather than directly performing 2D-to-3D feature mapping on high-resolution meshes, which is computationally expensive, our approach extracts both global and local features from low-resolution meshes and progressively refines them to high-resolution representations through subdivision operations during the training phase, which also enables dynamic multi-LOD rendering at runtime. By leveraging an effective occlusion-aware feature fusion mechanism, our model delivers superior reconstruction quality while significantly reducing computational cost and the number of Gaussians compared to existing methods. Additionally, to improve representation in non-head regions, we independently model the head and shoulder based on shared features, improving the completeness of the generated avatars. The main contributions are summarized as follows: • We present OMG-Avatar, a novel framework that reconstructs animatable Gaussian head avatars from a single image in just 0.2 seconds. It enables dynamic multi-level-of-detail (multi-LOD) rendering while achieving state-of-the-art reconstruction quality and real-time inference at 85 FPS using fewer Gaussians than prior methods. • We propose a coarse-to-fine learning strategy that progressively refines both transformer-based global features and projection-sampled local features through multi-level subdivisions, followed by an occlusion-aware feature fusion mechanism guided by the depth buffer. These components significantly enhance the fidelity and completeness of the generated avatars. • Comprehensive experiments on two large-scale datasets demonstrate that OMG-Avatar surpasses state-of-the-art methods in reconstruction accuracy, reenactment fidelity, and computational efficiency. 2 Related Work 2D Talking Head Generation. Early 2D approaches Zakharov et al. 2019 ; Burkov et al. 2020 ; Zhou et al. 2021 ; Wang et al. 2023 employ generative adversarial networks (GANs) Goodfellow et al. 2014 ; Isola et al. 2017 ; Karras et al. 2020 and incorporate driving expression features for controllable portrait synthesis. Subsequent methods Siarohin et al. 2019 ; Ren et al. 2021 ; Drobyshev et al. 2022 ; Hong et al. 2022 ; Zhang et al. 2023 ; Guo et al. 2024 adopt deformation-based frameworks, representing expressions and poses as warping fields to deform the source image. These methods usually struggle with large pose and expression variations due to a lack of 3D awareness. To address this, some Nef 1999 ; Paysan et al. 2009 ; Li et al. 2017 ; Gerig et al. 2018 integrate 3D Morphable Models (3DMMs) into 2D pipelines, but they still lack support for viewpoint control and free-viewpoint rendering. Recent diffusion-based approaches Cui et al. 2024 ; Tian et al. 2024 ; Xu et al. 2024a ; Zhao et al. 2025 further improve visual quality and spatio-temporal coherence. However, their high computational cost hinders real-time performance, such as in video conferencing or live chat applications. 3D Head Avatar Generation. Traditional 3D head avatars typically rely on 3D Morphable Models (3DMMs) for mesh reconstruction Xu et al. 2020 ; Khakhulin et al. 2022 , which often fail to capture fine geometric details. In contrast, NeRF-based approaches Kirschstein et al. 2023 ; Athar et al. 2022 ; Bai et al. 2023b ; Gafni et al. 2021 ; Gao et al. 2022 ; Guo et al. 2021 ; Ki et al. 2024 ; Park et al. 2021a ; Park et al. 2021b ; Tretschk et al. 2021 ; Zhang et al. 2024 ; Zhao et al. 2023 ; Zheng et al. 2023 ; Zielonka et al. 2023 have significantly improved