EPSilon: Efficient Point Sampling for Lightening of Hybrid-based 3D Avatar Generation
Seungjun Moon, Sangjoon Yu, Gyeong-Moon Park · 2025
Read EPSilon: Efficient Point Sampling for Lightening of Hybrid-based 3D Avatar Generation by Seungjun Moon, Sangjoon Yu, Gyeong-Moon Park (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-13648.txt.
Introduction
Seungjun Moon, Sangjoon Yu, and Gyeong-Moon Park present EPSilon in two thousand twenty five. Hybrid avatars pair SMPL meshes with neural radiance fields. The mix renders people well but runs very slowly in practice. Deforming each sampled point to the mesh costs the time.
Most sampled points sit in empty space and add nothing. Empty ray omission drops rays that cross only void. Empty interval omission trims unoccupied spans along each ray. Quality holds while sampled points fall to under four percent. Inference runs about twenty times faster than before.
Catalog record
| CREATOR | Seungjun Moon, Sangjoon Yu, Gyeong-Moon Park |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-13648
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
EPSilon: Efficient Point Sampling for Lightening of Hybrid-based 3D Avatar Generation Seungjun Moon, Sangjoon Yu, Gyeong-Moon Park Abstract The rapid advancement of neural radiance fields (NeRF) has paved the way to generate animatable human avatars from a monocular video. However, the sole usage of NeRF suffers from a lack of details, which results in the emergence of hybrid representation that utilizes SMPL-based mesh together with NeRF representation. While hybrid-based models show photo-realistic human avatar generation qualities, they suffer from extremely slow inference due to their deformation scheme: to be aligned with the mesh, hybrid-based models use the deformation based on SMPL skinning weights, which needs high computational costs on each sampled point. We observe that since most of the sampled points are located in empty space, they do not affect the generation quality but result in inference latency with deformation. In light of this observation, we propose EPSilon, a hybrid-based 3D avatar generation scheme with novel efficient point sampling strategies that boost both training and inference. In EPSilon, we propose two methods to omit empty points at rendering; empty ray omission (ERO) and empty interval omission (EIO). In ERO, we wipe out rays that progress through the empty space. Then, EIO narrows down the sampling interval on the ray, which wipes out the region not occupied by either clothes or mesh. The delicate sampling scheme of EPSilon enables not only great computational cost reduction during deformation but also the designation of the important regions to be sampled, which enables a single-stage NeRF structure without hierarchical sampling. Compared to existing methods, EPSilon maintains the generation quality while using only 3.9% of sampled points and achieves around 20 × 20\times faster inference, together with 4 × 4\times faster training convergence. We provide video results on https://github.com/seungjun-moon/epsilon . Figure 1 : Comparisons of inference latency and performance with an avatar generation baseline. (a) Our method achieves 20 times faster inference for generating 300 frames of video, compared to the baseline. As the baseline does, we only utilize a (b) monocular video and achieve comparable performances on (c) novel pose generation and (d) clothing transfer. The video can be viewed on our project page . 1 Introduction Along with recent advances in Neural Radiance Fields [ 20 ] (NeRF), 3D human avatar generation with deep learning has been prevalent [ 12 , 25 , 4 , 23 , 13 , 9 , 30 , 6 , 34 , 36 , 32 , 10 , 11 , 35 , 33 , 27 , 39 ] . The most practical approach is to generate the avatar from a single monocular video [ 13 , 35 , 9 , 4 , 25 ] , which is cheap and easy to acquire. However, unless utilizing extra expensive information, e.g. , 3D scan [ 21 , 30 , 31 ] , pure NeRF-based models suffer from a lack of details, e.g. , artifacts on fingers and face shapes. Consequently, hybrid representation [ 9 , 8 ] recently emerged, which borrows the detailed human shape representation from the statistically modeled mesh, e.g. , SMPL [ 19 , 24 ] , MANO [ 28 ] , and FLAME [ 17 ] , while using NeRF to represent the non-human objects, e.g. , clothes. The combination of a strong prior on the human features in a statistical model and the high expressive power of the NeRF model indeed shows exceptional performance in avatar generation [ 9 , 8 ] . While hybrid-based models show remarkably better results than pure NeRF-based models, they suffer from slow inference time , i.e. , 0.07 FPS [ 9 ] . This is mainly due to the slow deformation of hybrid-based models. Due to the reliance on SMPL mesh, hybrid-based models should deform each sampled point based on SMPL linear blend skinning (LBS) weights, which is relatively slower than MLP-based deformation used in NeRF-based models [ 5 , 13 ] . However, most recent works either focus on boosting the rendering itself [ 22 , 3 , 29 , 16 ] which does nothing to boost the deformation, or rely on coarse MLP-based deformation [ 5 , 13 ] which is incompatible with hybrid representation. In other words, reducing the deformation cost in hybrid-based models is still under-explored. In the NeRF rendering scenario, it is well-known that the large portion of the sampled points is empty , which does not affect the rendering result due to the low volume density [ 16 , 15 , 37 , 41 ] . Especially for the avatar generation scenario, since the structure of the human body only occupies a small portion of the cubic-shaped rendering space, the portion of empty points is remarkably large [ 13 ] . In light of this observation, we argue that delicate sampling strategies that only select non-empty points can greatly reduce sampling points while preserving the quality. Since computation costs of deformation are proportional to the number of sampled points, this can effectively boost the inference without performance degradation. Indeed, in Figure 1 c and 1 d , we compare the result which renders with only 3.9% of the sampled points, i.e. , ours, and 100%, i.e. , SCARF [ 9 ] , and ours shows the comparable result. To this end, we argue that efficient point sampling can effectively reduce the computation, even without altering the deformation scheme. Contributions. We propose EPSilon, E fficient P oint S ampl i ng for l ightening o f Hybrid-based 3D avatar ge n eration. EPSilon targets to render only with non-empty points to reduce the computation cost by omitting empty points calculation. In specific, EPSilon proposes (i) empty ray omission and (ii) empty interval omission . First, using a silhouette of a given SMPL mesh, (i) classifies the empty ray and omits the rendering process of them. Second, (ii) narrows the sampling interval to the vicinity of SMPL mesh, to sample points only on the non-empty interval. Using both sampling strategies, we not only remove hierarchical sampling without notable performance degradation but also reduce the number of sampling rays and points on each ray. With efficient omitting of the empty points, EPSilon shows comparable results on reconstruction and novel pose generation with the state-of-the-art baseline [ 9 ] while achieving 20 times lower latency on video generation, and 4 times faster training speed. Moreover, EPSilon enables fine pose reenactment and clothing transfer, while fast rendering-based existing baselines [ 5 , 13 ] cannot. 2 Related Work 2.1 Efficient Point Sampling Various works focus on efficient point sampling to enhance both rendering quality and speed [ 20 , 22 , 13 , 37 , 15 , 14 , 38 ] . The key concept of the majority of them is to estimate density [ 15 ] and sample points using it. However, the estimated density is defined on canonical space , while our bottleneck exists on deformation , i.e. , sending points from observation to canonical space. Consequently, efficient sampling strategies on canonical space do not reduce the deformation bottleneck. Rather, we need to sample points efficiently on observation space . InstantAvatar [ 13 ] proposes an efficient sampling strategy on observation space, but it requires pre-computation