A 3D Facial Reconstruction Evaluation Methodology: Comparing Smartphone Scans with Deep Learning Based Methods Using Geometry and Morphometry Criteria

Álvaro Heredia-Lidón (🖂), Alejandro Moñux-Bernal, Alejandro González, Luis M. Echeverry-Quiceno, Max Rubert, Aroa Casado, María Esther Esteban, Mireia Andreu-Montoriol, Susanna Gallardo, Cristina Ruffo, Neus Martínez-Abadías, Xavier Sevillano · 2025

Read A 3D Facial Reconstruction Evaluation Methodology: Comparing Smartphone Scans with Deep Learning Based Methods Using Geometry and Morphometry Criteria by Álvaro Heredia-Lidón (🖂), Alejandro Moñux-Bernal, Alejandro González, Luis M. Echeverry-Quiceno, Max Rubert, Aroa Casado, María Esther Esteban, Mireia Andreu-Montoriol, Susanna Gallardo, Cristina Ruffo, Neus Martínez-Abadías, Xavier Sevillano (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-09425.txt.

Introduction

Twelve authors set a test frame for 3D face builds in 2025 that goes past plain shape gaps. Cheap phone scans and deep builds from flat shots chase top gear that costs too much for wide clinic use. Pro kit builds set the truth marks for all tests in the frame. Shape and trait calls must both hold for a build to pass.

Shape-form math joins the frame, so trait keep can be scored, not just point gaps on the face. World and local gaps get counts in one pass, each with clear sense for the reader. Case runs pit phone scans against deep builds on the same truth set. The frame gives a fair grade path for cheap face gear of all kinds.

Catalog record

CREATORÁlvaro Heredia-Lidón (🖂), Alejandro Moñux-Bernal, Alejandro González, Luis M. Echeverry-Quiceno, Max Rubert, Aroa Casado, María Esther Esteban, Mireia Andreu-Montoriol, Susanna Gallardo, Cristina Ruffo, Neus Martínez-Abadías, Xavier Sevillano
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-09425

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A 3D Facial Reconstruction Evaluation Methodology: Comparing Smartphone Scans with Deep Learning Based Methods Using Geometry and Morphometry Criteria Álvaro Heredia-Lidón (🖂), Alejandro Moñux-Bernal, Alejandro González, Luis M. Echeverry-Quiceno, Max Rubert, Aroa Casado, María Esther Esteban, Mireia Andreu-Montoriol, Susanna Gallardo, Cristina Ruffo, Neus Martínez-Abadías, Xavier Sevillano Abstract Three-dimensional (3D) facial shape analysis has gained interest due to its potential clinical applications. However, the high cost of advanced 3D facial acquisition systems limits their widespread use, driving the development of low-cost acquisition and reconstruction methods. This study introduces a novel evaluation methodology that goes beyond traditional geometry-based benchmarks by integrating morphometric shape analysis techniques, providing a statistical framework for assessing facial morphology preservation. As a case study, we compare smartphone-based 3D scans with state-of-the-art deep learning reconstruction methods from 2D images, using high-end stereophotogrammetry models as ground truth. This methodology enables a quantitative assessment of global and local shape differences, offering a biologically meaningful validation approach for low-cost 3D facial acquisition and reconstruction techniques. 1 Introduction Three-dimensional (3D) facial model acquisition has been a breakthrough in fields such as plastic surgery [ 1 ] , orthodontic diagnosis [ 2 ] or the study of facial morphology for diagnostic purposes [ 3 ] . The potential of these techniques lies in their non-invasive nature, capturing precise details of the face, and resolving the limitations of two-dimensional (2D) analysis. Acquiring highly accurate 3D facial models usually requires specialised equipment [ 4 ] . Examples include stereophotogrammetry systems (SPG) –consisting of multiple cameras capturing images synchronously [ 5 ] –, portable devices based on laser technology [ 6 ] , structural light-based cameras [ 7 ] or medical devices like magnetic resonance image scanners [ 8 ] . While these techniques yield high-resolution 3D facial reconstructions, they are often expensive and inaccessible, limiting their widespread application in clinical settings [ 9 ] . As an alternative, portable structured-light scanners embedded in consumer devices like smartphones have emerged as a promising approach to low-cost 3D facial model acquisition [ 10 , 18 ] . Several studies have validated the applicability of the iPhone’s TrueDepth camera as a viable alternative to high-cost scanners for clinical applications [ 10 , 20 ] . A different low-cost approach consists in deep learning-based methods for reconstructing 3D facial models from a single or multiple 2D images. On the one hand, single-view 3D facial reconstruction has been a long-standing challenge in computer vision, leading to the development of various state-of-the-art approaches. For instance, Lei et al. [ 11 ] introduced a Hierarchical Representation Network (HRN) that decouples facial geometry to enhance high-fidelity detail reconstruction. Deng et al. [ 12 ] proposed a weakly-supervised CNN for 3D face reconstruction, while Wang et al. [ 13 ] leveraged geometric information from facial part silhouettes to guide the reconstruction process, improving structural accuracy. Figure 1: Methodology pipeline. (a) Data acquisition using high-cost 3D stereophotogrammetry system, and low-cost approaches. (b) Facial mesh extraction and normalisation. (c) 3D anatomical landmarks registration for morphometric analysis. (d) Methods comparison based on geometry and morphometry metrics. On the other hand, multi-view methods emerge as a powerful alternative, offering more accurate modelling but relying on camera calibrations and poses [ 11 , 14 ] . Ramon et al. [ 14 ] presented H3D-Net architecture for high-quality 3D human heads reconstruction from a few input images. Lei et al. [ 11 ] took advantage of the hierarchical structure of HRN to adapt it to multiple images, adding geometric consistency between different views. Another multi-view approach is diffusion modelling, generating multiple views from a single 2D image, like in Era3D [ 15 ] , for subsequent reconstruction of 3D models using NeuS [ 16 ] or Gaussian Splatting [ 17 ] techniques. The validation of low-cost 3D facial acquisition and reconstruction methods has predominantly relied on benchmarks such as REALY [ 21 ] or NoW [ 22 ] , which assess geometric accuracy using high-resolution 3D facial models as ground truth [ 11 ] . However, these benchmarks are limited to surface-based geometric deviations and fail to account for facial morphology and anatomical consistency. To address this gap, it is necessary to incorporate statistical shape analysis techniques that evaluate the morphological fidelity of reconstructed faces, providing a more anatomically relevant validation framework. In this context, Geometric Morphometrics (GM) is a robust set of statistical tools that measure the shape of biological structures from the coordinates of a set of anatomical landmarks [ 23 ] . The main advantage of GM is that the 3D shape and geometry are preserved throughout the analysis, providing more robust and precise results, detecting subtle shape differences, and allowing the visualization of the results as shape changes [ 23 ] . Among the two most commonly used GM techniques in facial analysis are: i) Generalized Procrustes Analysis (GPA) [ 23 ] to assess global differences in facial shape, and ii) Euclidean Distance Matrix Analysis (EDMA) [ 24 ] to detect local differences in facial shape. For this reason, we propose a new evaluation methodology for low-cost 3D facial acquisition and reconstruction methods, which extends beyond traditional geometric assessments by incorporating GM-based metrics (Figure 1 ). To test our methodology, we compared smartphone-based 3D scans with 2D image-based deep learning 3D reconstruction methods using high-resolution stereophotogrammetry models as ground truth. The results showed that smartphone scans achieved higher geometric and morphometric similarity with respect to the ground truth. 2 Materials and Methods 2.1 Participants Recruitment and Ethical Statement A total of 82 volunteers (40 females and 42 males, ages 30.48 \pm 12.13) with no pathological facial dysmorphologies were recruited. Each individual was captured on the same day by the different acquisition methods. No discriminatory criteria, such as excessive wrinkles or beard, were selected. To guarantee unobstructed facial shape acquisition, participants were asked to remove any hair covering their face and any artefacts such as earrings or piercings when possible, while maintaining a neutral facial expression. All the participants signed an informed consent approved by the Bioethics Committe of Universitat de Barcelona (IRB03099). 2.2 Face Acquisition and Reconstruction The first step of the proposed methodology requires using a high cost acquisition method to obtain the ground truth facial models, and a set of methods to be compared against this ground truth. Figure 2 illustrates the implementation of this step in the context of this work. Figure 2: Face acquisition and reconstruction. (a) High quality facial models acquired by a stereophotogrammetry (SPG) system: setup and reconstruction of the 3D facial model from 10 images. (b) Low-cost facial model acquisition via iPhoneX TrueDepth camera and processed 3D model. (c) Low-cost facial reconstruction from 2D image(s): 3DDFA_V3 [ 13 ] , HRN3 [ 11 ] (3 images) and Era3D [ 15 ] . High-end facial acquisition . We built a stereophotogrammetry (SPG) system composed of 10 synchronised DSLR cameras mounted on 5 tripods that were arranged in a semi-circle in two rows at different angles and heights covering on the front and sides of the subject (from 0 to \pm 90 degrees), and two side light sources (Figure 2 a) as in [ 3 ] . Camera synchronization was crucial to minimize motion artefacts [ 5 ] . High-resolution 3D models

Read the complete text