Evaluating and Predicting Distorted Human Body Parts for Generated Images
Lu Ma * †, Kaibo Cao *, Hao Liang, Jiaxin Lin, Zhuang Li, Yuhong Liu, Jihong Zhang, Wentao Zhang ‡, Bin Cui ‡ · 2025
Read Evaluating and Predicting Distorted Human Body Parts for Generated Images by Lu Ma * †, Kaibo Cao *, Hao Liang, Jiaxin Lin, Zhuang Li, Yuhong Liu, Jihong Zhang, Wentao Zhang ‡, Bin Cui ‡ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-00811.txt.
Introduction
Lu Ma and co-authors build tools to catch warped body parts in AI-drawn people in a 2025 paper. Image generators often slip on anatomy, adding limbs, fusing fingers, or dropping parts. Common quality scores cannot see such faults, and human rating scales stay vague. The team set out to define and measure these errors directly.
They first wrote shared standards for naming body distortions. They then built a set of 4,700 labeled images, both normal and warped, across styles and fault types. Their detector model beat strong rivals at finding and outlining the faults. Last, they graded four popular image generators with 500 people-focused prompts. The benchmark shows how far current generators still fall short on basic anatomy.
Catalog record
| CREATOR | Lu Ma * †, Kaibo Cao *, Hao Liang, Jiaxin Lin, Zhuang Li, Yuhong Liu, Jihong Zhang, Wentao Zhang ‡, Bin Cui ‡ |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-00811
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evaluating and Predicting Distorted Human Body Parts for Generated Images Lu Ma * †, Kaibo Cao *, Hao Liang, Jiaxin Lin, Zhuang Li, Yuhong Liu, Jihong Zhang, Wentao Zhang ‡, Bin Cui ‡ Abstract Recent advancements in text-to-image (T2I) models enable high-quality image synthesis, yet generating anatomically accurate human figures remains challenging. AI-generated images frequently exhibit distortions such as proliferated limbs, missing fingers, deformed extremities, or fused body parts. Existing evaluation metrics like Inception Score (IS) and Fréchet Inception Distance (FID) lack the granularity to detect these distortions, while human preference-based metrics focus on abstract quality assessments rather than anatomical fidelity. To address this gap, we establish the first standards for identifying human body distortions in AI-generated images and introduce Distortion-5K, a comprehensive dataset comprising 4,700 annotated images of normal and malformed human figures across diverse styles and distortion types. Based on this dataset, we propose ViT-HD, a Vision Transformer-based model tailored for detecting human body distortions in AI-generated images, which outperforms state-of-the-art segmentation models and visual language models, achieving an F1 score of 0.899 and IoU of 0.831 on distortion localization. Additionally, we construct the Human Distortion Benchmark with 500 human-centric prompts to evaluate four popular T2I models using trained ViT-HD, revealing that nearly 50% of generated images contain distortions. This work pioneers a systematic approach to evaluating anatomical accuracy in AI-generated humans, offering tools to advance the fidelity of T2I models and their real-world applicability. The Distortion-5K dataset, trained ViT-HD will soon be released in our GitHub repository: https://github.com/TheRoadQaQ/Predicting-Distortion . † † footnotetext: * Equal contribution † † footnotetext: †The work was done during an internship at Tencent Email: [email protected] † † footnotetext: ‡Corresponding author Email: { wentao.zhang , bin.cui } @pku.edu.cn Figure 1 : Examples from our Distortion-5K . AI-generated human images frequently exhibit various distortions, including proliferation (first row), absence (second row), deformation (third row), fusion (fourth row), and the occurrence of multiple distortions within a single image (fifth row). We annotate the distorted body parts in these images, where the left image in each pair represents the original, and the right image features red masks indicating the distorted regions. 1 Introduction In recent years, text-to-image (T2I) models achieve remarkable advancements, enabling the synthesis of high-quality images directly from textual descriptions [ 46 , 13 , 9 , 33 ] . These models demonstrate vast potential across a wide range of applications, including digital art creation [ 39 ] , virtual reality [ 19 ] , and automated content generation [ 11 ] . Despite these significant strides, AI-generated images still face notable challenges, particularly in rendering human figures with anatomical accuracy. The synthesis of human bodies remains a complex task due to the intricate anatomical structures and subtle nuances involved, especially in the depiction of hands and feet [ 17 , 28 ] . As illustrated in Figure 1 , AI-generated human images often exhibit distortions such as the proliferation of hands, the absence of fingers, the deformation of feet, and the fusion of body parts. We define such instances as distorted , and our experimental results indicate that nearly 50% of human-related generated images suffer from these distortions, highlighting a critical limitation in current T2I models. Existing evaluation metrics for generated images are inadequate for detecting these specific issues related to human body distortions. Metrics such as the Inception Score (IS) [ 8 ] and the Fréchet Inception Distance (FID) [ 20 ] often fail to align with human judgment [ 14 ] and lack the granularity needed to identify distorted human images. While metrics derived from human preferences provide summarized numeric scores of image quality [ 44 , 43 ] , they are limited to broad assessments and fail to address finer details or provide insights into specific areas where a model underperforms, particularly in the integrity of human anatomical structures in generated images. To address this gap, we establish standards for identifying human body distortions and introduce a comprehensive dataset of normal and distorted AI-generated human images. Additionally, we present a distortion detection model, specifically designed to evaluate and predict these distortions. Our contributions can be summarized as follows: • We establish the first comprehensive set of standards for identifying human body distortions in AI-generated images and introduce the Distortion-5K dataset, which contains approximately 5,000 images of normal and various types of distorted human figures, including detailed annotations of distorted regions. • We propose a Vi sion T ransformer model for H uman D istortion in AI-generated images, termed ViT-HD, which is capable of evaluating and identifying various types of distortions across different body parts in a wide range of artistic styles. • We introduce the Human Distortion Benchmark and conduct an extensive evaluation of popular T2I models using our ViT-HD model. This evaluation involves analyzing the frequency of human body distortions in generated images, providing valuable insights into the performance and limitations of these models in rendering anatomically accurate human figures. To the best of our knowledge, this work represents the first dedicated effort to develop both a specialized model and a dataset focused on evaluating distortions in AI-generated human figures. We believe that our contributions significantly advance the field of AI image generation, offering a pathway towards more precise and anatomically accurate synthesis of human bodies. Our work not only addresses a critical gap in current evaluation methods but also provides a valuable toolset for researchers and practitioners aiming to improve the fidelity of T2I models in human figure generation. 2 Related Works 2.1 Text-to-image Generation Text-to-image generation sees significant advancements through various model architectures. Initially, Generative Adversarial Networks (GANs) [ 18 ] use a generator and discriminator to produce and evaluate images. However, GANs struggle with generating consistently diverse and high-quality images. This leads to the exploration of Variational Auto-Encoders (VAEs) [ 38 , 22 ] , which optimize the evidence lower bound to improve image likelihood. The introduction of diffusion models [ 21 ] marks a significant shift, setting a new state-of-the-art by iteratively refining images from random noise, thus capturing greater image diversity and quality. Latent Diffusion Models (LDMs) [ 33 ] further improve efficiency by performing the diffusion process in a compact latent space. Additionally, pixel-based models like DALL-E [ 32 ] and Imagen [ 35 ] achieve superior text-to-image alignment and resolution. 2.2 Text-to-image Evaluation Inception Score (IS) [ 8 ] and Fréchet Inception Distance (FID) [ 20 ] are commonly used to evaluate text-to-image models but fall short in assessing single images and aligning with human preferences. Recent studies focus on collecting and learning human preferences to fine-tune visual language models (VLMs). Wu et al. [ 44 , 43 ] create a dataset of 98,807 images based on user prompts and train a model to predict the Human Preference Score (HPS). Kirstain et al. [ 23 ] develop a web app to gather prompts and user preferences, resulting in the Pick-a-Pic dataset, which focuses on overall preferences but lacks detailed annotations. Xu et al. [ 45 ] collect a dataset by having users rank and rate images on quality, alignment, and fidelity, and train the ImageReward model for human preference learning. AGIQA-20k [ 25 ] compiles 20,000 AI-generated images with 420,000 subjective scores on