Multi-Dimensional Quality Assessment for Text-to-3D Assets: Dataset and Model

Kang Fu*, Huiyu Duan*, Zicheng Zhang, Xiaohong Liu, Member, IEEE,, Xiongkuo Min, Member, IEEE, Jia Wang, Guangtao Zhai, Fellow, IEEE · 2025

Read Multi-Dimensional Quality Assessment for Text-to-3D Assets: Dataset and Model by Kang Fu*, Huiyu Duan*, Zicheng Zhang, Xiaohong Liu, Member, IEEE,, Xiongkuo Min, Member, IEEE, Jia Wang, Guangtao Zhai, Fellow, IEEE (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-16915.txt.

Introduction

Kang Fu and six co-authors build the first big yardstick for judging 3D objects made from text prompts, in a 2025 paper. Generators now turn a sentence into a 3D asset in seconds. Their quality varies wildly, and human aligned grading tools lag behind.

The team assembled 969 assets from 170 prompts across six popular generators. Human raters scored each asset on quality, realism, and match to the prompt. That set became the largest database of its kind. The authors then trained a model that grades new assets on all three axes. The benchmark gives builders a shared target for improvement.

Catalog record

CREATORKang Fu*, Huiyu Duan*, Zicheng Zhang, Xiaohong Liu, Member, IEEE,, Xiongkuo Min, Member, IEEE, Jia Wang, Guangtao Zhai, Fellow, IEEE
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-16915

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Multi-Dimensional Quality Assessment for Text-to-3D Assets: Dataset and Model Kang Fu*, Huiyu Duan*, Zicheng Zhang, Xiaohong Liu, Member, IEEE,, Xiongkuo Min, Member, IEEE, Jia Wang, Guangtao Zhai, Fellow, IEEE Abstract Recent advancements in text-to-image (T2I) generation have spurred the development of text-to-3D asset (T23DA) generation, leveraging pretrained 2D text-to-image diffusion models for text-to-3D asset synthesis. Despite the growing popularity of text-to-3D asset generation, its evaluation has not been well considered and studied. However, given the significant quality discrepancies among various text-to-3D assets, there is a pressing need for quality assessment models aligned with human subjective judgments. To tackle this challenge, we conduct a comprehensive study to explore the T23DA quality assessment (T23DAQA) problem in this work from both subjective and objective perspectives. Given the absence of corresponding databases, we first establish the largest text-to-3D asset quality assessment database to date, termed the AIGC-T23DAQA database. This database encompasses 969 validated 3D assets generated from 170 prompts via 6 popular text-to-3D asset generation models, and corresponding subjective quality ratings for these assets from the perspectives of quality, authenticity, and text-asset correspondence, respectively. Subsequently, we establish a comprehensive benchmark based on the AIGC-T23DAQA database, and devise an effective T23DAQA model to evaluate the generated 3D assets from the aforementioned three perspectives, respectively. Specifically, the proposed method utilizes the projection videos of text-to-3D assets to extract 3D shape, texture and text-asset correspondence features, then fuses them to calculate the final three preference scores respectively. Extensive experimental results demonstrate the effectiveness of the proposed T23DAQA method in evaluating the quality of AI generated 3D asset, which is more consistent with human perception. To the best of our knowledge, this is the first work that studies the problem of text-guided 3D generation quality assessment, and The database is released at https://github.com/ZedFu/T23DAQA . I Introduction The 3D asset generation has long been an important task in the field of computer vision (CV) and artificial intelligence (AI), which pursues high-quality and automatic 3D model or view synthesis [ 1 , 2 ] . The recent advances in text-to-image generation via diffusion models have spurred the development of numerous text-to-3D asset generation methodologies, exemplified by works including Dreamfusion [ 3 ] , Prolificdreamer [ 4 ] , etc . However, the text-to-3D asset synthesis is influenced by various factors such as prompts, and techniques, leading to diverse perceptual qualities that directly impact user experience. Consequently, there is a crucial need for a subjective-consistent quality assessment framework to evaluate text-to-3D assets. However, existing quality assessment models fail to adequately address this task. As shown in Fig. 1 , on one hand, distortions introduced by text-to-3D asset generation models, including unreal structures, unreasonable components, discontinuous views, are significantly different from those encountered in traditional 3D asset, which invalidates traditional quality assessment methods. On the other hand, conventional quality assessment models do not take the alignment between text and 3D asset into consideration, which is a pivotal evaluation aspect for text-to-3D assets. Fig. 1: Illustration of the difference between traditional 3d asset and AI generated 3d asset, whose perceptual quality are affected by different attributes. Current text-to-3D asset generation models generally uses image fidelity evaluation metrics such as Inception Score (IS) [ 5 ] and Fréchet Inception Distance (FID) [ 6 ] to assess the quality of text-to-3D assets. However, these metrics cannot evaluate the fidelity, quality and text-image correspondence of a single generated image. Moreover, previous quality assessment metrics designed for natural images, omnidirectional images, natural videos, user generated videos, point clouds, meshes etc. [ 7 , 8 , 9 , 10 ] , may not generalize well for assessing text-to-3D assets. There are two main reasons for this: 1) Previous quality assessment methods can only predict the quality aspect of the generated asset, while ignoring the authenticity aspect and the association between the prompt and the generated 3D asset; 2) The distortions existed in text-to-3D asset, such as floating artifacts and multiple similar planes, are different from the common distortions existed in traditional 3D models, such as noise and compression, which makes most traditional quality assessment methods unable to generalize well to assess the quality of T23DA. Several text-to-3D generation works also conduct the user studies, which let volunteers choose the better generated 3D assets, to validate the effectiveness of a generation framework. However, user studies are time consuming and inefficient, which further strengths the importance of developing an objective perception evaluation algorithm for text-to-3D assets. In the same time, T23DAQA has many potential applications in real-world scenarios: 1) it has the potential to be used to optimize the perceptual quality of generated 3D asset as a loss function in the training of a text-to-3D asset model. 2) Nowadays, many T23DA companies have emerged to assist game designers and filmmakers in creating 3D asset, such as Genie [ 11 ] and Meshy [ 12 ] . However, the generated 3D asset is not always excellent and usually requires to select the best 3D asset from multiple generated results. T23DAQA can automatically filter out generated 3D asset with better perceptual quality. Fig. 2: An Overview of the established AIGC-T23DAQA database and the proposed T23DAQA method. AIGC-T23DAQA database is the first and the largest text-to-3d assets quality assessment database. This database encompasses 969 validated 3D assets generated from 170 prompts via 6 popular text-to-3D asset generation models, and corresponding subjective quality ratings. In addition, we popose a T23DAQA method to predict the text-to-3D asset quality from three aspects: shape, texture, and correspondence. The proposed method achieves the state-of-the-art performance in evaluating the perceptual attributes of text-to-3d assets. As shown in Fig. 2 , in order comprehensively and accurately evaluate text-to-3D assets, we conduct both subjective and objective assessment studies in this work. Firstly, we establish the largest-scale subjective text-to-3D asset quality assessment dataset to date, named AIGC-T23DAQA database. This dataset comprises 969 text-to-3D assets generated by six distinct text-to-3D methods using 170 text prompts. Based on the generated 3D assets, a subjective experiment is conducted to collect the quality, authenticity, and text-asset correspondence ratings, respectively, which are further processed to obtain mean opinion scores (MOSs). To the best of our knowledge, this is the first database for text-to-3D generated asset evaluation from multiple perspectives. Based on the established AIGC-T23DAQA database, we propose a novel model equipped with multi-modality foundation models for better text-to-3D asset quality assessment, which is named as T23DAQA model. Since the most of recent text-to-3D asset generation methods employ neural radiation fields (NeRF) to represent 3D asset, which are stored in multilayer perceptrons (MLPs) or voxels. The NeRF-based representation generally lacks explicit 3D models, which poses challenges for 3D quality assessment. So our proposed method is a projection-based quality evaluation algorithm that extracts perceptual quality features from three aspects, including: shape, texture, and text-asset correspondence, and then fuse the extracted features to predict quality, authenticity, and text-asset correspondence scores. Based on the constructed AIGC-T23DAQA database, we establish a benchmark for it including many SOTA quality assessment methods and validate the effectiveness of the proposed method on this benchmark. Experimental results demonstrate that our proposed method achieves the best performance compared to these state-of-the-art methods for evaluating text-to-3D assets, which manifests the superiority of the proposed model. In summary, the

Read the complete text