Interpretable Evaluation of AI-Generated Content with Language-Grounded Sparse Encoders
Yiming Tang, Arash Lagzian, Srinivas Anumasa, Qiran Zou, Trang Nguyen, Ehsan Adeli, Ching-Yu Cheng, Yilun Du, Dianbo Liu † · 2025
Read Interpretable Evaluation of AI-Generated Content with Language-Grounded Sparse Encoders by Yiming Tang, Arash Lagzian, Srinivas Anumasa, Qiran Zou, Trang Nguyen, Ehsan Adeli, Ching-Yu Cheng, Yilun Du, Dianbo Liu † (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-18236.txt.
Introduction
Yiming Tang and co-authors build a tool that grades AI-made images pattern by pattern, in plain words. Whole-image scores miss the specific flaws that sink generated content. Their 2025 system, LanSE, decomposes pictures into interpretable visual patterns, each with a natural language label. Large multimodal models help discover and name the patterns. Over five thousand emerge, with ninety-three percent human agreement on the labels. Decomposed scoring then beats whole-image rivals at evaluation.
The tool also runs the first systematic test of physical plausibility in generated images. Medical imaging settings prove reachable as well. Because patterns carry words, failures become discussable and fixable. The team pitches the approach for any field where outputs need auditable, part-level judgment.
Catalog record
| CREATOR | Yiming Tang, Arash Lagzian, Srinivas Anumasa, Qiran Zou, Trang Nguyen, Ehsan Adeli, Ching-Yu Cheng, Yilun Du, Dianbo Liu † |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-18236
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Interpretable Evaluation of AI-Generated Content with Language-Grounded Sparse Encoders Yiming Tang, Arash Lagzian, Srinivas Anumasa, Qiran Zou, Trang Nguyen, Ehsan Adeli, Ching-Yu Cheng, Yilun Du, Dianbo Liu † Abstract While the quality of AI-generated contents, such as synthetic images, has become remarkably high, current evaluation metrics provide only coarse-grained assessments, failing to identify specific strengths and weaknesses that researchers and practitioners need for model selection and development, further limiting the scientific understanding and commercial deployment of these generative models. To address this, we introduce Language-Grounded Sparse Encoders (LanSE), a novel architecture that creates interpretable evaluation metrics by identifying interpretable visual patterns and automatically describing them in natural language. Through large-scale human evaluation (more than 11,000 annotations) and large multimodal model (LMM) based analysis, LanSE demonstrates reliable capabilities to detect interpretable visual patterns in synthetic images with more than 93% accuracy in natural images. LanSE further provides a fine-grained evaluation framework that quantifies four key dimensions of generation quality, prompt match, visual realism, physical plausibility, and content diversity. LanSE reveals nuanced model differences invisible to existing metrics, for instance, FLUX’s superior physical plausibility and SDXL-medium’s strong content diversity, while aligning with human judgments. By bridging interpretability with practical evaluation needs, LanSE offers all users of generative AI models a powerful tool for model selection, quality control of synthetic content, and model improvement. These capabilities directly address the need for public confidence and safety in AI-generated content, both critical for the future of generative AI applications. \keepXColumns Introduction AI-synthesized contents created by generative machine learning models is increasingly used in various aspects of society, including artistic design, advertisement generation, and video production. While recent generative models are remarkably fluent in producing highly realistic outputs ( rombach2022highresolutionimagesynthesislatent ; tian2024visualautoregressivemodelingscalable ) , they are still prone to notable failure modes, such as hallucinating nonexistent objects ( aithal2024understandinghallucinationsdiffusionmodels ) , misusing lighting cues ( zhao2025clearrobustcontextguidedgenerative ) , and violating anatomical coherence ( Narasimhaswamy_2024 ) . When AI trains on AI-generated content, these failures cascade through systems; for example, medical AI learning from synthetic images with anatomical errors perpetuates those mistakes in real diagnoses ( shumailov2024curserecursiontraininggenerated ) . Therefore,it is vital to measure quality of data generated by AI, identify and remove these failures before releasing them for applications and to the public. However, there exists a significant gap in evaluating the quality of generated content and its alignment with human intent. While methods for AI-synthesized data evaluation, typically based on semantic similarity ( hessel2022clipscorereferencefreeevaluationmetric ) , distributional alignment ( jayasumana2024rethinkingfidbetterevaluation ; barratt2018noteinceptionscore ) , or aesthetics ( huang2023predictingscoresvariousaesthetic ) , can capture certain aspects of quality, they lack the granularity and interpretability needed to provide nuanced assessments on varied model performance axis ( sampaio2024typescoretextfidelitymetric ; chen2023understandingvulnerabilityclipimage ) . These significant gaps in evaluation can mislead model selection and mask critical failure modes, where models with higher metric scores can still generate outputs with unacceptable structural errors or physics violations ( bianchi2024clipmainroadblockfinegrained ; kirstain2023pickapicopendatasetuser ) . Recent analyses have shown that the fundamental problem of current evaluation approaches is they directly utilize high-dimensional embedding spaces that contain biased information and can ignore critical visual patterns ( zhang2018unreasonableeffectivenessdeepfeatures ; schrodi2025effectstriggermodalitygap ) . Unlike many existing evaluation methods that conduct a holistic assessment and assign a single score to each generated output, humans evaluate visual content by identifying distinct visual patterns and considering them collectively ( biederman1987recognition ; marr2010vision ; zeki1999art ; clark1996using ; nightingale2017can ; farid2022creating ) . Consider how art critics work: when evaluating a painting created from a prompt, they rarely assign a single score. Instead, they describe which aspects work and which fail: the lighting may be striking, the composition balanced, the anatomy flawed. Previous studies in human cognition have shown that people rely on specific visual cues when judging image quality—such as facial asymmetry ( rhodes1998facial ) , inconsistent lighting or shadows ( Santos03042018 ) , and unnatural textures ( landy2013texture ) . However, such factors are typically overlooked by existing evaluation metrics, which reduce assessment to single scores or opaque embeddings. This disconnect highlights the urgent need for evaluation methods grounded in interpretable visual patterns, better aligned with how humans assess visual content. To automatically identify such interpretable visual patterns needed for AI-synthesized image evaluation, recent advances in mechanistic interpretability ( bereska2024mechanisticinterpretabilityaisafety ; farrell2024applyingsparseautoencodersunlearn ) offer useful tools. Studies have shown that enforcing sparsity on various neural modules elicits monosemantic neurons—individual units that only respond to certain specific concepts ( bussmann2025learningmultilevelfeaturesmatryoshka ) . In detail, the linear representation hypothesis ( park2024linearrepresentationhypothesisgeometry ) reveals that these meaningful features are often encoded as directions in representation space, and modules like sparse autoencoders ( cunningham2023sparseautoencodershighlyinterpretable ) and transcoders ( dunefsky2024transcodersinterpretablellmfeature ) can effectively extract them. Crucially, recent works have found that such interpretable features often correlate with specific failure patterns in generative models ( templeton2024scaling ) . This motivates us to adapt the interpretability modules for evaluation, creating metrics that are both rigorous in computation and interpretable in language to close the gap in evaluating AI generated contents. Figure 1: Language-Grounded Sparse Encoders (LanSE). Given an input image-caption pair, LanSE maps visual and textual inputs into a sparse, interpretable feature space that reflect evaluation dimensions. LanSE neurons are categorized according to their interpretable visual patterns. Only a few neurons are activated per input. To solve the problems above, we introduce Language-Grounded Sparse Encoders (LanSE), a method that automatically learn thousands of interpretable visual patterns from training data and use these visual patterns to conduct fine-grained evaluation of synthetic images produced by generative machine learning models (Figure 1 ). By automatically collecting and concatenating neurons from trained interpretability modules, LanSE filters out noisy neurons, and keeps only the most reliable neurons that serve as high-accuracy visual quality indicators. The semantic meaning of each neuron, which we refer to as an interpretable visual pattern, is automatically identified and phrased by large multimodal models (LMMs). Through extensive human evaluation involving over 11,000 annotations from four independent annotators, LanSE demonstrates a reliable ability to detect nuanced visual patterns, achieving over 93% agreement with human judgments. In addition to natural images, we extended our evaluation pipeline to medical imaging. Leveraging these interpretable features, LanSE provides a comprehensive evaluation framework that assesses generative models along four critical dimensions: prompt match (whether concepts in prompts exist in images ( huang2025t2icompbenchenhancedcomprehensivebenchmark ) ), visual realism (photorealism of generated content ( kynkäänniemi2019improvedprecisionrecallmetric ) ), physical plausibility (adherence to intuitive physics constraints ( yang2018physicsinformeddeepgenerativemodels ) ), and content diversity (variation in generated outputs ( gerstgrasser2024modelcollapseinevitablebreaking ) ). LanSE metrics decompose generative model quality into interpretable dimensions, revealing critical aspects that traditional existing metrics fail to capture or even contradict. To our best knowledge, LanSE provides the first automatic evaluation method for intuitive physics violations, the first semantic alignment metrics and content diversity metrics that support assessments on targeted semantic groups. By bridging mechanistic interpretability with practical evaluation needs, LanSE improves how we assess generative models today and lays the foundation for more trustworthy, controllable, and safer systems. Its LMM-driven automated pipeline scales the curation of interpretable visual patterns beyond what manual annotation can support. Beyond image generation, LanSE offers a generalizable, interpretable evaluation framework for video synthesis, reinforcement learning, and autonomous-driving perception. The same capacity