Knowledge Visualization: A Benchmark and Method for Knowledge-Intensive Text-to-Image Generation
Ran Zhao, Sheng Jin, Size Wu, Kang Liao, Zerui Gong, Zujin Guo, Yang Xiao, Wei Li · 2026
Read Knowledge Visualization: A Benchmark and Method for Knowledge-Intensive Text-to-Image Generation by Ran Zhao, Sheng Jin, Size Wu, Kang Liao, Zerui Gong, Zujin Guo, Yang Xiao, Wei Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22302.txt.
Introduction
Zhao and seven colleagues study text-to-image generation where scientific correctness matters, not just plausible looks. Their KVBench benchmark covers six senior high-school subjects, with 1,800 expert-curated prompts drawn from over 30 textbooks. Testing 14 leading open and closed models reveals large gaps in logical reasoning, symbolic precision and multilingual robustness, with open models trailing proprietary ones. Their KE-Check method enriches prompts with structured knowledge, then refines outputs against an explicit checklist. It cuts scientific hallucinations and narrows the gap between open and leading closed models.
Catalog record
| CREATOR | Ran Zhao, Sheng Jin, Size Wu, Kang Liao, Zerui Gong, Zujin Guo, Yang Xiao, Wei Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55702 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.22302
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Knowledge Visualization: A Benchmark and Method for Knowledge-Intensive Text-to-Image Generation Ran Zhao, Sheng Jin, Size Wu, Kang Liao, Zerui Gong, Zujin Guo, Yang Xiao, Wei Li Abstract Recent text-to-image (T2I) models have demonstrated impressive capabilities in photorealistic synthesis and instruction following. However, their reliability in knowledge-intensive settings remains largely unexplored. Unlike natural image generation, knowledge visualization requires not only semantic alignment but also strict adherence to domain knowledge, structural constraints, and symbolic conventions, exposing a critical gap between visual plausibility and scientific correctness. To systematically study this problem, we introduce KVBench, a curriculum-grounded benchmark for evaluating knowledge-intensive T2I generation. KVBench covers six senior high-school subjects: Biology, Chemistry, Geography, History, Mathematics, and Physics. The benchmark consists of 1,800 expert-curated prompts derived from over 30 authoritative textbooks. Each sample is paired with a reference image and a fine-grained evaluation checklist that decomposes correctness into atomic and verifiable constraints, enabling objective, interpretable, and reproducible assessment of structural accuracy and reasoning consistency. Using this benchmark, we evaluate 14 state-of-the-art open- and closed-source models, revealing substantial deficiencies in logical reasoning, symbolic precision, and multilingual robustness, with open-source models consistently underperforming proprietary systems. To address these limitations, we further propose KE-Check, a two-stage framework that improves scientific fidelity via (1) Knowledge Elaboration for structured prompt enrichment, and (2) Checklist-Guided Refinement for explicit constraint enforcement through violation identification and constraint-guided editing. KE-Check effectively mitigates scientific hallucinations, narrowing the performance gap between open-source and leading closed-source models. Data and codes are publicly available at https://github.com/zhaoran66/KVBench . Figure 1: Illustrative examples from KVBench, featuring expert-curated prompts, textbook-grounded reference images, and a set of atomic checklist-based evaluation criteria. 1 Introduction Recent advances in text-to-image (T2I) generation have achieved remarkable progress in photorealism and instruction following 54 ; 1 ; 16 ; 70 ; 68 ; 35 ; 36 . Modern generative models can synthesize visually compelling images from open-ended textual descriptions, demonstrating strong capabilities in composition, style control, and semantic alignment. However, as these models are increasingly deployed in knowledge-intensive scenarios such as scientific education, textbook illustration, and academic communication, a critical limitation emerges: visually plausible generation does not imply scientific correctness 44 ; 19 . Existing T2I systems frequently produce images that appear reasonable at a glance, yet violate fundamental domain knowledge, including incorrect structures, missing components, inconsistent spatial relations, and erroneous symbolic representations. This limitation stems from a fundamental mismatch between natural image synthesis and knowledge visualization. While natural image generation prioritizes perceptual realism and coarse semantic alignment, knowledge visualization demands precise compliance with domain-specific constraints , including structural correctness, symbolic accuracy, and standardized visual conventions. Generating such images requires not only understanding textual descriptions, but also grounding them in structured knowledge and enforcing fine-grained constraints during generation. Despite its importance, this problem remains underexplored. Recent efforts have begun to evaluate T2I models using exam-style or multidisciplinary benchmarks 45 ; 7 ; 66 , focusing on broad reasoning capabilities across diverse domains. However, these settings are loosely defined and often rely on holistic judgment, making it difficult to assess whether generated images satisfy the precise requirements of real-world educational content. In practice, educational applications require curriculum-grounded visualization , where correctness is defined by strict textbook standards rather than subjective plausibility. To bridge this gap, we introduce KVBench , a curriculum-grounded benchmark for knowledge-intensive text-to-image generation. KVBench focuses on knowledge visualization tasks derived from senior high-school education, covering six core subjects: Biology, Chemistry, Geography, History, Mathematics, and Physics. Each sample requires generating a textbook-quality image that satisfies rigorous domain constraints. The benchmark contains 1,800 expert-curated bilingual samples, enabling systematic evaluation of both reasoning accuracy and multilingual robustness. A key feature of KVBench is its checklist-based verification pipeline. Instead of relying on holistic scoring, we decompose each sample into a set of atomic, verifiable checklist items derived from authoritative textbooks. These items explicitly encode requirements on entities, spatial relations, labels, and visual conventions, enabling fine-grained and interpretable evaluation of model outputs. All samples and checklists are curated from over 30 textbooks and validated through multi-stage expert review, ensuring pedagogical fidelity and reproducibility. We further propose KE-Check , a simple yet effective framework for improving scientific fidelity. KE-Check follows a two-stage design. First, Knowledge Elaboration enriches abstract prompts into structured, domain-specific descriptions, providing a stronger conditioning signal for generation. Second, Checklist-Guided Refinement explicitly enforces constraint satisfaction by constructing structured checklists, performing item-wise constraint auditing, and applying constraint-guided editing. By decoupling knowledge injection from constraint enforcement, KE-Check effectively mitigates scientific hallucinations and produces high-fidelity visualizations. Notably, it significantly narrows the performance gap between open-source and proprietary models. In summary, this work makes the following contributions: • KVBench: A Curriculum-Grounded Benchmark for Knowledge Visualization. We introduce KVBench, a standardized benchmark for evaluating knowledge-intensive T2I generation. The dataset consists of 1,800 bilingual prompts curated from over 30 authoritative textbooks across six subjects. We further propose a checklist-based verification pipeline that decomposes visualization correctness into atomic, verifiable checklist items, enabling objective, interpretable, and reproducible assessment beyond holistic metrics. • KE-Check: A Constraint-Aware Refinement Framework. We propose KE-Check, a two-stage framework that combines Knowledge Elaboration with Checklist-Guided Refinement to enforce scientific correctness in generated images. Our method explicitly models constraint violations and performs constraint-guided editing, substantially improving structural accuracy and symbolic fidelity. • Comprehensive Analysis of Knowledge-Intensive T2I. We conduct extensive experiments on state-of-the-art T2I models, revealing persistent deficiencies in reasoning, constraint satisfaction, and multilingual robustness. Our findings highlight key challenges in knowledge-grounded generation and provide actionable insights for future research. 2 Related Works 2.1 Text-to-Image Generation Models. Text-to-image (T2I) generation has progressed rapidly from pixel-space diffusion models 28 ; 15 to high-fidelity latent approaches such as Stable Diffusion 54 , the Flux series 3 ; 2 , and DALL·E 53 ; 1 . These models achieve impressive visual quality and semantic alignment, but are primarily optimized for perceptual realism rather than structured correctness. Recent advances have shifted toward autoregressive and unified multimodal architectures, which model images and text within a shared token space 57 ; 20 ; 62 . Unified Multimodal Large Language Models (MLLMs), including Chameleon 59 , Emu3 65 , and subsequent frameworks 72 ; 14 , demonstrate strong capabilities in both generation and understanding by treating visual content as sequential representations. More recently, reasoning-driven generation has emerged as a new frontier, aiming to handle complex and rule-constrained tasks. Models such as GPT-Image-1 51 , Gemini 2.5-Flash-Image 25 , and Gemini-3-pro-image 24 incorporate implicit or explicit reasoning processes for visual synthesis. Complementary approaches, including Chain-of-Thought prompting for image generation 31 and step-wise reasoning paradigms 34 ; 40 , further enhance compositional control. Despite these advances, existing models remain limited in producing scientifically rigorous visualizations, where correctness is governed by strict structural, relational, and symbolic constraints. This gap motivates the need for both specialized evaluation and constraint-aware generation frameworks. 2.2 Text-to-Image Evaluation Benchmarks. Evaluation of T2I systems has evolved from holistic distribution-based metrics, such as FID 27 and CLIPScore 26 , to fine-grained alignment and reasoning-oriented benchmarks. Early works like GenEval 22 and TIFA 29 focus on compositional correctness with explicitly defined visual elements. Subsequent benchmarks increase prompt complexity and diversity 64 ; 80 ; 56 , but often fall short in capturing the dense constraints present in real-world applications. To better assess higher-level