From EduVisBench to EduVisAgent: A Benchmark and Multi-Agent Framework for Reasoning-Driven Pedagogical Visualization

Haonian Ji * , Shi Qiu * , Siyang Xin * , Siwei Han *, Zhaorun Chen, Dake Zhang, Hongyi Wang, Huaxiu Yao · 2025

Read From EduVisBench to EduVisAgent: A Benchmark and Multi-Agent Framework for Reasoning-Driven Pedagogical Visualization by Haonian Ji * , Shi Qiu * , Siyang Xin * , Siwei Han *, Zhaorun Chen, Dake Zhang, Hongyi Wang, Huaxiu Yao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-16832.txt.

Introduction

Haonian Ji and seven co-authors tackled a gap in how AI models teach with pictures, in a 2025 paper. Models can reason in words, yet their visual explanations for school topics often miss what a learner needs. The team built both a test set and a multi-agent system to close that gap.

Their benchmark, EduVisBench, holds STEM problems at varied levels that call for picture-based answers. A grading rubric drawn from teaching theory scores how well each picture explains. Tests showed current models often fail to break hard reasoning into clear visual steps. Their system, EduVisAgent, splits the work among agents that plan the lesson, break down the reasoning, prompt reflection, and design the picture. It beat all rivals by a wide margin, with a gain of about 40 percent.

Catalog record

CREATORHaonian Ji * , Shi Qiu * , Siyang Xin * , Siwei Han *, Zhaorun Chen, Dake Zhang, Hongyi Wang, Huaxiu Yao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-16832

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

From EduVisBench to EduVisAgent: A Benchmark and Multi-Agent Framework for Reasoning-Driven Pedagogical Visualization Haonian Ji * , Shi Qiu * , Siyang Xin * , Siwei Han *, Zhaorun Chen, Dake Zhang, Hongyi Wang, Huaxiu Yao Abstract While foundation models (FMs), such as diffusion models and large vision-language models (LVLMs), have been widely applied in educational contexts, their ability to generate pedagogically effective visual explanations remains limited. Most existing approaches focus primarily on textual reasoning, overlooking the critical role of structured and interpretable visualizations in supporting conceptual understanding. To better assess the visual reasoning capabilities of FMs in educational settings, we introduce EduVisBench, a multi-domain, multi-level benchmark. EduVisBench features diverse STEM problem sets requiring visually grounded solutions, along with a fine-grained evaluation rubric informed by pedagogical theory. Our empirical analysis reveals that existing models frequently struggle with the inherent challenge of decomposing complex reasoning and translating it into visual representations aligned with human cognitive processes. To address these limitations, we propose EduVisAgent, a multi-agent collaborative framework that coordinates specialized agents for instructional planning, reasoning decomposition, metacognitive prompting, and visualization design. Experimental results show that EduVisAgent substantially outperforms all baselines, achieving a 40.2% improvement and delivering more educationally aligned visualizations. EduVisBench and EduVisAgent are available at github.com/aiming-lab/EduVisBench and github.com/aiming-lab/EduVisAgent . 0 0 footnotetext: Equal contribution. Correspondence to: {haonianj, huaxiu}@cs.unc.edu 1 Introduction “To truly teach is not to tell the answer, but to illuminate the path." While foundation models (FMs), such as diffusion models and large vision-language models (LVLMs), have been extensively adopted in educational domains Chu et al. (2025) ; Wang et al. (2024a) , including pedagogical agents providing automated classroom assistance and science learning agents offering textual explanations of problem-solving processes Wu et al. (2023) , their applications have predominantly focused on text-based interactions Wu et al. (2023) ; Xu et al. (2024) . However, in education, especially K-12 settings, creating compelling visualizations is crucial for cognitive comprehension and overall learning effectiveness Presmeg (2006) . Despite its importance, there is currently limited understanding of how FMs can effectively generate visually grounded elements (e.g., diagrams , interactive education tools , illustrative graphics ) to support the pedagogical illustration of problem-solving processes. Figure 1: GPT-4o fails to illustrate its problem-solving with high-quality, logical, and explanatory visualization. Currently, generating visually grounded elements for pedagogical reasoning poses several challenges: (1) decomposing complex reasoning into representable steps that align closely with human cognitive processes is non-trivial Yang et al. (2024) ; Chen et al. (2024d) ; (2) precisely producing visual aids for each sub-step to optimally support learners is challenging Hong et al. (2025) ; and (3) different educational domains require distinct visualization styles and formats, making consistent and adequate visual aid delivery difficult Pandey and Ottley (2025) . Addressing these obstacles first requires a clear picture of how current FMs perform, so that future models can be purpose-built to close the gaps. Consequently, a comprehensive evaluation platform is critical for systematically assessing FMs on visual pedagogical reasoning. To bridge this gap, we introduce EduVisBench , a multi-domain, multi-level benchmark designed to evaluate the capacity of foundation models to generate pedagogically effective, step-by-step visual reasoning. EduVisBench comprises structured problem sets across diverse domains, each requiring multimodal-centric reasoning and solutions that prioritize visualization principles such as interpretability , cognitive alignment , and instructional clarity to achieve high evaluation score. To facilitate a detailed evaluation, we further develop a fine-grained rubric enabling multidimensional assessments of AI-generated visual outputs, focusing explicitly on pedagogical criteria such as contextual relevance , visual clarity , multimodal coherence , reasoning support , and interactive engagement . Utilizing this benchmark, we conduct extensive evaluations on a variety of FMs and agents. Our findings reveal that although current models achieve predominantly correct step-by-step textual analyses, they frequently fail to generate useful or faithful visualizations, as depicted in Figure 1 . Specifically, our systematic analysis highlights recurring challenges including (1) semantic misalignments between textual explanations and visual components, (2) omissions of critical steps within rendered diagrams, and (3) structural inconsistencies in code-based visual outputs, collectively undermining accuracy, clarity, and interactivity. To address these limitations, we introduce a multi-agent collaborative framework, EduVisAgent , designed to simulate the complete learning journey—from initial problem exposure to deep conceptual understanding. Specifically, a central planning agent orchestrates six specialized expert agents dedicated to visualization design , cognitive scaffolding , and metacognitive regulation . A synthesis module then integrates these expert outputs into interactive, personalized learning webpages tailored specifically to human learners. Experimental results demonstrate that our proposed method EduVisAgent achieves an average improvement of 40.2% than current SOTA method. This underscores the effectiveness of our approach—leveraging modular specialization and collaborative integration to produce robust and visually grounded learning solutions. Figure 2: Dataset distribution of EduVisBench. Each domain encompasses various sub-domains, collectively covering 15 comprehensive pedagogical scenarios. Figure 3: Representative examples from EduVisBench, featuring questions from Maths, Chemistry, and Physics alongside their corresponding high-scoring visual explanations. These interactive visualizations, generated by our multi-agent system EduVisAgent, exemplify well-designed, pedagogically effective outputs for STEM problems. 2 EduVisBench Benchmark 2.1 Overview In this section, we introduce EduVisBench, a novel and challenging benchmark designed to evaluate the capability of models to generate logical and explanatory visualizations for educational purposes. As shown in Figure 2 , EduVisBench comprises 1,154 carefully curated STEM questions across three academic subjects and 15 distinct domains, organized into three levels of difficulty. In addition to assessing accuracy in step-by-step problem solving, EduVisBench places particular emphasis on a model’s ability to communicate the reasoning process clearly and visually—helping students understand problems through structured, interpretable visual outputs, as illustrated in Figure 3 . Specifically, EduVisBench adopts a multimodal setting in which models are provided with both textual and visual inputs and are tasked with producing diverse output formats, including interactive web pages and visual diagrams. Beyond evaluating the correctness of final answers, we introduce a fine-grained evaluation framework that assesses the quality of visualizations across five key dimensions: (1) the logical sequencing of visual elements, (2) the structural richness of the visuals, (3) semantic alignment with the underlying subject matter, (4) the clarity and guidance provided for problem-solving, and (5) the level of interactivity and engagement. In the following subsections, we describe our dataset curation process and the design of the evaluation rubric in detail. 2.2 Dataset Curation EduVisBench is built from several high-quality public educational resources that we carefully curated, translated, and adapted to support multimodal visualization learning tasks. Specifically, the chemistry questions are sourced from the C-MHChem-Benchmark Zhang et al. (2024a) , originally presented in Chinese and meticulously translated into English with careful attention to scientific accuracy and terminology. The physics questions are drawn from the high-school-physics Rohith (2023) dataset, which includes a range of conceptual and quantitative exercises suitable for secondary-level learners. The mathematics component combines easy-level problems from the Illustrative Mathematics curriculum with medium- to hard-level questions selected from the MATH-500 Lightman et al. (2023) dataset. Furthermore, each domain encompasses diverse sub-domains, collectively covering 15 comprehensive pedagogical scenarios, as illustrated in Figure 2 . All data sources were standardized into a unified format and consolidated to enable consistent and comprehensive evaluation across subjects. 2.3 Evaluation Metric In this subsection, we will detail the performance evaluation rubrics in EduVisBench. Evaluation

Read the complete text