Infogen : Generating Complex Statistical Infographics from Documents

Akash Ghosh 1 Aparna Garimella 2 Pritika Ramu 2 Sambaran Bandyopadhyay 2 Sriparna Saha 1 1 Indian Institute of Technology Patna, India 2 Adobe Research {akash_2321cs19,sriparna}@iitp.ac.in , {garimell,pramu}@adobe.com , [email protected] · 2025

Read Infogen : Generating Complex Statistical Infographics from Documents by Akash Ghosh 1 Aparna Garimella 2 Pritika Ramu 2 Sambaran Bandyopadhyay 2 Sriparna Saha 1 1 Indian Institute of Technology Patna, India 2 Adobe Research {akash_2321cs19,sriparna}@iitp.ac.in , {garimell,pramu}@adobe.com , [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-20046.txt.

Introduction

Akash Ghosh and co-authors generate full statistical infographics from documents in a 2025 paper. Charts alone are easy for AI now; layered infographics with several sub-charts, titles, and written insights are not. No prior system had tackled them from text-heavy sources.

The team defines infographic metadata capturing the title, insights, and each sub-chart's data and layout. Their new benchmark pairs documents with that metadata. Infogen then works in two stages: a tuned language model writes the metadata, and code renders the graphic. On the benchmark it beat both closed and open models, setting the current standard for the task. The dataset is a first for text-to-infographic work.

Catalog record

CREATORAkash Ghosh 1 Aparna Garimella 2 Pritika Ramu 2 Sambaran Bandyopadhyay 2 Sriparna Saha 1 1 Indian Institute of Technology Patna, India 2 Adobe Research {akash_2321cs19,sriparna}@iitp.ac.in , {garimell,pramu}@adobe.com , [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-20046

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Infogen : Generating Complex Statistical Infographics from Documents Akash Ghosh 1 Aparna Garimella 2 Pritika Ramu 2 Sambaran Bandyopadhyay 2 Sriparna Saha 1 1 Indian Institute of Technology Patna, India 2 Adobe Research {akash_2321cs19,sriparna}@iitp.ac.in , {garimell,pramu}@adobe.com , [email protected] Abstract Statistical infographics are powerful tools that simplify complex data into visually engaging and easy-to-understand formats. Despite advancements in AI, particularly with LLMs, existing efforts have been limited to generating simple charts, with no prior work addressing the creation of complex infographics from text-heavy documents that demand a deep understanding of the content. We address this gap by introducing the task of generating statistical infographics composed of multiple sub-charts (e.g., line, bar, pie) that are contextually accurate, insightful, and visually aligned. To achieve this, we define infographic metadata, that includes its title and textual insights, along with sub-chart-specific details such as their corresponding data, alignment, etc. We also present Infodat , the first benchmark dataset for text-to-infographic metadata generation, where each sample links a document to its metadata. We propose Infogen , a two-stage framework where fine-tuned LLMs first generate metadata, which is then converted into infographic code. Extensive evaluations on Infodat demonstrate that Infogen achieves state-of-the-art performance, outperforming both closed and open-source LLMs in text-to-statistical infographic generation. The sample datapoints from Infodat can be accessed through this link 1 Introduction Data visualization tools transform raw data into meaningful visuals, making complex information more accessible and understandable Sadiku et al. 2016 . In this work, we focus on Complex statistical infographics , which we view as those statistical visuals that are composed of more than one sub-chart, each with its own axes and titles, that are particularly significant for presenting intricate data in the form of simpler components. 1 1 1 While the term infographic can refer to a wide range of visual illustrations, we restrict ourselves to only those visuals that only comprise of multiple statistical charts. The common sub-charts include bar, pie, line graphs, and histograms, including their stacked or grouped variants, accompanied by varying textual information in the form of their titles or summaries. These information-dense visuals organize complex statistical data into a single cohesive layout, enabling a quick understanding of key statistics and trends. Widely used in business, academia, and media, they play a crucial role in supporting effective communication and informed decision-making Siricharoen 2013 . With recent advancements in AI, particularly the development of Large Language Models (LLMs) and Visual Language Models (VLMs) Ghosh et al. 2024a , the field of data visualization has undergone a transformative evolution Vázquez 2024 . Generative AI’s growing adoption has encouraged users to rely on prompts for diverse tasks Gozalo-Brizuela and Garrido-Merchán 2023 , For example, tools like Adobe Express Adobe and PiktoChart Piktochart leverage generative AI to analyze textual prompts and propose visually appealing, template-based designs. However, while effective for general infographics, these tools struggle with complex statistical contexts requiring more precise and nuanced data representation. This application of generating complex statistical infographics from text is especially useful for applications such as real-time dashboards from meeting summaries, scientific posters from research abstracts, personalized health visualizations, educational materials, survey summaries, market trends, social media insights, and policy briefs. Figure 1: Sample instance of text to complext statistical infographic task. The input is a textual document as shown in the left and the output is the corresponding statistical infographic in right. Research Gap: Previous research has improved LLMs’ ability to understand insights from infographics Liu et al. 2022a ; Liu et al. 2022b ; Masry et al. 2023 . Other studies have focused on creating simple statistical infographics from text and data Dibia 2023 ; Tian et al. 2024 , showing how AI can help with data visualization. However, these works mainly focus on basic charts like bar or line graphs based on structured instructions. Also, they take data in the form of CSV and tabular formats. However, if the user provides just the information in the form of textual documents, then generating the statistical infographic that consists of many sub charts requires a higher level of alignment and reasoning capabilities of LLMs. Motivation: In this work, we aim to address this research gap by curating a benchmark dataset named Infodat . Each datapoint of Infodat consists of the textual document as input. The output is the metadata, consisting of all the information that will guide the final code generation for the infographic. Metadata here refers to structured information describing the characteristics of infographics, including chart types (e.g., line, bar), axis labels, statistical data points, text annotations, layout details (e.g., position, alignment, dimensions), and visual styles (e.g., fonts, background color). It organizes and contextualizes subcharts within an infographic, ensuring clarity and coherence in representation. Our primary motivation for generating intermediate metadata is inspired by works such as Yan et al. 2023 ; Lee et al. 2024 demonstrating that providing explicit instructions to LLMs significantly improves output quality based on the use case. As there is no existing dataset for this task, we use a semi-automated approach for curating this dataset. 2 2 2 Examples of metadata are shown in Appendix A.6. We propose a novel framework, Infogen , with two main stages: the metadata generation module and the code generation module. The metadata generation module uses fine-tuned LLMs and a ranker to select the best output from these models. The code generation module includes LLM agents Yang et al. 2024b , namely the coder and feedback modules. The coder generates code from the metadata, while the feedback module refines the code based on the input document to improve the visual quality of the infographic. The goals of Infogen are to accurately determine the number and types of sub-charts and their content from the document and to arrange them in a visually appealing and well-aligned format. A sample instance of our task is illustrated in Figure 1 . Contributions : We make four main contributions in this paper: 1) We introduce the task of text to complex statistical infographic generation. 2) We present a synthetic data curation approach to obtain text-to-infographic parallel data along with intermediate metadata. We refer to this resulting dataset as Infodat . 3) We propose Infogen , a novel framework that performs content planning using LLMs to first generate intermediate metadata and then generate the final infographic and achieve state-of-the-art results for this task. 4) We propose a novel evaluation setup using various automatic metrics to evaluate the performance of different models for this task. 5) We conduct extensive empirical and qualitative analyses to measure our model’s effectiveness for generating statistical infographics from text. 2 Related Works Statistical Infographics Understanding: Research on this topic is broadly divided into two main approaches. The first involves using a single model to directly interpret charts and answer questions in natural language, as seen in works like Liu et al. 2022b ; Masry et al. 2023 , which streamlines the process by handling both visual and textual data simultaneously. The second approach converts charts into structured data for analysis, allowing for more accurate interpretations, as demonstrated by works like Liu et al. 2022a ; Xia et al. 2023 . Our approach is inspired by the second method, where we convert text data into

Read the complete text