Leveraging Large Language Models For Scalable Vector Graphics Processing: A Review

Boris Malashenko, Ivan Jarsky, Valeria Efimova · 2025

Read Leveraging Large Language Models For Scalable Vector Graphics Processing: A Review by Boris Malashenko, Ivan Jarsky, Valeria Efimova (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04983.txt.

Introduction

Boris Malashenko, Ivan Jarsky and Valeria Efimova review how large language models handle scalable vector graphics, in work from 2025. Vector files such as SVG are text at heart, which makes them a natural fit for language models, while older vector tools are slow and produce overly complex output. The review sorts the field into generation, editing and understanding tasks.

Systems such as IconShop, StrokeNUWA and StarVector are weighed for strengths and limits. Benchmarks including SVGEditBench, VGBench and SGP-Bench are analysed, and the authors run their own tests across models. Reasoning-tuned models beat standard ones, above all in generation and understanding. Richer datasets are the clear next need.

Catalog record

CREATORBoris Malashenko, Ivan Jarsky, Valeria Efimova
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-04983

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Leveraging Large Language Models For Scalable Vector Graphics Processing: A Review Boris Malashenko, Ivan Jarsky, Valeria Efimova Abstract . In recent years, rapid advances in computer vision have significantly improved the processing and generation of raster images. However, vector graphics, which is essential in digital design, due to its scalability and ease of editing, have been relatively understudied. Traditional vectorization techniques, which are often used in vector generation, suffer from long processing times and excessive output complexity, limiting their usability in practical applications. The advent of large language models (LLMs) has opened new possibilities for the generation, editing, and analysis of vector graphics, particularly in the SVG format, which is inherently text-based and well-suited for integration with LLMs. This paper provides a systematic review of existing LLM-based approaches for SVG processing, categorizing them into three main tasks: generation, editing, and understanding. We observe notable models such as IconShop, StrokeNUWA, and StarVector, highlighting their strengths and limitations. Furthermore, we analyze benchmark datasets designed for assessing SVG-related tasks, including SVGEditBench, VGBench, and SGP-Bench, and conduct a series of experiments to evaluate various LLMs in these domains. Our results demonstrate that for vector graphics reasoning-enhanced models outperform standard LLMs, particularly in generation and understanding tasks. Furthermore, our findings underscore the need to develop more diverse and richly annotated datasets to further improve LLM capabilities in vector graphics tasks. \english 1. Introduction In recent years, there has been a significant breakthrough in the field of computer vision, particularly in image generation and processing. Modern machine learning models [ 30 , 31 , 40 , 7 ] demonstrate impressive results when working with raster images, enabling advancements in graphic design, art, and data visualization. At the same time, vector graphics are also widely used in digital design. Vector graphics have a fundamentally different structure and offer several advantages, including scalability without quality loss, compact representation, and ease of editing. Vector images are based on mathematical descriptions of shapes such as lines, curves, polygons, and text elements. Unlike raster images, which consist of pixels, vector images store shape information as a set of coordinates and instructions, making them ideal for use in design, web development, and printed media. The most popular vector graphics format is SVG (Scalable Vector Graphics), which is based on XML markup. Figure 1 . Example of smiley face in SVG format (left) and its rasterized analogue (right). Graphical elements in SVG files are text-based and are described using XML tags. For instance, a basic image in SVG format can be depicted as shown in Figure 1 . This approach allows easy editing using text editors and automated modifications using software tools. Moreover, SVG supports CSS styling and dynamic manipulation with JavaScript, making it particularly useful for web applications and interactive graphics. Despite the clear value of vector graphics, the development of methods for their automatic generation and processing is still in its early stages. The earliest pioneering models for vector graphics generation [ 21 , 6 , 18 , 28 ] produced relatively simple images that were often noisy and distorted. However, their quality was insufficient for industrial use. A significant breakthrough in this area came with the introduction of DiffVG [ 20 ] , which enabled iterative vectorization of raster images with subsequent optimization of coordinates and other shape parameters. This led to the development of multiple optimization-based methods for image vectorization [ 22 , 39 , 15 ] and vector domain-specific style transfer methods [ 14 , 32 , 19 ] . Furthermore, the advent of diffusion models [ 30 , 31 , 40 , 23 ] has significantly improved the quality of generated raster images, facilitating substantial improvements in vector image generation through vectorization techniques [ 16 , 39 ] . The high fidelity of diffusion-generated images provides a robust foundation for vectorization processes, leading to more accurate and visually coherent vector outputs. Moreover, these advancements have enabled the optimization of vectorized representations through Score Distillation Sampling (SDS) [ 26 ] loss, which refines the generated vector images by leveraging the gradients of diffusion models, thereby improving their structural consistency and overall quality. However, existing machine learning-based vectorization methods [ 20 , 22 , 3 , 2 , 15 ] still face several serious challenges [ 12 ] . At first, they often require more than 10 minutes to process one image, especially when handling high-quality source images. Secondly, vectorization algorithms can generate an excessive number of primitives, making manual editing and post-processing utterly difficult. Additionally, traditional approaches do not allow designers to intuitively control the generation and editing process using text-based queries, limiting their practical applicability. The study presented in [ 17 ] , which focuses on generating SVGs, deliberately avoids utilizing DiffVG due to its inefficiency and frequent failures. Instead, the authors propose a novel generating approach based on a diffusion process. However, this process operates unconditionally and requires further investigation and refinement to enhance its effectiveness. The emergence of large language models (LLMs) [ 1 , 11 , 42 ] has introduced new possibilities for vector graphics generation and processing, because vector files in SVG format are text-based. XML-based structure makes SVGs an ideal medium for interaction with language models, as LLMs can generate, analyze, and edit SVG code, enabling users to work with vector graphics using natural language commands. This approach simplifies the creation of complex graphic elements, reduces the effort of designers and developers, and fosters new techniques for automated image generation. It is important to note that research on applying large language models to SVG has already started, with several studies demonstrating the potential of this approach. Specifically, some works [ 35 , 4 , 45 ] showcase the feasibility of automatic SVG generation based on textual descriptions, as well as the application of LLMs for editing and optimizing existing vector images. These studies lay the groundwork for future technological advancements that combine the power of language models with the flexibility of vector formats. We believe that, at present, language models are the only viable versatile approach for processing vector images. In this paper, we explore existing methods for generating and processing vector graphics using LLMs, analyze their advantages and limitations, and discuss the future prospects of this field. Our contributions are as follows: • We systematize approaches to vector graphics processing with LLMs. • We verify and reassess prior research findings. • We evaluate recently appeared LLMs, including novel reasoning models, for vector graphics tasks. In this paper, we explore the role of large language models (LLMs) in vector graphics processing, highlighting their potential and drawbacks in SVG generation, editing, and understanding tasks. Section 2 provides an overview of existing LLM-based models capable of SVG processing. Section 3 presents a detailed analysis of benchmark datasets and evaluation frameworks used to assess LLMs’ capabilities in vector-related tasks, covering Image-text bridging, SVGEditBench [ 24 ] , SVG Taxonomy [ 41 ] , VGBench [ 45 ] , and SGP-Bench [ 27 ] . Section 4 describes our experimental methodology, including evaluation metrics, implementation details, and the systematized results obtained in our study. Finally, Section 5 summarizes our findings, discusses limitations, and outlines future directions for research in this field. 2. LLM-Based models capable of

Read the complete text