UIBenchKit: A unified toolkit for design-to-code model evaluation
Chinh T. Le, Trevor Ong Yee Siang, Jingyu Xiao, Yuxuan Wan, Yintong Huo · 2026
Read UIBenchKit: A unified toolkit for design-to-code model evaluation by Chinh T. Le, Trevor Ong Yee Siang, Jingyu Xiao, Yuxuan Wan, Yintong Huo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13141.txt.
Introduction
Le and four co-authors introduce UIBenchKit, an open-source toolkit that unifies testing of design-to-code models, which turn webpage screenshots into HTML and CSS. Without a standard test platform, fair tests have been hard, slowing uptake and research. UIBenchKit hides setup, model runs and rendering work behind a plug-and-play design with an analytical scoring interface. A study of existing tools with the kit yields findings pointing to future gains.
Catalog record
| CREATOR | Chinh T. Le, Trevor Ong Yee Siang, Jingyu Xiao, Yuxuan Wan, Yintong Huo |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17999 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.13141
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
UIBenchKit: A unified toolkit for design-to-code model evaluation Chinh T. Le, Trevor Ong Yee Siang, Jingyu Xiao, Yuxuan Wan, Yintong Huo Abstract . Recent years have seen substantial progress in automated design-to-code generation, with many methods proposed for generating HTML and CSS from webpage screenshots. However, the absence of a standardized evaluation platform makes it difficult to compare these methods fairly, limiting both practical adoption and systematic research progress. To bridge this gap, we introduce UIBenchKit, an open-source, integrated toolkit designed to unify the evaluation of design-to-code tasks. UIBenchKit abstracts the complexities of environment setup, model inference, and code rendering, offering researchers a plug-and-play architecture to compare various methods under consistent settings. In addition, it offers an analytical interface for comparison across multiple metrics. Using UIBenchKit, we conduct a benchmarking study of existing tools and derive several findings that highlight directions for future improvement. By providing a streamlined environment for both experimentation and evaluation, UIBenchKit aims to accelerate future benchmarking and innovations in web engineering. The evaluation platform and toolkit are available at the project page https://www.uibenchkit.com/ . 1. Introduction The translation of visual user interface (UI) mockups into functional front-end implementations (referred to as UI2Code or design-to-code ), sits at the intersection of design and web development. This step remains challenging and costly, as it demands visual fidelity and correct implementation while coordinating designers and developers. Recently, Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in directly generating structured HTML and CSS from visual inputs, catalyzing a wave of both research and commercial interest in this area. In the commercial space, dedicated UI2Code products including Vercel’s v0, Lovable, Bolt.new, and Figma, have collectively attracted millions of active users ( 4 ) . On the research front, a growing body of work has emerged on UI2Code, spanning methods that improve generation quality ( 10 ; 3 ; 2 ; 11 ) , benchmarks that evaluate model performance ( 8 ) , and recent efforts that extend UI2Code generation from static UI mockups to interactive webpages ( 12 ) . Despite this rapid progress, there is a lack of a standardized evaluation toolkit for UI2Code research. Individual evaluations are tightly coupled to specific LLM backbones, configurations, and prompts ( 8 ; 10 ; 11 ) . Moreover, there is also no unified evaluation metric. Without a standardized pipeline, it is unclear whether reported improvements reflect stronger methods or simply differences in prompts or evaluation protocols. As a result, this makes it difficult for practitioners and researchers to choose and compare tools. We believe that a reliable evaluation platform for UI2Code must satisfy several key requirements. First, it must be modularized to isolate the effects of different factors, thereby enabling controlled and reproducible experiments. Second, it has to be extensible to incorporate new benchmarks and methods. Third, given the complexity of UI2Code evaluation, which spans visual, structural, and textual evaluation metrics ( 8 ; 11 ) , the platform should provide a data analytical interface to help practitioners compare tools. Figure 1. UIBenchKit System Architecture Design A block diagram illustrating the system architecture, showing the flow of data from the input module through the processing layers to the final output generation. To address these needs, we build UIBenchKit , a unified and extensible toolkit for developing, reproducing, and benchmarking design-to-code methods. UIBenchKit abstracts the end-to-end workflow into modular components. It encompasses integration with various MLLMs, method execution, and evaluation. This allows users to test and compare multiple methodologies through a simple interface. We envision that UIBenchKit enables more transparent and reproducible evaluation of UI2Code frameworks in future research. In summary, UIBenchKit makes three main contributions. (1) A unified execution framework for UI2Code research. UIBenchKit provides a standardized pipeline for evaluating design-to-code tools across datasets, backbone LLMs, and methodologies. It handles dataset preparation, method execution, and output generation through a unified interface. (2) An analytical interface for multi-dimensional comparison. UIBenchKit provides a reporting and visualization interface that helps users inspect generated outputs and compare methods across multiple dimensions. (3) A large-scale benchmarking study. Using UIBenchKit, we benchmark 16 models, 5 methodologies, and 2 datasets, which total to 832 instances under a unified setting, yielding a comprehensive view of current performance in terms of visual fidelity, structural accuracy, and computational overhead. 2. The Design of UIBenchKit 2.1. System Architecture Figure 1 illustrates UIBenchKit’s end-to-end evaluation system. The evaluation begins with the Dataset Manager , which prepares benchmark datasets or custom screenshot folders into a shared input format. This ensures that all methods operate on the same input structure and preprocessing conventions. After the inputs are normalized, the Run Orchestrator records the experiment configuration, tracks the progress for each instance, and stores the generation outputs and metadata. This provides reproducibility and supports recovery for long-running or failure-prone benchmark runs. During execution, the Method Dispatcher route prepared inputs to various UI2Code models. Although the methods differ in decomposition, generation, and assembly strategies, UIBenchKit exposes them through a common execution interface. For each LLM call made by a selected method, UIBenchKit abstracts provider-specific inference details such as input formatting, API calls, backend routing, and token accounting. This allows a method to be easily evaluated across different MLLM families. Once the method produces HTML, the Post-processing and Evaluation layer renders the generated code into screenshots using Playwright and applies an extensible set of evaluation metrics. 2.2. Tool Implementation Our implementation of UIBenchKit consists of two main modules: • Backend API : The core execution engine is implemented in Python using Flask ( 7 ) . It serves as the entry point for run submission, status tracking, and artifact access. • Web Frontend : For interactive use, UIBenchKit provides a browser-based frontend implemented as a Single Page Application using React ( 5 ) , TypeScript ( 6 ) , and Tailwind CSS ( 9 ) . This interface allows users to upload screenshots or benchmark-style folders, select models and methods, inspect generated outputs, and review evaluation results. 2.3. Reproducing Benchmark Runs UIBenchKit supports reproducible experiments through a shared CLI and REST API workflow. Users specify an input source, target model, and generation method, then submit the run through a unified interface. During execution, UIBenchKit exposes status polling and stores intermediate artifacts, allowing users to monitor progress and recover incomplete runs. Upon completion, it returns a consolidated report containing configurations, generated HTML, rendered screenshots, token statistics, and evaluation scores. 2.4. Data Analytical Interface UIBenchKit provides an analytical reporting module for interpreting evaluation results across models and methods. Upon run completion, the toolkit aggregates data into a unified report supporting multi-dimensional comparisons across models and methods. Users can compare model-method combinations across visual similarity, structural accuracy, fine-grained UI matching, and computational overhead. Crucially, the interface links quantitative metrics directly to underlying artifacts, such as input screenshots, generated HTML, and rendered webpages. This traceability allows users to determine not just which method excels, but why specific failures occur. The interface module complements the execution framework and delivers actionable insights for researchers and practitioners. Figure 2. UIBenchKit Graphical User Interface UIBenchKit Graphical User Interface 3. User Demo of UIBenchKit To complement the CLI and API workflows for large-scale experiments, UIBenchKit provides a lightweight web interface tailored for quick exploratory analysis and qualitative