WebGen-Agent: Enhancing Interactive Website Generation with Multi-Level Feedback and Step-Level Reinforcement Learning
Zimu Lu, Houxing Ren, Yunqiao Yang, Ke Wang, Zhuofan Zong, Junting Pan, Mingjie Zhan, Hongsheng Li · 2025
Read WebGen-Agent: Enhancing Interactive Website Generation with Multi-Level Feedback and Step-Level Reinforcement Learning by Zimu Lu, Houxing Ren, Yunqiao Yang, Ke Wang, Zhuofan Zong, Junting Pan, Mingjie Zhan, Hongsheng Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-22644.txt.
Introduction
Zimu Lu and 7 co-authors judge website generation by how the site looks and behaves, not just whether code runs. Code agents get feedback from execution alone, which misses visual quality and interaction flaws. Their agent, WebGen-Agent, collects multi-level feedback from a vision-language model. It writes detailed comments and scores on screenshots, and on tests run by a GUI agent.
Those scores feed a backtracking scheme that keeps the best version so far. The same scores become step-level rewards for training the reasoning model, a method they call Step-GRPO. On a website benchmark, the agent roughly doubled one strong model's accuracy and raised its appearance score. Step-GRPO also lifted a smaller coder model.
Catalog record
| CREATOR | Zimu Lu, Houxing Ren, Yunqiao Yang, Ke Wang, Zhuofan Zong, Junting Pan, Mingjie Zhan, Hongsheng Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-22644
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
WebGen-Agent: Enhancing Interactive Website Generation with Multi-Level Feedback and Step-Level Reinforcement Learning Zimu Lu, Houxing Ren, Yunqiao Yang, Ke Wang, Zhuofan Zong, Junting Pan, Mingjie Zhan, Hongsheng Li Abstract Agent systems powered by large language models (LLMs) have demonstrated impressive performance on repository-level code-generation tasks. However, for tasks such as website codebase generation, which depend heavily on visual effects and user-interaction feedback, current code agents rely only on simple code execution for feedback and verification. This approach fails to capture the actual quality of the generated code. In this paper, we propose WebGen-Agent , a novel website-generation agent that leverages comprehensive and multi-level visual feedback to iteratively generate and refine the website codebase. Detailed and expressive text descriptions and suggestions regarding the screenshots and GUI-agent testing of the websites are generated by a visual language model (VLM), together with scores that quantify their quality. The screenshot and GUI-agent scores are further integrated with a backtracking and select-best mechanism, enhancing the performance of the agent. Utilizing the accurate visual scores inherent in the WebGen-Agent workflow, we further introduce Step-GRPO with Screenshot and GUI-agent Feedback to improve the ability of LLMs to act as the reasoning engine of WebGen-Agent. By using the screenshot and GUI-agent scores at each step as the reward in Step-GRPO, we provide a dense and reliable process supervision signal, which effectively improves the model’s website-generation ability. On the WebGen-Bench dataset, WebGen-Agent increases the accuracy of Claude-3.5-Sonnet from 26.4% to 51.9% and its appearance score from 3.0 to 3.9, outperforming the previous state-of-the-art agent system. Additionally, our Step-GRPO training approach increases the accuracy of Qwen2.5-Coder-7B-Instruct from 38.9% to 45.4% and raises the appearance score from 3.4 to 3.7. We release the WebGen-Agent workflow code, along with the training code, data, and model weights at https://github.com/mnluzimu/WebGen-Agent . † † ∗ Equal contribution † Corresponding author 1 Introduction Recent studies on code agents have shown great advancements in repository-level code-generation tasks, such as fixing GitHub issues ( Yang et al. 2024b ) and implementing new features ( Miserendino et al. 2025 ) . However, for tasks like website code generation, which depend heavily on visual aesthetics and the fluency of user interactions, current code-agent systems fail to fully capture the actual quality of the generated codebase, because they mostly rely on simple code-execution feedback. This limitation can lead to various rendering and functional problems in the generated web applications, such as misaligned components, disharmonious coloring, unresponsive buttons, and broken links. To enable the code agent to effectively handle such tasks, we introduce WebGen-Agent , a code-generation system that generates websites from natural-language instructions that specify appearance and functional requirements, thus offering a highly automated website-development process. To ensure that the generated websites meet both functional requirements and aesthetic standards, we leverage both execution feedback and visual feedback to refine the project. Specifically, we leverage a visual language model (VLM) to assess the visual appeal and aesthetic quality of the current website, and a graphical user interface (GUI) agent to evaluate the correctness and intended functionality of the website’s codebase, thereby gathering accurate information and providing targeted suggestions. By iteratively applying this feedback and editing the codebase, WebGen-Agent builds websites with appealing designs and smooth interactive functionality. As shown in Fig. 1 , WebGen-Agent adopts an iterative, multi-step paradigm in which each step consists of three actions: code generation, code execution, and feedback gathering. The agent begins each step by creating and editing files in the codebase in a manner similar to Bolt.diy ( stackblitz labs 2024 ) . During code execution, dependencies are installed, and the website service is started. If execution emits errors, the errors are returned to the agent, which starts the next step to fix them. If five consecutive erroneous steps occur, the agent backtracks to a previous non-erroneous step. In the feedback-gathering process, a screenshot of the landing page of the website is captured first. A VLM then provides a description and an appearance score based on the screenshot. If the screenshot has room for improvement, the model supplies suggestions, which are implemented in the subsequent step to explicitly refine the website’s visual aesthetics. Otherwise, a GUI-agent session is initiated to explore the website, which evaluates the functional requirements and generates corresponding feedback. If the testing is successful, the task is complete; otherwise, suggestions for fixing the website are generated, and the agent can edit the codebase in the next step. At the end of the task trajectory, the best step is selected on the basis of the screenshot and GUI-agent scores, and the codebase is restored to the state of that step. Based on the pipeline, various models achieve better performance on WebGen-Bench ( Lu et al. 2025b ) , consistently outperforming other code agents. Remarkably, Claude-3.5-Sonnet improves its accuracy from 26.4% to 51.9% and its appearance score from 3.0 to 3.9, outperforming Bolt.diy. To equip code agents with enhanced reasoning abilities, we further propose Step-GRPO with Screenshot and GUI-agent Feedback . Given an instruction, multiple WebGen-Agent trajectories are generated. Each step in an agent trajectory is accompanied by a screenshot score and a GUI-agent testing score, and an accurate and reliable step-level reward can be computed by summing these two scores. This dual supervision of website appearance and functionality effectively optimizes the model to generate high-quality website codebases, providing stepwise, process-level guidance for the agent trajectory. Training a Qwen2.5-Coder-7B-Instruct model with this Step-GRPO approach increases the accuracy from 38.9% to 45.4% and raises the appearance score from 3.4 to 3.7 on WebGen-Bench, greatly improving both the functionality and the appearance of the generated websites. We name the trained family of models WebGenAgent-LM . Our contributions include: • We propose WebGen-Agent, a code-agent system that leverages screenshots and GUI-agent testing to provide feedback signals and iteratively improve the quality of generated websites. • We introduce Step-GRPO with Screenshot and GUI-agent Feedback, which uses screenshots and GUI-agent scores as step-level supervision in the GRPO training process, significantly improving the performance of smaller open-source models. • Extensive experiments demonstrate the effectiveness of the proposed system. The system increases the accuracy of Claude-3.5-Sonnet from 26.4% to 51.9% and its appearance score from 3.0 to 3.9, outperforming Bolt.diy. Our training approach also increases the accuracy of Qwen2.5-Coder-7B-Instruct from 38.9% to 45.4% and raises the appearance score from 3.4 to 3.7. 2 Method In this section, we first introduce WebGen-Agent, a novel website generation system that leverages screenshots and GUI-agent testing as reliable feedback to iteratively refine both the appearance and functionalities of the generated website with a coding LLM. Building on the reliable visual scores produced by WebGen-Agent, we then propose Step-GRPO with Screenshot and GUI-agent Feedback, a method that uses these scores to provide process supervision during GRPO training. This system significantly enhances language models’ ability to generate high-quality websites. 2.1 WebGen-Agent Workflow Figure 1: Iterative website generation with screenshot- and GUI-agent-based feedback. A backtracking and best-step-selection mechanism is applied on the basis of the screenshot and GUI-agent testing scores. The WebGen-Agent workflow consists of multiple steps, with each step including code generation, code execution, and feedback gathering. As shown in Fig. 1 , the agent trajectory starts from a website generation instruction ( \mathcal{I} ), denoted as \mathcal{T}=[\mathcal{I}]