V-Stylist: Video Stylization via Collaboration and Reflection of MLLM Agents

Zhengrong Yue, Shaobin Zhuang, Kunchang Li, Yanbo Ding, Yali Wang · 2025

Read V-Stylist: Video Stylization via Collaboration and Reflection of MLLM Agents by Zhengrong Yue, Shaobin Zhuang, Kunchang Li, Yanbo Ding, Yali Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-12077.txt.

Introduction

Zhengrong Yue and co-authors introduced this 2025 system that restyles videos to match a user's open-ended request. Older tools struggle with videos that cut between scenes and with vague style wishes. Their system, V-Stylist, splits the job among three AI agents that work and reflect like a human crew. Each agent is a large model that reads images and text.

A video parser chops the film into shots and captions each one. A style parser searches a tree of style models to pin down the user's wish. A style artist then renders every shot, checking its own work over several rounds and adjusting detail. The design mimics how professionals divide such work, and the team built a new benchmark to grade it.

Catalog record

CREATORZhengrong Yue, Shaobin Zhuang, Kunchang Li, Yanbo Ding, Yali Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-12077

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

V-Stylist: Video Stylization via Collaboration and Reflection of MLLM Agents Zhengrong Yue, Shaobin Zhuang, Kunchang Li, Yanbo Ding, Yali Wang Abstract Despite the recent advancement in video stylization, most existing methods struggle to render any video with complex transitions, based on an open style description of user query. To fill this gap, we introduce a generic multi-agent system for video stylization, V-Stylist , by a novel collaboration and reflection paradigm of multi-modal large language models. Specifically, our V-Stylist is a systematical workflow with three key roles: (1) Video Parser decomposes the input video into a number of shots and generates their text prompts of key shot content. Via a concise video-to-shot prompting paradigm, it allows our V-Stylist to effectively handle videos with complex transitions. (2) Style Parser identifies the style in the user query and progressively search the matched style model from a style tree. Via a robust tree-of-thought searching paradigm, it allows our V-Stylist to precisely specify vague style preference in the open user query. (3) Style Artist leverages the matched model to render all the video shots into the required style. Via a novel multi-round self-reflection paradigm, it allows our V-Stylist to adaptively adjust detail control, according to the style requirement. With such a distinct design of mimicking human professionals, our V-Stylist achieves a major breakthrough over the primary challenges for effective and automatic video stylization. Moreover, we further construct a new benchmark Text-driven Video Stylization Benchmark (TVSBench), which fills the gap to assess various stylization of complex videos on open user queries. Extensive experiments show that, V-Stylist achieves the state-of-the-art, e.g.,V-Stylist surpasses FRESCO and ControlVideo by 6.05% and 4.51% respectively in overall average metrics, marking a significant advance in video stylization. 1 Introduction Figure 1 : Overview. V-Stylist is a multi-agent system for complex video stylization with open user query. It contains three key roles to address the primary challenges in video stylization. Video Parser decomposes a video into several shots and prompts, via a video-to-shot prompting paradigm. Style Parser finds the most suitable stylization model, via a tree-of-thought searching paradigm. Style Artist adaptively adjusts detail control for preferable shot rendering, via a multi-round style reflection paradigm. † † {\dagger} Corresponding author. Video stylization is a classic and important topic in computer vision, which has widespread applications in the real world, such as art design, education training, advertising, etc. In the recent years, with the fast development of text-to-image generation [ 21 , 48 , 43 , 45 , 42 ] , the advancement of video stylization has been mainly driven by diffusion models [ 13 , 54 , 34 , 18 , 3 , 39 , 32 , 68 , 5 , 58 , 31 , 8 ] , for making a video with the required style of user query. However, the current approaches encounter three principal challenges in video stylization. (1) Complex Video Transitions. Most existing methods are designed for processing short video clips with only a few seconds. However, the videos in our real life often contain complex scene transitions with significant motions in a longer period, e.g., the original animated basketball video consists of three distinct scenes in Fig. 1 . In such a case, these methods are often infeasible or deteriorate significantly for stylization. (2) Vague Style Preference. Typically, most existing methods directly use the user query as text prompt for style control. However, we notice that the general users are often not the professional artists. Their queries are often ambiguous descriptions on style preference, e.g., the user query is “This Japanese anime movie would be more appealing if it was performed by real people” in Fig. 1 , which contains both anime movie and real people but without explicit expression of exact style tag. Such open prompts would mislead the models for poor stylization. (3) Fixed Detail Control. Different styles necessitate different levels of control over spatial structure detail. For instance, the animation style favors strict line structure control, while the oil painting style prefers less rigid structure control for greater creative freedom. However, most current approaches ignore such an adaptive property, and blindly control details with the fixed weight setting on a set of ControlNets. This would lead to low-level visual distortion or high-level character shifting in the stylized videos. Hence, there is a natural question: is it possible to automatically and precisely make any video into any style in the user query? To answer this question, we attempt to observe how video editors work in our realistic world. We notice that, video stylization is a complex workflow which typically involves three important stages: video shot parsing, style type selecting, video style rendering [ 69 ] . Inspired by this observation, we think that video stylization requires systematical video understanding and distinct style analyzing, instead of developing a single generative model. To this end, we propose to design a generic AI agent system for video stylization, V-Stylist , which can effectively render any video into the required style in the open query of user, by mimicking video professionals with a collaborative pipeline of Multi-modal Large Language Models (MLLMs). Specifically, our V-Stylist consists of three critical roles, as shown in Fig. 1 . (1) Video Parser . To handle complex video transitions, we introduce a concise video-to-shot prompting paradigm. First, we leverage a shot detector to decompose the input video into a number of shots, according to video transitions. Then, we employ a shot captioner to describe the key content of each shot. Finally, we use a shot translator to convert the detailed caption of each shot into its corresponding prompt, which is used as textual condition in the generation model to maintain content consistency in the stylization of each shot. Based on such a top-down design, video parser can effectively address videos with various transitions, by stylizing each shot with its content prompt. (2) Style Parser . To tackle vague style preference, we introduce a robust tree-of-thought searching paradigm. First, we leverage Large Language Model (LLM) as a style identifier, in order to parse the specific style from the open description of user query. Second, we need to develop a generation model that is used to transform the video into the required style. However, directly training such a model with the style prompt is problematic, due to no training samples on hand for a general user. Alternatively, we notice that, in the AI community like huggingface [ 14 ] and civitai [ 7 ] , there exist a number of open-source diffusion models that are well-pretrained on various styles. Hence, instead of training a model, we propose to build a style tree for searching the model, according to dependency of various styles. Specifically, we leverage LLMs as experts and progressively decide how to move in the tree via experts discussion. Such a tree-of-thought searching manner allows to robustly find the model that effectively matches the required style of user query, alleviating difficulty of vague style preference. (3) Style Artist . To deal with fixed structure control, we develop a style artist with a novel multi-round self-reflection mechanism on the stylized video. Given a video shot and its content prompt, we first leverage the matched model to stylize it. To control

Read the complete text