MAVEN: A Multi-Agent Framework for Multicultural Text-to-Video Generation
Shuowei Li, Yuming Zhao, Parth Bhalerao, Oana Ignat · 2026
Read MAVEN: A Multi-Agent Framework for Multicultural Text-to-Video Generation by Shuowei Li, Yuming Zhao, Parth Bhalerao, Oana Ignat (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16716.txt.
Introduction
Li, Zhao, Bhalerao and Ignat launch MAVEN, a multi-agent system that refines text-to-video prompts for cultural fidelity. It splits prompts into person, action, and location parts, handled by expert agents in parallel or in sequence. A new test set of 243 culturally grounded prompts and 972 videos covers single-culture and cross-culture settings. Multi-agent refinement, notably joint work by specialists, improves cultural relevance while preserving visual quality and timing consistency.
Catalog record
| CREATOR | Shuowei Li, Yuming Zhao, Parth Bhalerao, Oana Ignat |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40713 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.16716
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MAVEN: A Multi-Agent Framework for Multicultural Text-to-Video Generation Shuowei Li, Yuming Zhao, Parth Bhalerao, Oana Ignat Abstract Text-to-video (T2V) generation has rapidly progressed in visual fidelity, yet its ability to faithfully represent multiple cultures within a single prompt remains underexplored. We introduce MAVEN , a multi-agent prompt refinement framework designed to improve cultural fidelity in both mono-cultural and cross-cultural T2V generation. MAVEN decomposes prompts into person , action , and location dimensions, handled by specialized agents operating in parallel or sequentially. To support systematic evaluation, we contribute a new benchmark of 243 culturally grounded prompts and 972 corresponding videos, spanning three cultures (Chinese, American, Romanian), three action categories, and both mono-cultural and cross-cultural scenarios. Evaluations combining CLIP-based metrics, VLM-as-judge assessments, and video quality measures show that multi-agent refinement, particularly parallel specialization, significantly improves cultural relevance while preserving visual quality and temporal consistency. The dataset, prompts, generated metadata, and code are available at https://github.com/AIM-SCU/MAVEN . 1 Introduction Text-to-video (T2V) generation has rapidly advanced 31 ; 22 ; 18 , shifting the central challenge from visual realism alone to semantic faithfulness . Among these dimensions, cultural grounding , how people, actions, and places are represented with respect to specific cultures, remains both critically important and insufficiently understood. While prior work has documented systematic cultural gaps in language and image models 14 ; 15 ; 11 , the video setting, where cultural content must remain coherent across both space and time, has received almost no dedicated study; to our knowledge, this work is among the first to systematically frame multicultural T2V generation as a problem in its own right. Figure 1: Overview of MAVEN : agent-based prompt refinement pipelines feeding a fixed T2V model. Culture is inherently compositional: a person from one cultural background may perform an action associated with another culture in a location tied to a third. Such cross-cultural scenarios parallel the composition problem studied in image transcreation 12 and matter for downstream uses such as inclusive content creation and accessibility. Yet current T2V benchmarks overwhelmingly assume mono-cultural prompts 9 ; 5 , implicitly treating culture as a single uniform attribute, and most T2V systems convey all cultural information through a single prompt or refinement agent, even though person appearance, action execution, and location depiction each draw on distinct forms of cultural expertise. Building on recent multi-agent T2V frameworks 32 ; 24 , we introduce MAVEN ( M ulti- A gent V ideo E nrichment for cultural N arrative), which decomposes cultural grounding into three core dimensions, person , action , and location , each handled by a culturally specialized agent that enriches prompts before video generation. We evaluate on a benchmark of 243 prompts and 972 videos spanning three cultures, three action categories, and both mono-cultural and cross-cultural configurations (Section 3 ), using CLIP-based metrics 19 , VLM judgments of cultural relevance 15 , and video quality assessments 16 . Concretely, we organize our investigation around three research questions: • RQ1. Can multi-agent prompt refinement substantively improve cultural fidelity in T2V generation, and does it close the gap between mono-cultural and cross-cultural prompts? • RQ2. How does the choice of agent communication structure, specifically parallel specialization versus sequential refinement, affect cultural fidelity, visual quality, and temporal consistency? • RQ3. To what extent do CLIP-based automatic metrics agree with VLM-based judgments of cultural relevance, and what does any disagreement reveal about the limits of current T2V evaluation? 2 Related Work Cultural Understanding in LLMs and VLMs. Cultural gaps have been documented in both LLMs 14 ; 13 and vision–language models 15 ; 11 ; 17 , pointing to systematic knowledge gaps driven by sparse geographic coverage in training data. Culturally grounded evaluation has been extended to multilingual visual question answering 20 and to multicultural image generation, where multi-agent frameworks with cultural personas have been shown to improve cross-cultural depiction in static images 3 . Our work shares these concerns but identifies two further limitations: (1) cultures are studied independently, with no existing work modeling cross-cultural composition , i.e., combining person, action, and location from distinct cultural sources within a single generation; and (2) all prior work focuses on static image understanding or generation, leaving the temporal consistency challenges unique to video entirely unaddressed. Multi-Agent Text-to-Video Generation. Multi-agent frameworks for T2V generation decompose generation into specialized subtasks, including end-to-end agent coordination 32 , film-crew simulation 28 ; 27 , cross-shot protagonist consistency 8 , and script-writing alignment 24 . A related line of work pursues LLM-guided prompt refinement for T2V along non-cultural axes 29 ; 10 ; 6 ; 30 . We follow these frameworks in decomposing generation into specialized subtasks, but reorient agent roles from production (director, editor, keyframe artist) to cultural dimensions (person, action, location), enabling systematic study of both mono- and cross-cultural fidelity within a single prompt. Cultural Text-to-Video Benchmarks. Existing benchmarks for cultural T2V evaluation cover scenario-level cultural fairness 9 ; 25 , geo-cultural bias in city landscapes 4 , attribute-object-action compositionality 21 , and deep cultural knowledge integration 5 . However, none address cross-cultural composition, where person, action, and location originate from distinct cultures in a single system; our benchmark and framework directly target this gap. 3 Dataset A central contribution of this paper is a new benchmark for culturally grounded T2V evaluation. The benchmark comprises 243 unique prompts (Table 1 ); passing each through the four refinement pipelines (Base, SA, MAS, MAP; Section 4 ) yields 972 generated videos. The cross-cultural split is intentionally twice the mono-cultural split, since cross-cultural composition is the central novelty of our benchmark and the regime where current T2V models fail most clearly. Cultures and actions. We span three cultures ( Chinese , American , Romanian ) chosen for geographic and linguistic distinctness, and three action categories ( food , music , dance ) chosen for visual distinctiveness and the existence of clearly filmable cultural variants. Each (culture \times category) pair contributes 3 actions and each culture contributes 3 landmarks; the full list is given in Table 2 . Prompt construction. Prompts follow the template “ P A at L ” (person, action, location). Mono-cultural prompts fix all three roles to a single culture, yielding 3\times 3\times 3\times 3=81 prompts. Cross-cultural prompts draw P , A , L from three distinct cultures ( c_{p}\neq c_{a}\neq c_{l} ), yielding 3!\times 3\times 3=162 prompts. A representative example is “an American person eating dumplings at Bran Castle” ( P =American, A =Chinese, L =Romanian), which requires rendering three distinct cultural sources within a single video. Component Count Cultures (Chinese, American, Romanian) 3 Action categories (food, music, dance) 3 Actions per (culture \times category) 3 Distinct actions 27 Landmarks per culture 3 Distinct landmarks 9 Mono-cultural prompts 81 Cross-cultural prompts (novel) 162 Total unique prompts 243 Refinement pipelines (Base, SA, MAS, MAP) 4 Total generated videos 972 Duration per video (seconds) 5 Total video duration (minutes) 81 Table 1: MAVEN benchmark statistics. The cross-cultural split is intentionally 2\times the mono-cultural split, since cross-cultural composition is the central novelty of our benchmark. Category Items Chinese Food Peking duck, mooncakes, dumplings Music guzheng, erhu, dizi Dance fan dance, ribbon dance, umbrella dance Locations Forbidden City, West Lake, Potala Palace American Food hot dogs, burgers, pizza slice Music