KGEdit: Ambiguity-Aware Knowledge Graphs for Training-Free Precise Video Generation and Editing
Mingshu Cai, Miao Zhang, Chenghe Yang, Yixuan Li, Osamu Yoshie, and Yuya Ieiri · 2026
Read KGEdit: Ambiguity-Aware Knowledge Graphs for Training-Free Precise Video Generation and Editing by Mingshu Cai, Miao Zhang, Chenghe Yang, Yixuan Li, Osamu Yoshie, and Yuya Ieiri (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29509.txt.
Introduction
Mingshu Cai and five colleagues propose KGEdit, a control method sharpening training-free video generation and editing from written prompts. Vague wording, wrongly bound concepts, and flickering consistency across frames still trip existing methods. KGEdit first turns a prompt into an ambiguity-aware knowledge graph separating identity, relations, attributes, and negative constraints. An injection step feeds those signals into key layers of the video diffusion model, while a timing step schedules them across generation steps. Tests report better editing precision and steadier frame-to-frame behavior than existing methods.
Catalog record
| CREATOR | Mingshu Cai, Miao Zhang, Chenghe Yang, Yixuan Li, Osamu Yoshie, and Yuya Ieiri |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43267 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.29509
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
KGEdit: Ambiguity-Aware Knowledge Graphs for Training-Free Precise Video Generation and Editing Mingshu Cai, Miao Zhang, Chenghe Yang, Yixuan Li, Osamu Yoshie, and Yuya Ieiri Abstract In recent years, training-free video generation has progressed remarkably. However, when handling complex textual instructions, existing methods still suffer from semantic ambiguity, incorrect concept binding, and cross-frame inconsistency. To address these issues, we propose KGEdit, a structured semantic control framework for text-to-video (T2V) diffusion models. Specifically, we first construct an ambiguity-aware knowledge graph (AAKG) to disentangle and disambiguate the input prompt, converting it into four types of structured semantics: identity, relation, attribute, and negative constraints. We then design a structured semantic injection module (SSIM) to inject these semantic signals into key layers of the diffusion Transformer, enabling fine-grained semantic control. In addition, we introduce a temporal-aware semantic control (TASC) module that dynamically schedules semantic objectives according to the stage-wise characteristics of the denoising process, further improving semantic alignment and temporal consistency. Experiments show that KGEdit outperforms existing methods in editing precision and temporal stability, while offering higher efficiency and controllability in text-driven interaction scenarios. † † aftertitle: Fig. 1. Our model is a unified video generation and editing framework that, through semantic disambiguation and precise attribute injection, can produce highly fine-grained and well-aligned video results within only a few rounds of user interaction. I Introduction With the rapid development of diffusion models and large-scale video generative models, video generation and editing have achieved remarkable progress in recent years [ 17 , 39 , 24 , 34 , 38 , 2 , 52 , 26 , 14 , 7 ] . The research paradigm has gradually evolved from early text-to-video generation toward more complex and flexible settings, including reference-image-guided generation, reference-video-guided generation, region-level control, and multi-condition compositional editing [ 50 , 54 , 46 , 8 , 48 , 30 , 36 , 13 , 10 , 5 , 12 , 33 ] . This trend has further promoted the development of unified video creation frameworks, making it possible for a single model to support diverse tasks [ 23 , 49 ] , while also broadening the creative freedom and application potential of video content creation in domains such as advertising, animation, and gaming [ 9 , 51 , 53 , 22 ] . Although existing methods have expanded task coverage and improved generation quality, and recent studies have evolved from task-specific pipelines toward unified video creation frameworks [ 23 , 49 ] , text remains the fundamental, natural, and accessible input modality for video generation and editing. Stronger control signals, such as reference videos, local masks, or sparse guidance, are introduced only when needed [ 23 , 49 , 12 , 33 ] . However, natural language is inherently ambiguous, underspecified, and coarse-grained, especially when requests involve identity, appearance, motion, local-region modifications, or joint control of multiple attributes. Existing methods rely on prompts, cross-attention manipulation, or inversion-based guidance [ 30 , 36 , 45 , 27 , 15 ] . Yet these strategies often struggle to explicitly capture the key attributes and semantic relations governing the target video. Under complex instructions, models remain prone to semantic ambiguity, concept misbinding, and temporal instability. Achieving satisfactory results often requires repeated prompt refinement or additional control conditions, increasing both application complexity and inference cost [ 12 , 33 , 55 ] . Despite improving cross-task and cross-modal compatibility [ 23 , 49 ] , unified video creation frameworks still struggle with precise semantic control and temporal stability under complex textual instructions. First, text conditions are usually encoded as holistic semantics rather than explicit structured components such as identity, relations, attributes, and negative constraints. But such structure helps only if it is injected effectively during denoising: naively enforcing semantic supervision throughout diffusion is unreliable, especially at early noisy timesteps, leading to weak attribute injection, concept confusion, and semantic drift [ 30 , 36 , 27 , 15 ] . Second, video generation requires not only plausible frame-level content but also stable propagation of key semantics over time; once control becomes unstable, errors readily accumulate as cross-frame inconsistency, flickering, and drift [ 13 , 10 , 5 ] . Moreover, different semantic components matter at different denoising stages, so uniform guidance cannot simultaneously support early structural grounding, mid-stage relation modeling, and late detail refinement. Therefore, achieving more accurate structured semantic understanding and more stable temporal control during denoising, without additional training, remains a key challenge for practical video generation and editing systems. Motivated by these observations, we propose a training-free structured semantic control framework for text-to-video diffusion models. The core idea is that, rather than continually increasing input modalities or relying on repeated prompt refinement, it is more effective to improve the interpretability and controllability of the textual condition itself. Specifically, we first leverage an ambiguity-aware knowledge graph to disambiguate and structurally organize the key semantics in user instructions, and further decompose them into four semantic groups, namely identity, relation, attribute, and negative constraints, thereby alleviating ambiguity in natural language and highlighting the core semantics that truly determine the target video content [ 3 , 43 , 4 ] . On this basis, we design a structured semantic injection module to inject these structured semantic signals into key layers of the diffusion Transformer in a training-free manner, enabling finer-grained semantic control without additional model adaptation. Furthermore, we introduce a temporal-aware semantic control module, which dynamically schedules different semantic objectives according to the stage-wise characteristics of the denoising process, thereby improving both semantic alignment and temporal consistency. Through this design, our framework is able to produce more accurate, stable, and coherent video results under complex textual instructions. Representative examples are shown in Fig. . Overall, the main contributions of this work are as follows: • We propose KGEdit , a unified training-free framework for structured semantic control in video generation and editing. By improving the interpretability and controllability of textual conditions, KGEdit enables more accurate and temporally stable video generation under complex textual instructions, without requiring additional model training. • We propose an Ambiguity-Aware Knowledge Graph (AAKG) and a Structured Semantic Injection (SSIM) mechanism to achieve structured semantic modeling and fine-grained control for complex textual instructions. These designs improve semantic understanding, semantic alignment, and generation accuracy. • We propose a Temporal-Aware Semantic Control (TASC) module. Through dynamic semantic scheduling over the denoising process, TASC improves the temporal stability of key semantics during video generation. • Extensive experiments verify the effectiveness of the proposed method. The results show that KGEdit outperforms existing methods in overall performance and achieves state-of-the-art results on multiple metrics of the VBench benchmark [ 20 ] . II Related Works II-A Video Generation and Editing. Video generation and editing have advanced rapidly in recent years [ 52 , 12 , 26 , 14 , 33 , 23 , 54 ] , enabling high-quality and controllable content creation for advertising, film, gaming, and animation [ 9 , 51 , 53 , 22 ] . Early studies mainly adapted pretrained T2I diffusion models to the video domain to establish basic T2V generation capabilities [ 2 , 38 ] . Tune-A-Video [ 50 ] was among the first to demonstrate one-shot text-driven video generation by extending pretrained T2I models with tailored