EcoVideo: Entropy-Orchestrated Video Generation Paradigm in Cloud-Edge Dynamics
Jiayu Chen *, Hengyi Zhang *, Maoliang Li, Minyu Li, Zihao Zheng, Xuanzhe Liu, Guojie Luo, Xiang Chen † \dagger · 2026
Read EcoVideo: Entropy-Orchestrated Video Generation Paradigm in Cloud-Edge Dynamics by Jiayu Chen *, Hengyi Zhang *, Maoliang Li, Minyu Li, Zihao Zheng, Xuanzhe Liu, Guojie Luo, Xiang Chen † \dagger (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30557.txt.
Introduction
EcoVideo, a system for faster video generation released in 2026, comes from Jiayu Chen and seven colleagues. Video models built on diffusion transformers, which clean up noisy frames step by step, are slow because every frame gets full treatment. Earlier cloud-edge splits divided denoising steps between a big cloud model and a small edge model, yet ignored how alike neighbouring frames are.
Chen's group instead splits by frames. Early attention patterns, measured through entropy, a gauge of information density, show which frames carry most detail and need full cloud processing. The light edge model rebuilds the rest by motion-aware interpolation, tracking movement between frames. The system also adjusts its keyframe count and edge refinement depth to live bandwidth and computing power. Tests showed speedups up to nearly three times in low-bandwidth, compute-limited settings, with better quality trade-offs.
Catalog record
| CREATOR | Jiayu Chen *, Hengyi Zhang *, Maoliang Li, Minyu Li, Zihao Zheng, Xuanzhe Liu, Guojie Luo, Xiang Chen † \dagger |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.30557
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
EcoVideo: Entropy-Orchestrated Video Generation Paradigm in Cloud-Edge Dynamics Jiayu Chen *, Hengyi Zhang *, Maoliang Li, Minyu Li, Zihao Zheng, Xuanzhe Liu, Guojie Luo, Xiang Chen † \dagger Abstract DiT video generation is latency-intensive due to iterative full-frame denoising, while prior cloud-edge methods largely rely on static inter-step decoupling and cannot leverage inter-frame similarity or adapt to system dynamics. We propose EcoVideo , an entropy-orchestrated framework for dynamic inter-frame decoupling : early-stage self-attention entropy provides a training-free estimate of frame-wise information density for frame selection; a cloud large model denoises sparse high-entropy keyframes; and an edge lightweight model reconstructs the remaining frames via motion-aware interpolation with refinement for temporal stability. EcoVideo further adapts the keyframe budget and edge refinement depth to real-time bandwidth and compute availability, optimizing end-to-end latency under constraints. Experiments on representative DiT video generators show improved quality–efficiency trade-offs and up to 2.9 × \times end-to-end speedup in low-bandwidth, compute-limited edge settings. Code is available at https://github.com/IF-LAB-PKU/EcoVideo . Figure 1 : A comparison between inter-step decoupling (HybridSD) and inter-frame decoupling paradigms (ours). 1 Introduction In recent years, Diffusion Transformer (DiT) [ 22 , 19 ] based video generation models [ 23 , 32 ] have achieved remarkable progress in visual fidelity and spatiotemporal coherence. However, the DiT paradigm is inherently built upon step-by-step full-frame denoising [ 9 ] , which introduces a severe computational bottleneck and makes large-scale video generation services difficult to deploy in practice. To relieve the computation pressure, recent studies [ 18 , 4 , 30 , 29 ] have started to explore a cloud-edge collaborative generation paradigm. Representative works such as HybridSD [ 30 ] and EC-Diff [ 29 ] attempt to decouple inter-step dependencies in generation: a large model on the cloud performs early denoising steps to establish the semantic layout, while a small model on the edge completes the remaining refinement steps. Although promising, existing inter-step decoupling paradigms exhibit intrinsic limitations in practice, as shown in the left of Fig. 1 . Algorithmically, the small edge model often lacks sufficient denoising capability. Due to the limited denoising capacity of the small edge model, the late-stage denoising tends to overly smooth the video, often leading to informative frame artifacts such as texture flickering and detail collapse. More critically, inter-step decoupling implicitly assumes that every frame is equally important. Even when adjacent frames are highly similar, the pipeline still repeats nearly identical denoising processes frame by frame, leading to substantial redundant computation along the temporal dimension. Systemically, real-world cloud-edge environments are highly dynamic: fluctuations in network bandwidth and variations in cloud and edge resources cause the optimal workload partition to change over time. Therefore, a static inter-step decoupling paradigm cannot adapt, resulting in unstable or even degraded end-to-end efficiency in practice. Furthermore, we argue that the above issues provide three key insights into optimizing decoupled video generation under dynamic cloud–edge environments, as shown in the right of Fig. 1 . Insight 1: Inter-step decoupling overlooks inter-frame sparsity, leading to inefficient generation. Unlike inter-step decoupling , which still produces many similar and redundant frames, one must identify inter-frame differences and sparse information density along the temporal dimension. The decoupling paradigm should online localize keyframes that capture critical motion changes or structural transitions, thereby avoiding redundant per-frame generation in the cloud. Insight 2: Inter-frame decoupling video generation can be enabled by information reorganization and reuse. When the large cloud model generates only some frames to compress workload, the small edge model synthesis of intermediate frames [ 6 , 36 ] must reuse generated frame-conditioned cues to minimize temporal information loss between the edge and cloud outputs, preserving motion trajectories, structural boundaries, and texture details, and preventing flicker or abrupt temporal detail shifts. Insight 3: Inter-frame decoupling need adapt to cloud–edge dynamics. Given time-varying system conditions (e.g., network bandwidth and compute capability), the decoupling paradigm should adaptively allocate generative workloads across the cloud and edge. This enables closed-loop, end-to-end optimization under dynamic cloud-edge environments. Figure 2 : Overview of EcoVideo. Sec 3.1 : Inter-frame attention-entropy analysis estimates information density. Sec 3.2 : Frame-level entropy-orchestrated generation preserves temporal consistency via model collaboration and information reuse. Sec 3.3 : Cloud-edge dynamics-aware decoupling adaptation searches the optimal configuration. Building on these insights, we propose an entropy-orchestrated dynamic cloud-edge video generation paradigm, termed EcoVideo . The key idea is to shift the cloud-edge collaboration perspective from static inter-step decoupling to dynamic inter-frame decoupling and orchestration . Specifically, as shown in Fig. 2 guided by Insight 1 , we use attention entropy as a training-free signal to estimate online frame-wise information density and separate informative frames from low-entropy, highly similar frames, thereby initializing an entropy-based optimization space. Intuitively, lower entropy typically reflects high similarity and temporal redundancy. Guided by Insight 2 , the decoupling is centered on bounding the optimization scope under quality constraints. EcoVideo orchestrates generation in two collaborative stages: Inter-frame Decoupling and Model Collaboration , and Inter-frame Information Reuse and Interpolation . Concretely, the large cloud model denoises only a small set of high-entropy informative frames to anchor the global motion skeleton. Meanwhile, it injects frozen cues from similar frames as temporal-detail context, helping preserve motion trajectories and overall structure. The small edge model then reuses these frame-conditioned cues to synthesize the remaining low-entropy intermediate frames via motion-aware interpolation with greedy refinement, minimizing temporal information loss and effectively mitigating flicker and abrupt temporal-detail drift. Guided by Insight 3 , we further develop a cloud–edge dynamics-aware decoupling adaptation mechanism. By searching the optimization scope for the optimal cloud workload and edge compute depth based on network bandwidth and cloud-edge resources, EcoVideo balances cloud-side workload and end-to-end latency while maintaining runtime temporal coherence. We conduct systematic evaluations of EcoVideo on mainstream DiT model families, including Wan2.1-T2V [ 23 ] , Wan2.2-T2V, and CogVideoX [ 32 ] , using VBench [ 37 ] as the primary metric. Experimental results demonstrate that, compared with HybridSD and EC-Diff, EcoVideo significantly reduces cloud computation and transmission costs, while effectively mitigating temporal detail discontinuities commonly observed in existing cloud-edge methods, such as texture flickering and detail collapse. In low-bandwidth and compute-limited edge scenarios, EcoVideo achieves up to 2.9 \times end-to-end speedup. Contributions. Our main contributions are threefold: • To our knowledge, we are the first to introduce an inter-frame decoupling paradigm into cloud-edge video generation, shifting large-small model collaboration from inter-step model switching to frame-level workload partitioning that exploits temporal redundancy. • We design a training-free inter-frame attention-entropy analysis module that estimates frame-wise information density and identifies high-information keyframes for cloud-side generation. • We propose a frame-level entropy-orchestrated generation framework that preserves temporal consistency through model collaboration and information reuse, and adapts the keyframe budget and edge refinement depth to cloud–edge dynamics, achieving up to 2.9 \times end-to-end speedup. 2 Preliminary and Problem Definition 2.1 Video Diffusion Generation Paradigm Video diffusion models follow a step-by-step full-frame denoising paradigm. During inference, given a conditioning input c , the model first initializes a length- F noise sequence in the video latent space, \mathbf{x}_{T}\in\mathbb{R}^{F\times H\times W\times C} , where each latent feature map corresponds to fixed video frames, and \mathbf{x}_{T}\sim\mathcal{N}(\mathbf{0},\mathbf{I}) . The diffusion model then refines \mathbf{x}_{T} into the target latent \mathbf{x}_{0} through a pre-defined number of denoising steps T