Does Synthetic Layered Design Data Benefit Layered Design Decomposition?
Kam Man Wu Haolin Yang Qingyu Chen Yihu Tang, Jingye Chen Qifeng Chen, [0.15cm] HKUST · 2026
Read Does Synthetic Layered Design Data Benefit Layered Design Decomposition? by Kam Man Wu Haolin Yang Qingyu Chen Yihu Tang, Jingye Chen Qifeng Chen, [0.15cm] HKUST (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15167.txt.
Introduction
Kam Man Wu and five others ask whether purely synthetic layered data can aid graphic design decomposition, which cuts a flat image into foreground, background, and text layers. Old methods lean on scarce proprietary assets or partially synthetic data with weak structure. Building on the CLD baseline, the team creates SynLayers, makes textual supervision with vision-language models, and auto-fills inference inputs with predicted bounding boxes. Their findings test how far synthetic layers alone can carry decomposition quality.
Catalog record
| CREATOR | Kam Man Wu Haolin Yang Qingyu Chen Yihu Tang, Jingye Chen Qifeng Chen, [0.15cm] HKUST |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52225 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.15167
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Does Synthetic Layered Design Data Benefit Layered Design Decomposition? Kam Man Wu Haolin Yang Qingyu Chen Yihu Tang, Jingye Chen Qifeng Chen, [0.15cm] HKUST Abstract Recent advances in image generation have made it easy to produce high-quality images. However, these outputs are inherently flattened, entangling foreground elements, background, and text within a fixed canvas. As a result, flexible post-generation editing remains challenging, revealing a clear last-mile gap toward practical usability. Existing approaches either rely on scarce proprietary layered assets or construct partially synthetic data from limited structural priors. However, both strategies face fundamental challenges in scalability. In this work, we investigate whether pure synthetic layered data can improve graphic design decomposition. We make the simplifying assumption that, in graphic design, effective decomposition does not require modeling inter-layer dependencies as precisely as in natural-image composition, since design elements are often intentionally arranged as modular and semantically separable components. Concretely, we conduct a data-centric study based on CLD baseline, which is a state-of-the-art layer decomposition framework. Based on the baseline, we construct our own synthetic dataset, SynLayers, generate textual supervision using vision language models, and automate inference inputs with VLM-predicted bounding boxes. Our study reveals three key findings: (1) even training with purely synthetic data can outperform non-scalable alternatives such as the widely used PrismLayersPro dataset, demonstrating its viability as a scalable and effective substitute; (2) performance consistently improves with increased training data scale, while gains begin to saturate at around 50K samples; and (3) synthetic data enables balanced control over layer-count distributions, avoiding the severe layer-count imbalance commonly observed in real-world datasets. We hope this data-centric study encourages broader adoption of synthetic data as a practical foundation for layered design editing systems. We make the code publicly available at GitHub . 1 Introduction Graphic design plays a central role in modern content creation, including advertising, social media campaigns, presentations, and digital publishing. As visual generative models continue to mature, they have drawn increasing attention to the last mile of practical editing and controllability ( 54 ; 44 ; 51 ) . In practice, designers compose content in layers using tools such as Adobe Photoshop or PowerPoint, but the exported result is typically a single raster image in which foreground elements, background, and text are flattened together ( 40 ) . Consequently, subsequent edits often require manual effort, while generative editing ( 13 ; 32 ; 22 ; 3 ) can be unstable and may fail to preserve the geometry and semantics of unchanged regions, even for simple operations such as background flipping or text resizing ( 4 ; 8 ; 39 ) . These limitations motivate graphic design decomposition, which aims to recover editable RGBA layers from raster images for reliable and fine-grained control. In this case, graphic design decomposition can be viewed as the “last mile” that bridges image generation and user-editable outputs, and has recently attracted growing attention from the research community ( 40 ; 50 ; 34 ) . Existing approaches typically rely on limited amounts of real, non-synthetic graphic design data ( e.g. , Crello with around 20K samples) or on partially synthetic datasets such as PrismLayersPro with 20K samples, in which layout boxes are derived from real designs. At the same time, visual assets are generated by image models. However, these dataset sizes remain orders of magnitude smaller than those commonly used in modern generative modeling—for instance, text-to-image models are often trained on billions of samples ( e.g. , LAION-5B ( 38 ) ). This contradicts established scaling laws ( 25 ; 15 ) , and models trained on limited data often lack robustness and generalization. Therefore, a promising alternative is to leverage fully synthetic data, an approach that has demonstrated effectiveness across many domains ( 11 ; 31 ) . Yet its potential for layer decomposition remains largely unexplored. In this work, we aim to fill this gap by investigating whether purely synthetic layer data can effectively benefit graphic design decomposition. Figure 1 : Comparison between fully synthetic graphic-design data from SynLayers and non/partially-synthetic counterparts. In this paper, we explore whether synthetic layer data can help train effective layer decomposition models. We show only four layers from the decomposition results due to limited space. To answer this question, we propose SynLayers. We carefully design a synthetic data pipeline in which graphic design layers are composed from multiple sources, and conduct a comprehensive data-centric study. Building on the representative state-of-the-art layer decomposition method, CLD ( 29 ) , we systematically investigate the role of synthetic data in this task. Specifically, we design layer composition rules to construct diverse synthetic samples. Figure 1 shows the advantages of SynLayers. We further fine-tune a VLM to generate high-quality captions for our constructed synthetic data, providing additional semantic supervision for layer decomposition. Through extensive experiments, our data-centric study aims to answer the following questions: • Can synthetic data serve as a viable alternative to non-/partially synthetic datasets? Yes. With the same amount of training data (18K samples), synthetic data achieves comparable or better performance on most metrics, with improvements in both layer PSNR (+1.01) and composite PSNR (+0.83), indicating stronger reconstruction quality at both the layer and image levels. • Does synthetic data follow scaling laws, i.e., does performance improve consistently with increased data size? No. Performance does not improve monotonically with more synthetic data. For example, the best results are achieved at medium scales, with Layer FID reaching 5.97 at 20K and Composite FID reaching 10.35 at 30K. • Does synthetic data improve training stability regarding distribution balance? Yes. Synthetic data yields more robust performance across different layer counts. It consistently outperforms the baseline across different layer-count settings, with more gains in challenging cases. For example, when the number of layers is between 13 and 35, Mask IoU improves from 0.901 to 0.910, and Composite PSNR improves from 29.48 to 30.25. We hope this study demonstrates that synthetic data is a practical and scalable option for training layer-decomposition models and encourages its use in building more reliable and controllable graphic design editing systems. 2 Related Works 2.1 Layered Image Decomposition Layered image decomposition separates raster images into editable RGBA layers, enabling flexible reconstruction and modification. Several research works 28 ; 27 ; 30 ; 24 ; 17 ; 53 ; 52 ; 9 ; 18 focus on this problem. For example, LayerD ( 40 ) employs iterative matting and inpainting but offers limited user control, while Accordion ( 6 ) utilizes VLMs and SAM ( 26 ) in a top-down pipeline to recover layers from flattened AI-generated designs. Bottom-up and layout-aware approaches include COLE ( 21 ) and Open-COLE ( 19 ) , which cascade LLMs with diffusion models, and Composition-Aware Graphic LayoutGAN ( 55 ) , which learns structural priors for visual-textual arrangements. Recently, diffusion-based models such as Qwen-Image-Layered ( 50 ) have introduced variable-length disentanglement via RGBA-VAE and VLD-MMDiT. However, it suffers from high inference latency due to the heavy diffusion design. Notably, CLD ( 29 ) , which is built on top of ART 37 , introduces LD-DiT and MLCA components for bounding-box-guided decomposition, offering an efficient alternative to heavier diffusion design. Given the trade-off between controllability and computational efficiency, we adopt CLD as our basic