Controllable Layer Decomposition for Reversible Multi-Layer Image Generation

Zihao Liu, Zunnan Xu, Shi Shu, Jun Zhou, Ruicheng Zhang, Zhenchao Tang, Xiu Li · 2025

Read Controllable Layer Decomposition for Reversible Multi-Layer Image Generation by Zihao Liu, Zunnan Xu, Shi Shu, Jun Zhou, Ruicheng Zhang, Zhenchao Tang, Xiu Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-16249.txt.

Introduction

Zihao Liu and six co-authors present controllable layer decomposition for reversible multi layer image creation. Designers build images layer by layer, but once layers are flattened into one raster, layer level editing is lost. Matting and inpainting methods recover layers only with limited control and precision. Their method separates a raster image into distinct editable layers with fine grained control.

A dedicated decomposition transformer decouples elements into layers. A multi layer conditional adapter injects target image information into layer tokens for precise conditional creation. A new benchmark and tailored metrics support comprehensive evaluation. Reversible decomposition would let editors revise finished artwork structurally. The work targets design workflows where layer structure is creative capital, not disposable metadata.

Catalog record

CREATORZihao Liu, Zunnan Xu, Shi Shu, Jun Zhou, Ruicheng Zhang, Zhenchao Tang, Xiu Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-16249

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Controllable Layer Decomposition for Reversible Multi-Layer Image Generation Zihao Liu, Zunnan Xu, Shi Shu, Jun Zhou, Ruicheng Zhang, Zhenchao Tang, Xiu Li Abstract This work presents Controllable Layer Decomposition (CLD), a method for achieving fine-grained and controllable multi-layer separation of raster images. In practical workflows, designers typically generate and edit each RGBA layer independently before compositing them into a final raster image. However, this process is irreversible: once composited, layer-level editing is no longer possible. Existing methods commonly rely on image matting and inpainting, but remain limited in controllability and segmentation precision. To address these challenges, we propose two key modules: LayerDecompose-DiT (LD-DiT), which decouples image elements into distinct layers and enables fine-grained control; and Multi-Layer Conditional Adapter (MLCA), which injects target image information into multi-layer tokens to achieve precise conditional generation. To enable a comprehensive evaluation, we build a new benchmark and introduce tailored evaluation metrics. Experimental results show that CLD consistently outperforms existing methods in both decomposition quality and controllability. Furthermore, the separated layers produced by CLD can be directly manipulated in commonly used design tools such as PowerPoint, highlighting its practical value and applicability in real-world creative workflows. Our project is available at CLD . Given an image and its bounding boxes, our framework generates a clean foreground layer for each box and a single, coherent background. Our method can cleanly separate every foreground layer even when objects are crowded and heavily overlapping, while keeping boundaries sharp, depth order intact, and the composite visually coherent. 1 Introduction In the design of posters, advertisements, and other visual media, designers typically do not directly work on a single raster image. Instead, they create and edit foreground elements across multiple RGBA layers. Specifically, designers use tools such as Adobe Photoshop or PowerPoint to construct foreground elements at the layer level and then overlay multiple foreground layers onto a background layer to produce the final image. However, this compositing process is irreversible: once multiple RGBA layers are merged into a single raster image, the original multi-layer information cannot be recovered. Consequently, when only a raster image is available, precise layer-level editing and adjustments become extremely challenging. Accurate layer decomposition from raster images can effectively address this issue, enabling designers to perform efficient and controllable edits on the separated layers. In this work, we investigate the problem of user-controllable layer decomposition, aiming to split a single raster image into a set of independent layers based on user-provided bounding boxes. Existing approaches, such as decomposition methods for natural images [ 43 , 1 , 16 , 2 ] , often suffer from incomplete foreground extraction or unwanted artifacts, including messy edges or background color leaking into foreground layers. Some studies [ 4 , 45 , 60 ] adopt a modular, multi-stage pipeline, dividing the task into object detection [ 39 , 38 , 40 ] , segmentation [ 48 , 21 , 49 , 12 , 13 ] , image matting [ 54 , 41 , 20 ] , and image inpainting [ 17 , 31 , 5 ] , with each stage handled by a dedicated pre-trained model. However, such pipelines are prone to error propagation: mistakes in early stages can adversely affect subsequent stages, degrading overall layer decomposition quality. To address these limitations, LayerD [ 42 ] proposed a fully automatic graphic layer decomposition method, iteratively performing image matting for top-layer extraction and image inpainting for background completion. However, LayerD entirely relies on the matting model to identify top-layer elements, leaving users with no control over the final decomposition results. To overcome these limitations, we propose a controllable layer decomposition method, which allows users to specify desired decomposition outcomes via bounding boxes. Our core model uses pre-trained DiT models (e.g., FLUX.1[dev] [ 23 ] ), fully exploiting their strong image generation capabilities to produce layer decomposition results of higher quality. Figure Controllable Layer Decomposition for Reversible Multi-Layer Image Generation shows the results of our method. It can be seen that the model is able to generate the corresponding foreground and background layers based on the provided bounding boxes, achieving excellent overall visual quality. Moreover, previous evaluation metrics for layer decomposition were limited by uncontrollable generated results, lacking standardized benchmarks. By introducing bounding boxes, we can define ideal target layers and propose a new benchmark. Specifically, we establish a benchmark for controllable layer decomposition, built on the PrismLayersPro [ 3 ] dataset, with new metric dimensions tailored for controllable settings. Our main contributions are summarized as follows: • We propose CLD (Controllable Layer Decomposition), a controllable framework for raster image layer decomposition that leverages DiT’s generation and reasoning capabilities to achieve high-quality layer separation. • We introduce a new benchmark to assess the performance of layer decomposition from multiple dimensions. • Experimental results demonstrate that CLD outperforms baseline methods in both controllability and generation quality, and separated layers can be applied directly to downstream graphic design and editing tasks. 2 Related work Image Layer Decomposition. Image layer decomposition aims to divide an image into a set of composable layers that can be re-synthesized to reconstruct the original image. Early approaches are mostly color-based, grouping pixels by color similarity and focusing on digital painting or natural images [ 43 , 1 , 2 , 44 , 22 , 9 ] . Other studies explore object-level decomposition in natural scenes [ 15 , 27 , 32 , 58 , 55 , 59 , 28 , 50 , 52 ] . Recent studies have explored multi-layer image generation, using generative models to directly synthesize and disentangle foreground and background layers in a unified framework [ 14 , 46 , 36 , 35 , 3 , 56 , 29 , 11 , 30 ] . For example, Huang et al. [ 14 ] introduced DreamLayer, which explicitly models the interaction between transparent foreground and background layers for coherent text-driven generation. However, this method is designed for text-to-image synthesis and is not directly applicable to our layer decomposition task. In design images such as posters and advertisements, multiple visual elements coexist, making decomposition challenging in terms of fine-grained separation and controllability. Recent works [ 4 , 42 ] have explored this direction. Chen et al. [ 4 ] proposed a pipeline combining visual language models (VLM) with SAM [ 21 ] , while Suzuki et al. [ 42 ] introduced LayerD, which separates layers via image matting and inpainting. However, LayerD relies entirely on the matting model to determine top-layer elements, offering no user control and tending to produce coarse, element-level separations. To overcome these limitations, we propose a DiT-based framework that enables controllable, fine-grained layer generation guided by user-provided bounding boxes. Image matting and Element extraction. Natural image matting optimizes the compositing equation I=\alpha F+(1-\alpha)B for \alpha,F,B using inputs like trimaps or scribbles [ 47 , 25 , 34 ] . Although trimap-free methods [ 19 , 53 ] reduce manual effort, they are optimized for photographic statistics and fail on the clean edges, solid colors, and repetitive textures common in graphic designs. Zero-shot segmentation foundation models offer an alternative. SAM [ 21 ] and SAM 2 [ 37 ] produce binary masks from prompts but ignore partial transparency. HQ-SAM [ 18 ] refines boundaries but

Read the complete text