Decomposing Private Image Generation via Coarse-to-Fine Wavelet Modeling Thanks: Work done at Google as part of student researcher engagement. Jasmine Bayrooti, Weiwei Kong, Natalia Ponomareva, Carlos Esteves, Ameesh Makadia, Amanda Prorok Abstract Generative models trained on sensitive image datasets risk memorizing and reproducing individual training examples, making strong privacy guarantees essential. While differential privacy (DP) provides a principled framework for such guarantees, standard DP finetuning (e.g., with DP-SGD) often results in severe degradation of image quality, particularly in high-frequency textures, due to the indiscriminate addition of noise across all model parameters. In this work, we propose a spectral DP framework based on the hypothesis that the most privacy-sensitive portions of an image are often low-frequency components in the wavelet space (e.g., facial features and object shapes) while high-frequency components are largely generic and public. Based on this hypothesis, we propose the following two-stage framework for DP image generation with coarse image intermediaries: (1) DP finetune an autoregressive spectral image tokenizer model on the low-resolution wavelet coefficients of the sensitive images, and (2) perform high-resolution upsampling using a publicly pretrained super-resolution model. By restricting the privacy budget to the global structures of the image in the first stage, and leveraging the post-processing property of DP for detail refinement, we achieve promising trade-offs between privacy and utility. Experiments on the MS-COCO and MM-CelebA-HQ datasets show that our method generates images with improved quality and style capture relative to other leading DP image frameworks. 1 Introduction Recent advances in deep generative modeling have enabled high-quality image synthesis from textual descriptions, supporting applications such as creative image generation [ 18 , 36 ] and interactive editing [ 32 , 2 ] . However, training or finetuning these models on sensitive image datasets, including medical images and private photo collections, raises data-privacy concerns as generative models have been shown to memorize and reproduce information about individual training examples [ 9 , 7 ] . Differential privacy (DP) provides a rigorous mathematical framework to bound this risk by ensuring that model outputs are statistically insensitive to the inclusion or exclusion of any single training example. In practice, most DP methods enforce this guarantee during training or finetuning using variants of differentially private stochastic gradient descent (DP-SGD) [ 1 ] . While DP-SGD provides strong formal privacy guarantees, it introduces a privacy-utility trade-off where achieving strong privacy levels requires aggressive gradient clipping and noise injection, which can overwhelm the learning signal in high-dimensional generative models. This often leads to degradation in visual quality, particularly for complex image distributions with fine-grained structure, such as human faces. As a result, existing DP image generation methods struggle to produce high-fidelity samples on challenging benchmarks, even when leveraging large pretrained models or parameter-efficient finetuning strategies. Figure 1: Illustration of the DP-Wavelet method. To address these challenges, we introduce a DP image generation framework that improves the signal-to-noise properties of private training by carefully selecting which aspects of the image representation are learned under privacy constraints. Our approach is based on two hypotheses regarding the spectral structure of images and the interaction between DP-SGD and representation granularity. First, we hypothesize that the majority of the semantic signal that captures global structure, style, and content is concentrated in the low-frequency components of an image. This is supported by the energy compaction property of wavelet representations and sparsity of higher-frequency bands [ 29 ] . Second, we hypothesize that fine-scale image details such as skin textures and localized patterns are sufficiently generic to be synthesized by publicly pretrained models without direct access to private data. Together, these observations suggest that privacy budgets should be allocated to coarse, semantically meaningful image structure, while fine details can be generated as post-processing without additional privacy cost. Building on these insights, we propose DP-Wavelet, a coarse-to-fine method for DP text-to-image generation using wavelet-based image intermediaries. In our setting, text prompts are assumed to be public, while images contain sensitive information. Given a dataset of public texts x=\{x_{i}\} (e.g., captions and prompts) paired with private images y=\{y_{i}\} , our goal is to generate a set of DP synthetic images \hat{y}=\{\hat{y}_{i}\} conditioned on x . DP-Wavelet operates in two stages. In the first stage, we DP finetune a publicly pretrained wavelet-based image generation model \mathcal{T} on public texts x and a tokenization \{t_{i}\} of the coarse, low-frequency wavelet components of the corresponding private images y , yielding the DP-finetuned model \hat{\mathcal{T}} . In the second stage, \hat{\mathcal{T}} is used to generate a sequence of DP coarse wavelet tokens \{\hat{t}_{i}\} conditioned on the texts x . The coarse tokens are then autoregressively completed into full wavelet representations \{s_{i}\} using the frozen pretrained model \mathcal{T} and finally decoded into images \hat{y} . An overview of this process is shown in Figure 1 , where the Discrete Wavelet Transform (DWT) and its inverse (IDWT) are used to move between pixel and wavelet frequency spaces. Motivating applications . The public-text/private-image setting that we consider arises in scenarios where textual descriptions are non-sensitive but images contain confidential information, such as medical imaging datasets where clinical reports may be shareable while the underlying scans are protected. A second use case is style-preserving synthesis, e.g., modeling an artist’s style from public descriptions, while treating individual works as the private unit. DP-Wavelet also extends naturally to settings where texts are private by generating DP prompts using a separate DP text model and using these prompts for sampling; see Appendix F for an extended discussion. Contributions . Our contributions are summarized as follows: 1. We introduce DP-Wavelet, the first autoregressive DP method for text-to-image synthesis based on coarse image intermediaries. Unlike prior approaches that apply DP to dense latent or token representations, DP-Wavelet enforces privacy only on low-frequency wavelet components that capture global image structure. 2. We state and operationalize the hypothesis that privacy budgets should be preferentially allocated to low-frequency image components. By restricting DP optimization to these subbands, our approach improves the signal-to-noise ratio under DP-SGD relative to pixel-space training. 3. We empirically show that DP-Wavelet achieves competitive distributional quality (FID) and style consistency (LPIPS) relative to text-to-image baselines on the MS-COCO and MM-CelebA-HQ datasets. Notably, DP-Wavelet can produce DP coarse image intermediaries that reliably capture global structure, color composition, and stylistic cues of the underlying data. 1.1 Related Work In this section, we review prior work on non-private and private image synthesis as well as coarse-to-fine generation. Image synthesis . Several foundational approaches like VAEs [ 24 ] and GANs [ 20 ] established the abilities of generative modeling, although they face trade-offs between sample sharpness and training stability. Modern state-of-the-art pipelines address this by decoupling representation learning from generation by first mapping images into compact latent or token spaces using learned autoencoders or tokenizers and then synthesizing images within this space. Diffusion-based approaches generate images by iteratively denoising latent representations across a sequence of noise levels [ 23 , 33 , 36 ] . In contrast, autoregressive (AR) methods formulate image synthesis as a sequence prediction problem over discrete tokens and use transformer architectures to model token dependencies [ 16 , 49 ] . While diffusion models tend to excel at high-frequency texture synthesis, AR models benefit from maximum-likelihood training and favorable scaling behavior [ 43 ] , which we hypothesize may better preserve learning signal under differential privacy. Therefore, our work builds on this AR paradigm and leverages spectral tokenization to enable coarse-to-fine image generation. Private image synthesis . Early research on DP image generation primarily focused on training GANs with DP-SGD [ 48 , 44 , 5 , 10 , 8 ] . While effective on simple datasets like MNIST, these methods struggle to scale to more complex image datasets since DP noise injection exacerbates the instability of adversarial training. Therefore, more recent work applies DP to diffusion models, which are more robust to noisy optimization. Most DP diffusion methods rely on finetuning large public pretrained models to preserve semantic structure while restricting private updates [ 12 , 19 ] and further reduce privacy cost through techniques such as semantic-aware pretraining [ 25 ] , curriculum-based schedules [ 45 ] , or warm-starting from curated public data [ 34 ] . Among these, DP-LDM [ 28 ] mitigates the curse of dimensionality by finetuning only attention modules and is one of the few methods demonstrated on high-resolution text-to-image benchmarks such as MM-CelebA-HQ, whereas most prior work focuses on class-conditional generation. Conversely, DP autoregressive image models remain underexplored, with an initial study on Vision AutoRegressive models [ 38 ] indicating that standard DP finetuning strategies currently lag behind diffusion baselines in utility. Orthogonal to DP-SGD–based training, alternative approaches generate private synthetic images without model finetuning by using private evolution over image or textual intermediaries [ 27 , 46 ] , achieving strong results when the private data distribution is sufficiently close to that of the underlying pretrained models. Spectral and cascaded image generation . Coarse-to-fine synthesis strategies decompose generation by progressively resolving structure before details. Cascaded diffusion models, as used in Imagen [ 37 ] , implement this spatially through a pipeline of distinct models where a base generator synthesizes a low-resolution pixel grid which is subsequently refined by separate super-resolution upsamplers. In contrast, the autoregressive spectral image tokenizer (AR-SIT) [ 17 ] achieves coarse-to-fine generation within a single model by transforming images into discrete wavelet coefficients ordered by frequency scale. Unlike raster-order token generation that is typical of autoregressive transformers like Parti [ 49 ] and LlamaGen [ 40 ] , AR-SIT generates global low-frequency components before high-frequency textures and supports partial decoding from coarse token prefixes. This disentanglement provides a natural framework for our work by allowing us to focus private learning on low-frequency semantic structure, which we hypothesize carries most of the privacy cost, while handling the high-frequency details separately. 1.2 Notation Notation and basic definitions . Let \mathbb{R} denote the set of real numbers, \mathbb{C} denote the set of complex numbers, and \mathbb{Z} denote the set of integers. We denote the 2D spatial index by \mathbf{k}=(k_{1},k_{2})\in\mathbb{Z}^{2} and \mathbb{R}^{n}=\mathbb{R}\times\cdots\times\mathbb{R} , where the product is taken n times. For any set S , let \overline{S} denote its closure. Given X\subseteq\mathbb{R}^{n} , let L^{2}(X) be the Hilbert space of square-integrable measurable functions f:X\to\mathbb{C} satisfying \|f\|_{2}=\left(\int_{-\infty}^{\infty}|f(t)|^{2}dt\right)^{1/2}<\infty with the standard inner product \langle f,g\rangle=\int_{-\infty}^{\infty}f(t)\overline{g(t)}dt . Given vector spaces V and W , let V\otimes W denote their tensor product and V\oplus W denote their direct sum. For a 2D image (or subband) X and a filter kernel K , the discrete 2D convolution (X\star K) at a specific position (i,j) is the sum of the element-wise product of the kernel and the overlapping image region: (X\star K)[i,j]=\sum_{m}\sum_{n}X[i-m,j-n]\cdot K[m,n]. In the special case where the filter kernel is an outer product K=uv^{\top} , the above convolution can be broken down into two sequential 1D convolutions: (1) convolve the rows of X with the horizontal vector v^{\top} and then (2) convolve the columns of the resulting image with the vertical vector u . 2 Preliminaries This section provides a review of the following key concepts that are relevant to our work: differential privacy, MRA and 2D wavelets, and popular autoregressive image-generation methods. 2.1 Differential privacy and DP-SGD Differential privacy (DP) is a rigorous mathematical framework for quantifying the privacy leakage of randomized algorithms. It requires the output of a training procedure to be statistically insensitive to the presence or absence of any single record in the training dataset. This implies that an adversary analyzing a trained model cannot distinguish whether it was trained on a dataset D or a neighboring dataset D^{\prime} that differs by exactly one example. Some common measures of DP are \varepsilon -pure DP or (\varepsilon,\delta) -approximate DP [ 14 ] . A definition of the latter is given below. Definition 1 . ( (\varepsilon,\delta) -DP) Given \varepsilon>0 and \delta\leq 1 , a mechanism (randomized algorithm) \mathcal{A}:{\mathcal{D}}\mapsto\mathcal{R} is (\epsilon,\delta) -DP if, for any two neighboring 1 1 1 Differing by the addition or removal of one training example. datasets D and D^{\prime} , and any S\subseteq\mathcal{R} , we have P[\mathcal{A}(D)\in S]\leq e^{\varepsilon}\cdot P[\mathcal{A}(D^{\prime})\in S]+\delta. In this formulation, the parameter \varepsilon , called the privacy budget, limits how much the output distribution can change between neighbors. Smaller values of \varepsilon correspond to stronger privacy guarantees and any mechanism that is (\varepsilon_{0},\delta) -DP is also (\varepsilon_{1},\delta) -DP for all \varepsilon_{0}\leq\varepsilon_{1} . The parameter \delta quantifies a small probability of privacy failure and is typically chosen to be negligible, for example, satisfying \delta\ll 1/|D| . DP-SGD . To achieve this guarantee in machine learning, it is common to use differentially private stochastic gradient descent (DP-SGD) [ 1 ] , which we give in Algorithm 1 . Algorithm 1 DP-SGD 1: dataset D=\{x_{1},\dots,x_{N}\} , loss \mathcal{L} , learning rate \eta , noise multiplier \sigma , clipping norm C , batch size B , iteration count T 2: DP parameters \theta_{T} 3: Initialize \theta_{0} randomly 4: for t\in 1\dots T do 5: sample Poisson batch B_{t} with rate q=B/N 6: for each x_{i}\in B_{t} do 7: g_{t}(x_{i})\leftarrow\nabla_{\theta_{t}}\mathcal{L}(x_{i},\theta_{t}) 8: \bar{g}_{t}(x_{i})\leftarrow g_{t}(x_{i})/\max\left(1,\|g_{t}(x_{i})\|_{2}/C\right) 9: sample Z_{t}\sim\mathcal{N}(0,\sigma^{2}C^{2}I) 10: \tilde{g}_{t}\leftarrow({1}/{B})\left[\sum_{i\in B_{t}}\bar{g}_{t}(x_{i})+Z_{t}\right] 11: \theta_{t+1}\leftarrow\theta_{t}-\eta\tilde{g}_{t} 12: return \theta_{T} DP-SGD modifies standard stochastic gradient descent (SGD) by enforcing a bounded global sensitivity and introducing noise to the gradient updates. Specifically, the influence of any training example is limited by clipping the l_{2} norm of its gradient to a maximum threshold C (line 6). Then, it is privatized by adding Gaussian noise with standard deviation \sigma C to the aggregated batch gradient (line 8), which obfuscates any single example’s contribution. Other variants of Algorithm 1 may modify the update step in line 9 to use another first-order gradient update scheme, e.g., Adam or Adagrad [ 35 ] . For a given noise multiplier \sigma , batch size B iteration count T , and dataset size N , a run of DP-SGD with these parameters satisfies a cumulative privacy level of (\varepsilon,\delta) -DP. Privacy accountants quantify this privacy level, e.g., the value of \delta and \varepsilon , with the tightness of the resulting bound determined by underlying modeling assumptions. In practice, users typically fix a target privacy level (\epsilon,\delta) and use the accountant to solve for the minimum noise multiplier \sigma required to maintain it. In our experiments, we adopt Privacy Loss Distribution (PLD) privacy accounting [ 13 ] . Post-processing . A fundamental property of DP is its robustness to post-processing, which guarantees that computations performed on the output of a private mechanism cannot weaken its privacy guarantees provided they do not access the original private data. Formally, this is stated as follows: Proposition 1 (Post-Processing [ 15 ] ) . Let \mathcal{M}:\mathcal{D}\to\mathcal{R} be an (\epsilon,\delta) -DP algorithm, and let f:\mathcal{R}\to\mathcal{R}^{\prime} be an arbitrary (possibly randomized) mapping. Then the composition f\circ\mathcal{M}:\mathcal{D}\to\mathcal{R}^{\prime} is (\epsilon,\delta) -DP. This property is important in our work as it allows fine-scale image refinement to be performed entirely as post-processing of a DP coarse representation without incurring additional privacy loss. 2.2 MRA and 2D Wavelets We ground our coarse-to-fine image generation framework in Multiresolution Analysis (MRA), which allows us to explicitly decouple the “private” global structure from “public” local texture by decomposing the image space into nested subspaces. In this framework, an MRA of L^{2}(\mathbb{R}) consists of a sequence of nested 2 2 2 This also means that any function that is representable in V_{j} is also representable in V_{j+1} . closed function subspaces V_{j}\subset V_{j+1} whose union is dense 3 3 3 That is, any square integrable function can be approximated to arbitrary precision using elements in \bigcup_{j}V_{j} . in L^{2}(\mathbb{R}) . The subspace V_{0} is defined as the closure of the linear span of integer translations of a scaling function \phi\in L^{2}(\mathbb{R}) (often called the Father wavelet). That is, V_{0}=\overline{\text{span}\{\phi(\cdot-k):k\in\mathbb{Z}\}} where \{\phi(\cdot-k)\}_{k\in\mathbb{Z}} forms an orthonormal basis for V_{0} . An associated wavelet function (or Mother wavelet) \psi is then constructed such that its integer translations span the orthogonal complement W_{0} and we then construct V_{1}=V_{0}\oplus W_{0} . For general scales j , the subspaces V_{j} and W_{j} are generated by dilations of \phi and \psi respectively, satisfying the recursive relation V_{j+1}=V_{j}\oplus W_{j} . To extend this to an MRA of 2D images in L^{2}(\mathbb{R}^{2}) , we construct a separable basis using tensor products of the 1D spaces. This process naturally yields four generating functions that define the geometry of the 2D decomposition: one functions scaling function \Phi and three distinct wavelets \{\Psi^{H},\Psi^{V},\Psi^{D}\} where H= horizontal, V= vertical, and D = diagonal. The 2D approximation space at scale j , denoted V_{j}^{2D} , is then the tensor product V_{j}\otimes V_{j} . Crucially, the detail space needed to move from scale j to j+1 decomposes into three orthogonal orientation bands: V_{j+1}^{2D}=\underbrace{(V_{j}\otimes V_{j})}_{V_{j}^{2D}}\oplus\underbrace{(V_{j}\otimes W_{j})}_{W_{j}^{H}}\oplus\underbrace{(W_{j}\otimes V_{j})}_{W_{j}^{V}}\oplus\underbrace{(W_{j}\otimes W_{j})}_{W_{j}^{D}}. Similar to the 1D setting, the orthonormal basis for the subspace V_{j}^{2D} consists of the collection of all integer translations of the dilated generator. More specifically, for a spatial index \mathbf{k}=(k_{1},k_{2})\in\mathbb{Z}^{2} and scale j , the normalized 2D scaling basis function is \Phi_{j,\mathbf{k}}(x,y)=2^{j}\Phi(2^{j}x-k_{1},2^{j}y-k_{2}) (1) and the set \{\Phi_{j,\mathbf{k}}\}_{\mathbf{k}\in\mathbb{Z}^{2}} forms the complete orthonormal 4 4 4 The factor 2^{j} is required to maintain unit energy (normalization). As scale j increases, the spatial support shrinks by 2^{-j} in both dimensions (area scales by 2^{-2j} ). To satisfy the isometry condition \|\Phi_{j,\mathbf{k}}\|_{2}=1 , the amplitude must scale by \sqrt{2^{2j}}=2^{j} . basis for V_{j}^{2D} . Similarly, we can define \Psi_{j,k}^{\lambda} to be as in ( 1 ) but with \Phi=\Psi^{\lambda} and the sets \{\Psi^{\lambda}_{j,\mathbf{k}}\}_{\mathbf{k}\in\mathbb{Z}^{2}} form the bases for the detail spaces W_{j}^{\lambda} for \lambda\in\{H,V,D\} . Consequently, using the orthogonality of the basis functions, for a given coarseness level (hyperparameter) j_{0}\geq 1 , any image f(x,y) can be expressed as: \displaystyle f(x,y) \displaystyle=\underbrace{\sum_{\mathbf{k}\in\mathbb{Z}^{2}}c_{j_{0},\mathbf{k}}\Phi_{j_{0},\mathbf{k}}(x,y)}_{\text{Approximation at scale }j_{0}}+\sum_{j=j_{0}}^{\infty}\underbrace{\sum_{\mathbf{k}\in\mathbb{Z}^{2}}\sum_{\lambda\in\{H,V,D\}}d^{\lambda}_{j,\mathbf{k}}\Psi^{\lambda}_{j,\mathbf{k}}(x,y)}_{\text{Details for scale }j}, where the coefficients are defined by inner products with the basis functions: c_{j_{0},\mathbf{k}}=\langle f,\Phi_{j_{0},\mathbf{k}}\rangle\quad\text{and}\quad d^{\lambda}_{j,\mathbf{k}}=\langle f,\Psi^{\lambda}_{j,\mathbf{k}}\rangle. (2) This representation maps directly to our privacy hypothesis: • Approximation coefficients ( c_{j_{0},\mathbf{k}} ): These coefficients project the image onto V_{j_{0}}^{2D} . They capture the bulk of the signal energy and semantic identity, representing the “private” payload . • Detail coefficients ( d^{\lambda}_{j,\mathbf{k}} ): These coefficients project onto the detail spaces W_{j}^{2D} . They are typically sparse and capture generic textures that we treat as “public” information . While formally defined by continuous integrals, the coefficients \{c_{j,\mathbf{k}},d_{j,\mathbf{k}}^{\lambda}\} are computed in practice using the Discrete Wavelet Transform (DWT), also known as Mallat’s algorithm [ 30 ] . Given an input of N pixels, this efficient O(N) algorithm utilizes a cascade of discrete low-pass and high-pass filters followed by dyadic downsampling. More specifically, at each scale j , the DWT decomposes the signal into four distinct subbands; we denote these using the standard filter notation XY_{j} , where X,Y\in\{L,H\} indicate whether the low-pass or high-pass filter was applied to the rows and columns, respectively (see Figure 2 for a visualization): • LL_{j} ( \approx c_{j_{0}+j,\mathbf{k}} ): Represents the approximation at scale j_{0}+j . In the encoding phase, this becomes the input for the next decomposition step. • LH_{j} ( \approx d^{H}_{j_{0}+j,\mathbf{k}} ): Captures horizontal edges. • HL_{j} ( \approx d^{V}_{j_{0}+j,\mathbf{k}} ): Captures vertical edges. • HH_{j} ( \approx d^{D}_{j_{0}+j,\mathbf{k}} ): Captures corner features and diagonal textures. In particular, given a coarseness scale j_{0} , the subband LL_{0} corresponds to the approximation at the scale j_{0} and is obtained by repeatedly applying the DWT. This recursive calculation is realized in our experiments using the Haar wavelet basis [ 21 ] ; see ( 2.3 ) below. Although wavelet coefficients are formally defined as inner products over continuous domains, the DWT computes them efficiently via discrete convolution operations. As a result, extracting the LL_{0} tokens required for private training amounts to running a standard DWT and avoids any high-dimensional continuous computations. Figure 2: Visualization of the 2D Discrete Wavelet Transform. Left . Original image, Center . A one-level decomposition where the image is split into the approximation LL_{0} and details \{LH_{0},HL_{0},HH_{0}\} , Right , A two-level decomposition where the image is first split into scale 1 details in blue and a scale 1 approximation, which is then recursively split into scale 0 details in green and the final approximation LL_{0} in red. Note that indices are relative to the coarsest scale LL_{0} . 2.3 Autoregressive spectral image tokenizer Our generative framework builds on the popular vector-quantized autoregressive image models, specifically the VQ-GAN paradigm [ 16 ] . In this setting, an encoder-decoder tokenizer ( \mathcal{E} , \mathcal{D} ) maps images to sequences of discrete tokens drawn from a learned codebook while an autoregressive transformer \mathcal{T} models the token distribution. This formulation reduces high-dimensional image synthesis to sequence modeling over discrete tokens and enables the use of standard transformer architectures, as demonstrated by large-scale autoregressive models such as Parti [ 49 ] and LlamaGen [ 40 ] . Figure 3: Left . Pixel-based patchification, Right . Wavelet-based patchification where separate codebooks are used for the red, green, and blue patches [ 17 ] . We use the autoregressive spectral image tokenizer (AR-SIT) [ 17 ] , which extends this framework by performing tokenization in the wavelet domain rather than pixel space. AR-SIT applies a discrete wavelet transform (DWT) to decompose an image into multiscale subbands and then patchifies each subband independently. In our implementation, we use Haar wavelets for their simplicity and strong reconstruction properties. Using the notation from Section 2.2 , the subbands are computed recursively as \begin{gathered}LL_{j-1}=LL_{j}\star(gg^{\top}),\quad LH_{j-1}=LL_{j}\star(gh^{\top}),\\ HL_{j-1}=LL_{j}\star(hg^{\top}),\quad HH_{j-1}=LL_{j}\star(hh^{\top}),\end{gathered} for every j\geq 1 , where g=[1,1]^{\top} , h=[1,-1]^{\top} , and \star is the discrete 2D convolution. The AR-SIT encoder \mathcal{E} applies the DWT up to a specified coarseness level and patchifies every wavelet subband independently; Figure 3 shows the visual contrast between this spectral patching process and standard pixel/raster-order patching. Since approximation and detail subbands have different statistics across scales, AR-SIT uses an Approximation–Details Transformer (ADTransformer) that processes approximation and detail tokens with separate layer normalizations, MLPs, and attention blocks rather than shared parameters. A key capability of this architecture is partial decoding, which is achieved by enforcing scale-causal attention in the SIT decoder. This mechanism ensures that the initial sequence of tokens corresponding to the low-frequency approximation LL_{0} can be decoded into a recognizable coarse image before any high-frequency details are generated. That is, for a maximum recursion depth J and 0