Bayesian Tensor Decomposition with Diffusion Model Prior Zerui Tao, Qibin Zhao Abstract Low-rank tensor decomposition (TD) is usually effective on clean, fully observed data, but it often degrades under severe missingness or noise. Low-rankness is itself a useful but limited structural prior, and additional handcrafted priors ( e.g. , sparsity or smoothness) still fall short of capturing the rich statistics of real-world data. To compensate for this weak inductive bias under heavy corruption, one would like to inject a learned , data-driven prior; however, the state-of-the-art diffusion models are not readily compatible with current TD and tractable posterior inference. To address these challenges, we introduce DiffBCP, a hybrid-prior Bayesian CP decomposition framework that couples a cumulative shrinkage process prior over the CP factors for automatic rank selection with an off-the-shelf pre-trained diffusion model as an implicit data prior on the reconstructed tensor. To make posterior inference tractable despite the coupling among the likelihood, low-rank constraint, and diffusion prior, we develop a split Gibbs sampler: CP factors admit conjugate updates, while the diffusion block is sampled via low-rank-guided denoising. A noise-adaptive coupling schedule further reduces sensitivity to hand-tuned annealing. Experiments on image inpainting and denoising, including high-resolution out-of-distribution images, show consistent gains over Bayesian, nonlinear, and plug-and-play TD baselines. 1 Introduction Tensor decomposition (TD) is a powerful tool for multi-dimensional data analysis, with applications in machine learning, signal processing, and scientific computing ( 21 ; 9 ) . By factorizing high-order tensors into contractions of much smaller factors, TD enables efficient representation, compression, and interpretation of complex data structures. One important application is signal recovery from incomplete and noisy observations, where TD can exploit the low-rank structure of the underlying data to reconstruct missing or corrupted entries ( 33 ) . In the research field of TD, one scheme is to study effective decomposition structures to incorporate prior beliefs about the data latent representations, such as CP ( 14 ) , Tucker ( 42 ) , tensor networks ( 27 ; 53 ) , and many other decompositions ( 21 ; 20 ; 9 ) . The motivation behind is that when the model structure matches the data hidden pattern better, the TD method can achieve better representation and recovery performances. Motivated by this, efforts have been made to design more flexible TD models that can learn richer structures from the data, from traditional multi-linear models to non-linear models ( 56 ; 23 ) . Ironically, in real applications such as image processing, we usually observe that, when the data are complete and clean, even the simplest TD structure like CP decomposition achieves strong performances; on the contrary, when the data are partially observed or noisy, more sophisticated TD models may not lead to satisfactory results. The main challenge is that the low-rank assumption, while itself an effective structural prior, becomes insufficient on its own once the observations are noisy or incomplete. To reduce this gap, previous work augments TD with additional handcrafted priors such as sparsity or smoothness ( 37 ; 47 ) , but these handcrafted priors still may not fully exploit the rich information present in real-world data. This raises a natural question: Can we complement the structural low-rank prior with a more powerful, learned data prior for noisy and incomplete data? To address this issue, we adopt a Bayesian framework that can naturally couple a handcrafted structural prior with a learned, data-driven prior in a single probabilistic model. In particular, we propose DiffBCP, a hybrid-prior probabilistic CP decomposition model that leverages the recent advances in diffusion models ( 16 ) . Concretely, a powerful pre-trained diffusion model is placed in the Bayesian CP model as an implicit prior on the reconstructed tensor, enabling the model to capture complex data distributions effectively. To ensure low-rank structure and automatic rank determination, we adopt the cumulative shrinkage process (CUSP) prior ( 22 ) on the CP component weights. The resulting model combines the strengths of Bayesian tensor decomposition and diffusion models, allowing for robust learning from noisy and partially observed tensors. To sample from the posterior distribution, we adopt the split Gibbs sampler ( 45 , SGS,) with an auxiliary variable, which decouples the likelihood, the implicit diffusion prior, and the low-rank constraint. This leads to closed-form updates for the latent factors and conjugate sampling. The diffusion prior block is sampled via low-rank–guided denoising, turning plug-and-play guidance into a structured Bayesian inference procedure. While the noise level is an important factor in the SGS, our fully Bayesian framework allows us to infer it automatically from the data, eliminating the need for manual tuning. We conduct experiments on image inpainting and denoising tasks. Results show that our method performs well on various types of images, demonstrating the effectiveness of combining diffusion model priors with Bayesian tensor decomposition. 1.1 Contributions Our main contributions are summarized as follows: • We propose a hybrid-prior Bayesian CP model with the sparse CUSP prior on the latent factors and powerful pre-trained diffusion model prior on the reconstructed tensor to capture complex data distributions. • The inference is fully probabilistic, giving better noise adaptation and annealing ability. • The proposed method achieves superior performance on image datasets, even outperforms non-linear TDs. 1.2 Related Work Bayesian tensor decomposition Bayesian TD has been studied for various forms of decompositions, including CP ( 52 ; 28 ; 7 ) , Tucker ( 32 ; 12 ; 36 ) , tensor train/ring ( 25 ; 38 ; 49 ) , and non-parametric TD ( 56 ; 40 ) . Previous work mainly focuses on developing better priors on the latent factors, for example sparsity-inducing priors ( 58 ; 41 ) or smoothness priors ( 5 ) . In particular, 36 develop a Bayesian Tucker using a similar CUSP prior on Tucker factor matrices. Other methods learn more flexible likelihood models, such as mixture-of-Gaussians ( 6 ) and deep generative models ( 39 ; 4 ) . However, these works do not consider powerful data-driven priors on the reconstructed tensor itself. Generative priors for inverse problems Generative priors for general inverse problems have a long history, ranging from plug-and-play denoisers ( 44 ) and regularization-by-denoising ( 30 ) to generator-based priors such as CSGM ( 2 ) and Deep Image Prior ( 43 ) . The rise of diffusion models has produced much stronger natural-image priors, leading to a family of diffusion posterior samplers including DPS ( 8 ) , SNIPS/DDRM ( 19 ; 18 ) , and split-Gibbs-style samplers that embed a diffusion/generative prior, first introduced by 10 and later developed by 48 ; 50 ; 13 , with the recent benchmark of 57 . In the TD literature, 54 ; 55 pair CNN denoiser priors with ADMM, but the denoiser is much less expressive than a diffusion model and the framework is non-probabilistic. DiffBCP sits at the intersection of these two lines: built on the split Gibbs sampler ( 45 ; 10 ; 48 ) , it additionally imposes a Bayesian low-rank CP structure with CUSP shrinkage on the factor weights, yielding a hybrid-prior formulation within a fully probabilistic framework. 2 Preliminaries Notations We use bold lowercase letter, capital letters, and caligraphical capital letters to denote vectors, matrices, and tensors respectively, e.g. , \bm{\mathbf{x}}\in\mathbb{R}^{I},\bm{\mathbf{X}}\in\mathbb{R}^{I_{1}\times I_{2}} , and \bm{\mathscr{{X}}}\in\mathbb{R}^{I_{1}\times I_{2}\cdots\times I_{N}} . Subscripts represent slices of sub-arrays, e.g. , \bm{\mathbf{X}}_{i::} is the i -th slice of \bm{\mathscr{{X}}} along the first dimension. The mode- n matricization is denoted as \bm{\mathbf{X}}_{[n]} , where \bm{\mathbf{x}}_{[n],i_{n}:}=\text{vec}\left(\bm{\mathscr{{X}}}_{\cdots i_{n}\cdots}\right),\forall i_{n}=1,\ldots,I_{n} . We use underlined vectors to represent the set of indices, e.g. , \bm{\mathbf{\underline{{i}}}}=(i_{1},i_{2},\ldots,i_{N}) . We use \circ to denote outer product, \odot to denote Khatri-Rao product, and \ast to denote Hadamard product. D_{\mathrm{TV}} and D_{\mathrm{KL}} denote the total variation and Kullback-Leibler divergence. 2.1 Tensor Decomposition The goal of tensor decomposition is to learn parsimonious representations of multi-dimensional arrays, e.g. , \bm{\mathscr{{X}}}\in\mathbb{R}^{I_{1}\times I_{2}\times\cdots\times I_{N}} , where N is the order of the tensor and I_{n} is the dimension along the n -th mode. In this work, we focus on the CP decomposition, denoted as, \displaystyle\bm{\mathscr{{X}}} \displaystyle=\mathsf{CP}\left(\bm{\mathbf{\lambda}},{\bm{\mathbf{A}}}^{(1)},{\bm{\mathbf{A}}}^{(2)},\ldots,{\bm{\mathbf{A}}}^{(N)}\right) (1) \displaystyle=\sum_{r=1}^{R}\lambda_{r}\bm{\mathbf{a}}^{(1)}_{:r}\circ\bm{\mathbf{a}}^{(2)}_{:r}\cdots\circ\bm{\mathbf{a}}^{(N)}_{:r}, where the number R is the CP rank. The CP form factorizes a tensor into a sum of rank-one tensors. \bm{\mathbf{A}}^{(n)}\in\mathbb{R}^{I_{n}\times R},\forall n=1,\ldots,N are called factor matrices, and \bm{\mathbf{\lambda}}\in\mathbb{R}^{R} is the weight vector. Usually, TD problems are solved by minimizing the loss functions such as, \min_{\bm{\mathbf{\lambda}},\bm{\mathbf{A}}^{(1)},\ldots,\bm{\mathbf{A}}^{(N)}}\left\|\bm{\mathscr{{O}}}\ast\left(\bm{\mathscr{{Y}}}-\mathsf{CP}\left(\bm{\mathbf{\lambda}},{\bm{\mathbf{A}}}^{(1)},\ldots,{\bm{\mathbf{A}}}^{(N)}\right)\right)\right\|_{F}^{2}, where \bm{\mathscr{{Y}}} is the observation and \bm{\mathscr{{O}}} is the binary mask. Usually, adding prior information or regularization on the latent factors \bm{\mathbf{A}}^{(1:N)} or the estimate tensor \bm{\mathscr{{X}}} can improve the performance. However, these priors are usually heuristic and handcrafted such as smoothness ( 5 ) or sparsity ( 58 ; 41 ) . 2.2 Diffusion Model Diffusion models have become the most powerful class of generative models, especially for images. Diffusion models have been proposed from different disciplines ( 34 ; 15 ; 35 ) . The work of EDM ( 16 ) provides a unified framework to understand different diffusion models. Suppose the data is diffused by \bm{\mathbf{x}}_{t}=s(t)\bm{\mathbf{x}}+\sigma(t)\bm{\mathbf{\epsilon}} , where s(t) and \sigma(t) are two functions of time t , and \bm{\mathbf{\epsilon}}\sim\mathcal{{N}}(\bm{\mathbf{0}},\bm{\mathbf{I}}) . Denote p(\bm{\mathbf{x}}_{t};\sigma(t)) as the diffused distribution. The reversed denoising process follows the SDE, \displaystyle\mathop{}\!\mathrm{d}\bm{\mathbf{x}}_{t}=\left[u(t)\bm{\mathbf{x}}_{t}-v(t)\nabla_{\bm{\mathbf{x}}_{t}}\log p\left(\frac{\bm{\mathbf{x}}_{t}}{s(t)};\sigma(t)\right)\right]\mathop{}\!\mathrm{d}t (2) \displaystyle+\sqrt{v(t)}\mathop{}\!\mathrm{d}\bar{\bm{\mathbf{w}}}_{t}, where u(t)=\dot{s}(t)/s(t) , v(t)=2s(t)^{2}\dot{\sigma}(t)\sigma(t) , and \bar{\bm{\mathbf{w}}} is the standard Wiener process. The only unknown term is the score function \nabla_{\bm{\mathbf{x}}}\log p(\bm{\mathbf{x}};\sigma(t)) , which is approximated by a neural network s_{\psi}(\bm{\mathbf{x}}_{t},t) and trained by score matching techniques. By solving the SDE from a large t to 0 , we can sample from the data distribution or denoise noisy data. Nowadays, diffusion models have become the state-of-the-art generative models, and there are many off-the-shelf pre-trained diffusion models for different types of data. 3 Proposed Model and Algorithm 3.1 Probabilistic CP Decomposition To incorporate powerful data priors into the CP decomposition, we develop the probabilistic CP decomposition model. The joint probability of the proposed decomposition is, \displaystyle p(\bm{\mathscr{{Y}}},\bm{\mathscr{{X}}},\bm{\mathbf{\lambda}},\bm{\mathbf{A}}^{(1:N)},\tau)\propto (3) \displaystyle p(\bm{\mathscr{{Y}}}\mid\bm{\mathscr{{X}}},\tau)\,p(\bm{\mathscr{{X}}}\mid\bm{\mathbf{A}}^{(1:N)},\bm{\mathbf{\lambda}})\,p(\bm{\mathbf{A}}^{(1:N)})\,p(\bm{\mathbf{\lambda}})\,p(\bm{\mathscr{{X}}})\,p(\tau), where \bm{\mathbf{\lambda}},\bm{\mathbf{A}}^{(1:N)} are the CP factors in Eq. 1 and \bm{\mathscr{{X}}} is the reconstructed tensor. The structural factor p(\bm{\mathscr{{X}}}\mid\bm{\mathbf{A}}^{(1:N)},\bm{\mathbf{\lambda}})=\delta(\bm{\mathscr{{X}}}-\mathsf{CP}\left(\bm{\mathbf{\lambda}},{\bm{\mathbf{A}}}^{(1)},{\bm{\mathbf{A}}}^{(2)},\ldots,{\bm{\mathbf{A}}}^{(N)}\right)) encodes the low-rank CP constraint; p(\bm{\mathbf{A}}^{(1:N)}) , p(\bm{\mathbf{\lambda}}) , and p(\tau) are the conjugate factor priors specified below; and p(\bm{\mathscr{{X}}}) is a powerful pre-trained diffusion prior placed directly on the reconstructed tensor. Although \bm{\mathscr{{X}}} enters the joint through two factors, they play complementary roles: p(\bm{\mathscr{{X}}}\mid\bm{\mathbf{A}}^{(1:N)},\bm{\mathbf{\lambda}}) is a hard structural constraint that ties \bm{\mathscr{{X}}} to the CP factors, while p(\bm{\mathscr{{X}}}) is a soft data-driven regularizer on the reconstructed tensor. The two priors p(\bm{\mathscr{{X}}}) and p(\bm{\mathbf{A}}^{(1:N)})p(\bm{\mathbf{\lambda}}) jointly form a hybrid prior that fuses a structural low-rank component with a learned data-driven component in a single posterior. To our knowledge, this is the first Bayesian tensor decomposition that admits an off-the-shelf diffusion model as the data prior, extending the plug-and-play paradigm ( 44 ; 30 ; 48 ) from generic inverse problems to a fully probabilistic CP model with automatic rank and noise inference. For the likelihood, we consider each element is independently observed from the Normal distribution, y_{\bm{\mathbf{\underline{{i}}}}}\mid x_{\bm{\mathbf{\underline{{i}}}}},\tau\sim\mathrm{Normal}(y_{\bm{\mathbf{\underline{{i}}}}}\mid x_{\bm{\mathbf{\underline{{i}}}}},\tau^{-1}),\quad\forall\bm{\mathbf{\underline{{i}}}}\in\Omega, where \Omega denotes the set of observed entries in \bm{\mathscr{{O}}} . Latent variable priors Let \{\tau,\bm{\mathbf{\lambda}},\bm{\mathbf{A}}^{(1:N)}\} be latent variables. The precision follows a conjugate Gamma prior, \tau\sim\mathrm{Gamma}(\tau\mid\alpha_{0},\kappa_{0}), where \alpha_{0} , \kappa_{0} are the shape and rate parameters respectively. For the weight, we adopt the CUmulative Shrinkage Process (CUSP) prior ( 22 ) , which provides column-wise shrinkage that, combined with the rank-adaptation procedure below, makes DiffBCP adaptive to unknown CP rank, \displaystyle\lambda_{r}\mid\theta_{r}\sim\mathcal{{N}}(0,\theta_{r}),\,\,\theta_{r}\mid\pi_{r}\sim(1-\pi_{r})P_{0}+\pi_{r}\delta_{\theta_{\infty}}, \displaystyle\pi_{r}=\sum_{l=1}^{r}\omega_{l},\quad\omega_{l}=\nu_{l}\prod_{m=1}^{l-1}(1-\nu_{m}), where \nu_{l}\overset{\mathrm{iid}}{\sim}\mathrm{Beta}(1,\beta) , \theta_{\infty} is a small positive constant, \delta_{\theta_{\infty}} is the Dirac delta function, and P_{0} is a starting continuous distribution. As the rank r increases, the distribution of \lambda_{r} gradually diffuses from P_{0} to \delta_{\theta_{\infty}} almost surely. This is similar to a spike-and-slab prior, but with hierachical mixture proabability that can increasingly shrink factors. In practice, we set P_{0}=\mathrm{InvGamma}(\alpha_{\theta},\beta_{\theta}) with \alpha_{\theta}>1 and \theta_{\infty}=$1\text{\times}{10}^{-3}$ . For the factor matrices, we assume each element follows a Gaussian prior, a^{(n)}_{ir}\sim\mathrm{Normal}(0,1),\quad\forall n,i,r. This prior regularizes the norm of factor matrices, so that we can truncate the rank based on the value of \bm{\mathbf{\lambda}} . Diffusion model prior In the whole probabilistic model in Eq. 3 , we still need to specify the data prior p(\bm{\mathscr{{X}}}) . Most existing probabilistic TD methods leave p(\bm{\mathscr{{X}}}) implicit or treat it as a non-informative constant, in which case Eq. 3 reduces to a classical Bayesian CP ( 28 ; 52 ) (up to the CUSP shrinkage on the weights) and the model only exploits low-rank structure. We instead instantiate p(\bm{\mathscr{{X}}}) as a pre-trained diffusion model, which contributes a learned natural-data expert on the reconstructed tensor and is the key ingredient that allows DiffBCP to recover rich textures and structures under heavy missingness and noise. We assume the reconstructed tensor \bm{\mathscr{{X}}} follows a diffusion model prior, that means, the diffused proabability follows, \nabla_{\bm{\mathscr{{X}}}_{t}}\log p(\bm{\mathscr{{X}}}_{t};\sigma(t))=s_{\psi}(\bm{\mathscr{{X}}}_{t},t), where s_{\psi} is a pre-trained score network. Given this prior, we can sample \bm{\mathscr{{X}}} by solving the SDE in Eq. 2 . Considering the above probability formulation, we show that the CUSP prior can effectively shrink the residual of the CP decomposition. Theorem 3.1 . Denote the \bm{\mathbf{\underline{{i}}}} -th element in the r -th component as x_{r,\bm{\mathbf{\underline{{i}}}}}=\lambda_{r}\prod_{n=1}^{N}a^{(n)}_{i_{n}r} . Suppose the factor is bounded by \eta in second moment, i.e. , \mathbb{E}(a^{(n)}_{i_{n}r})^{2}<\eta_{n},\forall n,i_{n},r . Then \forall\epsilon>0 , we have, \displaystyle p((x_{r,\bm{\mathbf{\underline{{i}}}}})^{2}\geq\epsilon)\leq \displaystyle\qquad\frac{1}{\epsilon}\left[\left(\frac{\beta}{1+\beta}\right)^{r}\left(\frac{\beta_{\theta}}{\alpha_{\theta}-1}-\theta_{\infty}\right)+\theta_{\infty}\right]\prod_{n=1}^{N}\eta_{n}. Remark 3.2 . The proof is deferred to appendix Section B.1 . Since \theta_{\infty} is usually set to a small value, the CUSP prior effectively shrinks the tail probability of each component as the rank r increases. We can constrol the tail probability by adjusting the hyperparameter \beta . If we desire larger shrinkage, we may set a smaller \beta . 3.2 Split Gibbs Sampler To get posterior samples, we need to sample from the joint distribution, \displaystyle\exp(-\ell(\bm{\mathscr{{Y}}};\bm{\mathscr{{X}}},\tau)-g(\bm{\mathscr{{X}}})- (4) \displaystyle f_{\lambda}(\bm{\mathbf{\lambda}}\mid\bm{\mathbf{\theta}})-f_{\bm{\mathbf{\theta}}}(\bm{\mathbf{\theta}})-f_{\bm{\mathbf{A}}}(\bm{\mathbf{A}})-f_{\tau}(\tau)), \displaystyle s.t.\quad\bm{\mathscr{{X}}}=\mathsf{CP}\left(\bm{\mathbf{\lambda}},{\bm{\mathbf{A}}}^{(1)},{\bm{\mathbf{A}}}^{(2)},\ldots,{\bm{\mathbf{A}}}^{(N)}\right). Directly sampling from this distribution is difficult, because the likelihood, the prior on \bm{\mathscr{{X}}} , and the prior of factors \bm{\mathbf{A}} are coupled together. Moreover, since the diffusion prior on \bm{\mathscr{{X}}} is implicit, even Langevin samplers for \bm{\mathbf{A}} are infeasible to implement. To solve this problem, we adopt the Split Gibbs Sampler ( 45 , SGS,) . Introducing an augmented variable \bm{\mathscr{{Z}}} , the sampling problem becomes, \displaystyle\exp(-\ell(\bm{\mathscr{{Y}}};\bm{\mathscr{{X}}},\tau)-g(\bm{\mathscr{{Z}}})-\phi(\bm{\mathscr{{Z}}},\bm{\mathscr{{X}}};\rho)- \displaystyle\qquad\qquad f_{\lambda}(\bm{\mathbf{\lambda}}\mid\bm{\mathbf{\theta}})-f_{\bm{\mathbf{\theta}}}(\bm{\mathbf{\theta}})-f_{\bm{\mathbf{A}}}(\bm{\mathbf{A}})-f_{\tau}(\tau)), \displaystyle s.t.\quad\bm{\mathscr{{X}}}=\mathsf{CP}\left(\bm{\mathbf{\lambda}},{\bm{\mathbf{A}}}^{(1)},{\bm{\mathbf{A}}}^{(2)},\ldots,{\bm{\mathbf{A}}}^{(N)}\right), where \phi is some distance measure and \rho>0 is a hyperparameter controlling the coupling strength. If this distance measure converges to zero when \bm{\mathscr{{X}}} and \bm{\mathscr{{Z}}} are close, the marginal distribution converges to the original distribution ( 45 ) . Then, we can derive the Gibbs sampler of each random variable. Following 45 ; 10 ; 48 , the distance is defined as, \phi(\bm{\mathscr{{Z}}},\bm{\mathscr{{X}}};\rho)=\frac{1}{2\rho^{2}}\lVert\bm{\mathscr{{Z}}}-\bm{\mathscr{{X}}}\rVert_{F}^{2}. (5) 3.2.1 Latent Variable Steps First, we show how to sample all latent variables including the CP weight, factor matrices, the noise precision, and CUSP parameters. To sample from the CUSP prior, we introduce an augmentation variable \bm{\mathbf{\zeta}}\in\{0,1\} . Sample \bm{\mathbf{\lambda}} For r=1,\ldots,R , \lambda_{r}\mid\cdots\sim\mathcal{{N}}(\mu_{r},\sigma_{r}), (6) where, \displaystyle\sigma_{r}=\left(\theta_{r}+\tau\lVert\bm{\mathscr{{O}}}\ast\bm{\mathscr{{C}}}^{r}\rVert^{2}_{F}+\frac{1}{\rho^{2}}\lVert\bm{\mathscr{{C}}}^{r}\rVert^{2}_{F}\right)^{-1},\quad\mu_{r}= \displaystyle\sigma_{r}\mathsf{Sum}\left(\tau\bm{\mathscr{{O}}}\ast\bm{\mathscr{{C}}}^{r}\ast(\bm{\mathscr{{Y}}}-\bm{\mathscr{{D}}}^{r})+\frac{1}{\rho^{2}}\bm{\mathscr{{C}}}^{r}\ast(\bm{\mathscr{{Z}}}-\bm{\mathscr{{D}}}^{r})\right), with \bm{\mathscr{{C}}}^{r}=\bm{\mathbf{a}}^{(1)}_{:r}\circ\bm{\mathbf{a}}^{(2)}_{:r}\circ\cdots\circ\bm{\mathbf{a}}^{(N)}_{:r} , \bm{\mathscr{{D}}}^{r}=\sum_{j\neq r}\lambda_{j}\bm{\mathscr{{C}}}^{j} , and \mathsf{Sum}(\cdot) the sum of all elements. Sample \bm{\mathbf{A}}^{(n)} For n=1,\ldots,N and i=1,\ldots,I_{n} , the full conditional distribution of \bm{\mathbf{a}}^{(n)}_{i:} is, \bm{\mathbf{a}}^{(n)}_{i}|\cdots\sim\mathcal{{N}}(\bm{\mathbf{\mu}}^{(n)}_{i},\bm{\mathbf{\Sigma}}^{(n)}), (7) where, \displaystyle\bm{\mathbf{\Sigma}}^{(n)} \displaystyle=\left(\bm{\mathbf{I}}+\bm{\mathbf{B}}^{(n)}\text{diag}(\tau\bm{\mathbf{o}}_{[n],i:}+1/\rho^{2})\bm{\mathbf{B}}^{(n)\mathsf{T}}\right)^{-1}, \displaystyle\bm{\mathbf{\mu}}^{(n)}_{i} \displaystyle=\bm{\mathbf{\Sigma}}^{(n)}\left(\tau\bm{\mathbf{y}}_{[n],i:}\text{diag}(\bm{\mathbf{o}}_{[n],i:})+\frac{1}{\rho^{2}}\bm{\mathbf{z}}_{[n],i:}\right)\bm{\mathbf{B}}^{(n)\mathsf{T}}. with \bm{\mathbf{B}}^{(n)} defined by, \bm{\mathbf{B}}^{(n)}=\bm{\mathbf{\Lambda}}\left(\bm{\mathbf{A}}^{(N)}\odot\cdots\bm{\mathbf{A}}^{(n+1)}\odot\bm{\mathbf{A}}^{(n-1)}\odot\cdots\bm{\mathbf{A}}^{(1)}\right)^{\mathsf{T}}. Remark 3.3 . We follow 28 to adaptively adjust the number of components in \bm{\mathbf{\lambda}} (the CP rank). This procedure is denoted as \mathsf{adapt\_factor}(\bm{\mathbf{\lambda}},\bm{\mathbf{A}}) and details are shown in the appendix Appendix A . At sampling step i , we adapt the rank with probability p(i)=\exp(\alpha_{0}+\alpha_{1}i) , where \alpha_{0} and \alpha_{1} are hyperparameters. If there are inactive factors, we remove them. If all factors are active, we add a new factor (and associated parameters) from the priors. Together with the CUSP prior, this yields a bidirectional rank-adaptation scheme: CUSP shrinks redundant components toward \delta_{\theta_{\infty}} which are then physically pruned, while a new component is sampled whenever the current rank turns out to be insufficient. Consequently, DiffBCP is robust to mis-specification of the initial rank in either direction. Sample \tau The noise precision can be sampled from a conjugate Gamma distribution, \tau\mid\dots\sim\mathrm{Gamma}\left(\alpha_{0}+\frac{|\Omega|}{2},\kappa_{0}+\frac{1}{2}\sum_{\bm{\mathbf{\underline{{i}}}}\in\Omega}(y_{\bm{\mathbf{\underline{{i}}}}}-x_{\bm{\mathbf{\underline{{i}}}}})^{2}\right), (8) where |\Omega| is the number of observed entries. Sample \bm{\mathbf{\zeta}} For r=1,\ldots,R , the posterior \zeta_{r}=h\mid\cdots\propto \omega_{h}\cdot\begin{cases}\mathrm{Normal}(\lambda_{r};0,\theta_{\infty}),&h\leq r\\ \mathrm{Student\mbox{-}t}_{2\alpha_{\theta}}(\lambda_{r};0,\beta_{\theta}/\alpha_{\theta}),&h>r.\end{cases} (9) Sample \bm{\mathbf{\nu}} For r=1,\ldots,R-1 , the posterior \nu_{r}\mid\cdots\sim \mathrm{Beta}\left(1+\sum_{h=1}^{R}\mathbbm{1}(\zeta_{h}=r),\beta+\sum_{h=1}^{R}\mathbbm{1}(\zeta_{h}>r)\right), (10) and set \nu_{R}=1 . Sample \bm{\mathbf{\theta}} For r=1,\ldots,R , the posterior \theta_{r}\mid\cdots\sim \mathrm{InvGamma}\left(\alpha_{\theta}+\frac{1}{2},\beta_{\theta}+\frac{\lambda_{r}^{2}}{2}\right)^{\mathbbm{1}(\zeta_{r}>r)}\cdot\delta_{\theta_{\infty}}^{\mathbbm{1}(\zeta_{r}\leq r)}. (11) Input: Data \bm{\mathscr{{Y}}} , Diffusion Model s_{\psi} , Coupling constant c , Hyper-priors. Output: Posterior samples of CP factors \bm{\mathbf{\lambda}},\bm{\mathbf{A}}^{(1:N)} . for i=1,\dots,M do Compute \rho=\sqrt{c/\tau} ; Sample \bm{\mathbf{\lambda}} from Eq. 6 ; Sample \bm{\mathbf{A}}^{(n)},\forall n from Eq. 7 ; \mathsf{adapt\_factor}(\bm{\mathbf{\lambda}},\bm{\mathbf{A}}^{(1:N)}) ; Sample \tau from Eq. 8 ; Sample \zeta_{r},\forall r from Eq. 9 ; Sample \nu_{r},\forall r from Eq. 10 ; Sample \theta_{r},\forall r from Eq. 11 ; Find T_{i} according to \sigma(T_{i})=\rho ; for t=T_{i},\dots,1 do Denoising step by Eq. 2 ; end for Collect samples after burn-in; end for Algorithm 1 Gibbs sampler for DiffBCP 3.2.2 Augmented Variable Step Second, we show how to sample the augmented variable given the diffusion model prior. Suppose we have a pre-trained score network s_{\psi}(\bm{\mathscr{{X}}}_{t},t) , following the EDM framework described in Section 2.2 . The conditional distribution of \bm{\mathscr{{Z}}} is, \bm{\mathscr{{Z}}}\mid\cdots\sim\exp(-g(\bm{\mathscr{{Z}}})-\phi(\bm{\mathscr{{Z}}},\bm{\mathscr{{X}}};\rho)), (12) where g(\bm{\mathscr{{Z}}}) is the implicit prior defined by the diffusion model. Since the distance \phi is defined as the squared error in Eq. 5 , sampling from the posterior Eq. 12 is essentially a denoising problem with prior g(\bm{\mathscr{{Z}}}) and observation \bm{\mathscr{{X}}} with noise level \rho ( 10 ; 48 ) . Different from PnP-DM ( 48 ) where the guidance is unconstrained, here the guidance \bm{\mathscr{{X}}} is constrained by the CP decomposition structure. The sampling can be solved by running the EDM denoising process Eq. 2 . Specifically, for given noise level \rho , we find the corresponding time step t such that \sigma(t)=\rho . Then, we solve the SDE in Eq. 2 from t to 0 to get the sample of \bm{\mathscr{{Z}}} . Noise-adaptive coupling schedule As we will discuss in the next subsection, the coupling parameter \rho plays an important role in the sampling process. Thus, we need to design a proper annealing schedule for \rho . In 10 ; 48 ; 50 , heuristic and deterministic schedules are tested. However, the performances may be sensitive to the choice of scheduler. In our formulation, \tau and \rho always appear jointly in the conditional updates, e.g. , Eqs. 6 and 7 . Thus the optimization/sampling landscape seen by the latent variables is shaped by the relative magnitude between \tau and \rho^{-2} rather than \rho alone. Motivated by this, we set \tau\rho^{2}=c , where c is a hyperparameter constant. When \tau is inferred during the sampling procedure, this rule automatically adjusts \rho to maintain a fixed relative scale between the likelihood and coupling terms. The overall algorithm is summarized in Algorithm 1 . More details and derivation can be find in appendix Appendix A . 3.2.3 Theoretical Properties In this subsection, we investigate the approximations in the sampling algorithm and how the noise parameter \rho affects the sampling process. Define the set of all hyperparameters ( \tau,\bm{\mathbf{\zeta}},\bm{\mathbf{\nu}},\bm{\mathbf{\theta}} ) and CP factors ( \bm{\mathbf{\lambda}},\bm{\mathbf{A}}^{(1:N)} ) as \Theta . The \rho -smoothed prior induced by the diffusion model is, p_{\rho}(\bm{\mathscr{{X}}})=\frac{1}{C_{\rho}}\int p(\bm{\mathscr{{Z}}})\exp(-\varphi(\bm{\mathscr{{Z}}},\bm{\mathscr{{X}}};\rho))\mathop{}\!\mathrm{d}\bm{\mathscr{{Z}}}, where C_{\rho} is the normalizing constant. Denote the marginalized posterior as, \pi_{\rho,\bm{\mathscr{{X}}}}(\Theta)\propto p(\bm{\mathscr{{Y}}}\mid\bm{\mathscr{{X}}}(\Theta),\tau)p(\Theta)p_{\rho}(\bm{\mathscr{{X}}}(\Theta)), (13) and the original posterior \pi_{0}(\Theta) defined in Eq. 4 . Under some conditions on the joint probability, 45 shows that the smoothed posterior \pi_{\rho,\bm{\mathscr{{X}}}}(\Theta) converges to the original posterior \pi_{0}(\Theta) as \rho\rightarrow 0 , i.e., \lim_{\rho\rightarrow 0}D_{\mathrm{TV}}(\pi_{\rho,\bm{\mathscr{{X}}}},\pi_{0})=0. (14) This indicates that by choosing a smaller \rho , we can reduce the bias introduced by the split Gibbs sampler. However, using small \rho also makes the denoising step more challenging, especially when the score function is approximated by a neural network. Let \pi_{\rho}(\bm{\mathscr{{Z}}},\Theta) be the target joint density of the augmented form, \pi_{\rho}(\bm{\mathscr{{Z}}},\Theta)\propto p(\bm{\mathscr{{Y}}}\mid\bm{\mathscr{{X}}}(\Theta),\tau)p(\Theta)p(\bm{\mathscr{{Z}}})\exp(-\phi(\bm{\mathscr{{Z}}},\bm{\mathscr{{X}}};\rho)), (15) with conditionals \pi_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta) and \pi_{\rho}(\Theta\mid\bm{\mathscr{{Z}}}) , and let \pi_{\rho,\bm{\mathscr{{X}}}}(\Theta)=\int\pi_{\rho}(\bm{\mathscr{{Z}}},\Theta)\,d\bm{\mathscr{{Z}}} be its marginal on \Theta . Assume that the practical diffusion sampler used in the denoising step induces a conditional density q_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta)\approx\pi_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta) (for each fixed \Theta ), and consider the inexact block Gibbs chain that alternates \bm{\mathscr{{Z}}}^{k+1}\sim q_{\rho}(\,\cdot\mid\Theta^{k}),\qquad\Theta^{k+1}\sim\pi_{\rho}(\,\cdot\mid\bm{\mathscr{{Z}}}^{k+1}). Assume moreover that the two families of conditionals \pi_{\rho}(\Theta\mid\bm{\mathscr{{Z}}}) and q_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta) are compatible, so that the above Markov chain admits a stationary joint distribution \tilde{\pi}_{\rho}(\bm{\mathscr{{Z}}},\Theta) . Denote \tilde{\pi}_{\rho,\bm{\mathscr{{X}}}}(\Theta)=\int\tilde{\pi}_{\rho}(\bm{\mathscr{{Z}}},\Theta)\mathop{}\!\mathrm{d}\bm{\mathscr{{Z}}} and \pi_{\rho,\bm{\mathscr{{Z}}}}(\bm{\mathscr{{Z}}})=\int\pi_{\rho}(\bm{\mathscr{{Z}}},\Theta)\mathop{}\!\mathrm{d}\Theta . The following theorem quantifies the stationary bias on \Theta induced by the inexact diffusion denoising step. Theorem 3.4 . For any \Theta in the support of \pi_{\rho,\bm{\mathscr{{X}}}} , the stationary bias on \Theta can be quantified as \displaystyle D_{\mathrm{KL}}\!\left(\pi_{\rho,\bm{\mathscr{{X}}}}\,\|\,\tilde{\pi}_{\rho,\bm{\mathscr{{X}}}}\right)= (16) \displaystyle\mathbb{E}_{\Theta\sim\pi_{\rho,\bm{\mathscr{{X}}}}}\left[\log\,\mathbb{E}_{\bm{\mathscr{{Z}}}\sim\pi_{\rho,\bm{\mathscr{{Z}}}}}\left(\frac{q_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta)}{\pi_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta)}\right)\right]. The proof follows 13 and we defer it to appendix Section B.2 . Eqs. 14 and 3.4 can be used to explain the overall bias in the following corollary. Table 1 : Results for FFHQ and ImageNet datasets. PSNR \uparrow , SSIM \uparrow , and LPIPS \downarrow metrics are reported, while SSIM and LPIPS are multiplied by 100 for better readability. Purple rows indicate TDs with deep (neural network) structures. Green rows indicate TDs with smooth or pre-trained model priors. Uniform(0.7) Uniform(0.9) Stripe Irregular Method PSNR SSIM LPIPS PSNR SSIM LPIPS PSNR SSIM LPIPS PSNR SSIM LPIPS FFHQ BCP 26.28 64.53 51.56 21.61 44.56 61.95 9.26 25.28 65.68 22.64 62.52 47.30 BTR 27.32 68.22 45.16 24.22 58.58 56.23 19.63 50.35 53.22 24.91 66.74 43.98 HLRTF 28.16 77.92 40.94 25.12 66.55 52.08 25.21 75.15 40.20 25.84 77.42 37.27 DeepTensor 28.23 72.23 30.83 26.11 61.66 40.65 26.44 75.70 29.53 28.01 79.49 26.19 tCTV 26.40 59.18 38.19 25.18 59.94 48.16 24.32 58.61 43.59 24.97 53.98 36.03 GLON 13.02 27.18 62.89 7.47 17.65 36.83 21.38 53.53 47.84 22.69 53.21 40.89 DiffBCP 32.13 88.83 17.70 28.28 81.18 28.93 27.91 85.11 19.89 30.34 88.60 15.98 ImageNet BCP 24.34 61.07 47.97 20.17 39.71 59.46 10.05 28.62 62.56 21.33 61.21 41.93 BTR 25.03 63.44 43.58 21.80 48.37 56.15 18.68 49.45 49.79 22.44 60.81 42.94 HLRTF 26.00 73.94 38.56 22.65 59.35 50.66 23.30 70.09 38.34 22.01 71.83 35.73 DeepTensor 26.03 68.81 32.60 23.74 56.46 42.85 23.87 68.64 32.60 25.16 73.10 29.30 tCTV 24.94 60.13 36.78 23.03 54.83 48.50 22.87 58.14 41.47 23.62 55.96 33.89 GLON 12.47 27.46 60.45 7.02 15.39 70.43 20.65 53.14 45.60 21.54 54.86 41.01 DiffBCP 28.95 84.53 21.27 25.03 71.49 35.58 25.07 77.58 24.83 27.02 83.09 19.66 Corollary 3.5 . For any bounded measurable function f , \displaystyle\big|\mathbb{E}_{\tilde{\pi}_{\rho,\bm{\mathscr{{X}}}}}[f(\Theta)]-\mathbb{E}_{\pi_{0,\bm{\mathscr{{X}}}}}[f(\Theta)]\big|\leq (17) \displaystyle\big|\mathbb{E}_{\pi_{\rho,\bm{\mathscr{{X}}}}}[f(\Theta)]-\mathbb{E}_{\pi_{0,\bm{\mathscr{{X}}}}}[f(\Theta)]\big|+ \displaystyle\|f\|_{\infty}\,\sqrt{2D_{\mathrm{KL}}\!\left(\pi_{\rho,\bm{\mathscr{{X}}}}\,\|\,\tilde{\pi}_{\rho,\bm{\mathscr{{X}}}}\right)}, where the last term is given by Eq. 16 . Remark 3.6 . The first term on the RHS of Eq. 17 converges to 0 as \rho\rightarrow 0 by Eq. 14 . The second term instead quantifies the stationary bias induced by the inexact diffusion step, as characterized in Theorem 3.4 . It becomes smaller as q_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta) gets closer to \pi_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta) , which is expected to happen when \rho increases, since the denoising becomes easier. Thus there is a trade-off in the choice of \rho . 4 Experiments Experiments are conducted on single NVIDIA A100 GPU with 40GB VRAM unless otherwise specified. More details and results are provided in appendix Appendix D . The code is available at https://github.com/taozerui/DiffBCP . Original Observe BCP BTR HLRTF DeepTensor tCTV GLON DiffBCP Figure 1 : Visualization for FFHQ and ImageNet datasets. From top to bottom: ImageNet with Uniform(0.7), FFHQ with Uniform(0.9), ImageNet with Stripe, and FFHQ with Irregular masks. 4.1 Image Inpainting and Denoising In this experiment, we evaluate our method on natural image inpainting and denoising tasks, with pre-trained diffusion models on corresponding datasets as priors. Datasets and pre-trained models We adopt FFHQ ( 17 ) and ImageNet ( 11 ) . We use the pre-trained diffusion model for both datasets with checkpoints from 8 . For each dataset, 128 images from the test set are randomly selected for evaluation. We adopt three types of masks for inpainting: (1) Uniform(0.9/0.7) randomly masks 90%/70% pixels in a uniform manner; (2) Stripe randomly masks pixels in horizontal and vertical stripes; (3) Irregular masks pixels using lines with random lengths and angles. Finally, all images are scaled to range [0,1] and iid Gaussian noise with standard variance \sigma=0.05 is added for denoising. Baselines We compare with Bayesian CP ( 52 , BCP,) , Bayesian Tensor Ring ( 25 , BTR,) , Hierarchical Low-Rank Tensor Factorization ( 26 , HLRTF,) , TD with Deep network priors ( 31 , DeepTensor,) , TD with a tensor Correlated Total Variation regularization ( 46 , tCTV,) , and TD with Global-LOcal-Nonlocal priors ( 55 , GLON,) . BCP and BTR are two traditional Bayesian TD for CP and TR decompositions. HLRTF and DeepTensor are two deep learning-based TD methods. GLON is a TD method that leverages pre-trained neural networks as priors. However, GLON only applies for pre-trained denoising networks with fixed noise levels. Results We evaluate reconstruction quality using three complementary metrics: peak signal-to-noise ratio (PSNR) measuring pixel-wise accuracy, structural similarity index (SSIM) capturing perceptual similarity, and learned perceptual image patch similarity ( 51 , LPIPS,) quantifying semantic fidelity. Higher PSNR/SSIM and lower LPIPS indicate better performance. The quantitative results in Table 1 demonstrate that DiffBCP consistently outperforms all baselines across different datasets and missing patterns. Specifically, on FFHQ with Uniform(0.9) mask, DiffBCP achieves 28.28 dB PSNR, improving over the best baseline (DeepTensor) by 2.17 dB. The gains are even more pronounced on Irregular masks (+2.33 dB) where structured priors matter most. On ImageNet, DiffBCP maintains strong performance on all metrics, with average improvements of 1.82 dB in PSNR and 12.42 in SSIM over the best competing method. The qualitative comparisons in Fig. 1 reveal that DiffBCP reconstructs sharper textures and more coherent structures. Traditional multi-linear methods (BCP and BTR) produce overly coarse results due to limited prior expressiveness, e.g. , we can easily identify the low-rank structures. Non-linear decompositions (HLRTF and DeepTensor) generate finer-grained details but suffer from artifacts. GLON exhibits severe instability, particularly at high missing ratios (90%+), often converging to trivial solutions (predicting all missing pixels as zero); this explains its poor quantitative performance in Table 1 . In contrast, DiffBCP leverages the powerful diffusion prior while maintaining stable inference through the split Gibbs sampler. We ablate the diffusion prior and the CUSP shrinkage prior in Section D.3 , and report sensitivity to the scheduling hyperparameters c and \rho_{\min} in Section D.5 . The two ablations show that (i) the diffusion prior is the main source of gain on structured masks, and (ii) CUSP enables strong recovery even when the initial CP rank is severely under-specified, so the model is not sensitive to the choice of initial rank. Table 2 : Results for high-resolution images. PSNR \uparrow and SSIM \uparrow metrics are reported, while SSIM is multiplied by 100 for better readability. Uni(0.9) Uni(0.95) Irr Method PSNR SSIM PSNR SSIM PSNR SSIM Marseille BCP 16.94 29.42 15.89 26.55 17.63 33.55 PuTT 19.63 36.47 17.86 28.26 19.83 40.84 DiffBCP 20.15 39.08 18.01 28.42 20.94 46.75 Tokyo BCP 17.89 37.61 16.90 36.67 18.62 40.40 PuTT 19.98 39.52 18.33 30.74 20.27 45.03 DiffBCP 20.66 44.90 18.90 35.50 21.36 51.38 Westerlund BCP 21.12 65.60 20.08 65.09 22.26 68.34 PuTT 24.43 65.68 23.00 55.70 24.38 68.21 DiffBCP 23.85 68.33 21.86 66.16 25.27 74.03 Original Observe BCP PuTT DiffBCP Figure 2 : Visualization for high-resolution images. From top to bottom: Marseille with Uniform(0.9), Tokyo with Uniform(0.95), and Westerlund with Irregular masks. 4.2 Out-of-Distribution and High-Resolution Images A critical challenge for practical deployment is handling images from distributions different from the diffusion prior’s training data, as well as varying resolutions. To assess generalization capability, we evaluate on out-of-distribution (OOD) high-resolution images. We select three diverse 2048\times 2048 images: Marseille (urban landscape), Tokyo (nighttime cityscape), and Westerlund (astronomical image). See appendix Appendix D for their sources. These images are deliberately chosen to be OOD relative to the FFHQ/ImageNet training distributions. The images also test multi-scale reasoning since the diffusion prior was trained on 256\times 256 images. We compare with PuTT ( 24 ) , a recent coarse-to-fine method achieving state-of-the-art results on high-dimensional tensors. For DiffBCP, we apply the reshape operation in Eq. 5 to match the prior’s expected input dimensions while preserving spatial structure. Results in Table 2 show that DiffBCP maintains strong performance even on OOD high-resolution data. On Marseille with Irregular mask, DiffBCP achieves 20.94 dB PSNR versus 19.83 dB for PuTT, despite the significant distribution shift. Qualitative results ( Fig. 2 ) reveal that DiffBCP better preserves fine details and global coherence. PuTT’s coarse-to-fine strategy can introduce boundary artifacts when transitioning between scales, whereas our joint low-rank and diffusion modeling maintains consistency across resolutions. The relatively smaller gaps compared to in-distribution results suggest that the low-rank structure provides an inductive bias that partially compensates for distribution mismatch. 4.3 Improving Diffusion Posterior Sampling Finally, we investigate how the low-rank structure in DiffBCP can improve diffusion posterior sampling, especially comparing with PnP-DM ( 48 ) which shares a similar split Gibbs sampler framework but without tensor decomposition. A direct quantitative comparison with DPS ( 8 ) and PnP-DM under both single-sample and posterior-mean evaluation is deferred to Section D.2 . Figure 3 : (a) Trace plot of PSNR for ImageNet with Uniform(0.7) mask. Thinner lines correspond to individual images and thicker lines show the average. (b) PnP-DM recovery of Tokyo with Uniform(0.95) mask. Faster mixing As shown in Fig. 3 (a), the low-rank assumption leads to an easier posterior distribution, which may lead to faster mixing ( 29 ) . However, we should note that faster mixing does not necessarily lead to better performance, because the low-rank assumption may introduce bias if the data are not exactly low-rank. Robust to noise level and scheduling Following 48 , we clip \rho to [\rho_{min},\rho_{max}] in each sampling step. As shown in Fig. 3 (a), PnP-DM could be sensitive to the scheduling of noise level ( e.g. , \rho_{min} ), while our noise-adaptive coupling schedule tends to be more robust. More results are shown in Section D.5 . High-resolution images As shown in Fig. 3 (b), PnP-DM fails to recover the high-resolution images. As comparison, our method produces much better results as shown in Fig. 2 . The corresponding wall-clock time and peak GPU memory are reported in Section D.7 . 5 Conclusion and Discussion We propose DiffBCP, a principled Bayesian framework for tensor decomposition that integrates pre-trained diffusion models as implicit priors. By combining the structural inductive bias of low-rank CP decomposition with the expressive power of diffusion priors, DiffBCP achieves state-of-the-art performance on tensor completion and denoising tasks. Key contributions include: (1) a cumulative shrinkage prior for automatic rank determination, (2) a split Gibbs sampler enabling tractable posterior inference despite the complex coupling between likelihood, low-rank constraint, and diffusion prior, and (3) an adaptive noise scheduling strategy that removes hyperparameter sensitivity. The performance of DiffBCP rely on the underlying signal admitting a meaningful low-rank structure: when this assumption is violated, the structural contribution of the CP block vanishes while its factor updates remain comparatively more expensive than a pure diffusion sampler. For future research, several directions merit further investigation. First, while we focus on tensor completion and denoising, the framework naturally extends to other linear inverse problems (e.g., compressed sensing, super-resolution). Second, the current implementation processes the full tensor in Steps Eqs. 6 and 7 ; stochastic mini-batch updates could reduce memory overhead for extremely large tensors. Third, we employ CP decomposition in this work, but the framework is compatible with other decompositions that may better capture specific structural patterns; we sketch the extension to tensor train and tensor ring in Appendix C . We hope this work inspires future research at the intersection of tensor decomposition and modern generative models. Acknowledgement We thank the anonymous reviewers and AC for their constructive feedback. ZT was supported by the JSPS KAKENHI Grant Number JP26K21321 and RIKEN Incentive Research Project. QZ was supported by the JSPS KAKENHI Grant Number JP23K28109 and JSPS Bilateral Program Number JPJSBP120257420. Impact Statement This paper presents work whose goal is to advance the field of machine learning, especially tensor decomposition and diffusion models. There are many potential societal consequences of our work, none of which we feel must be specifically highlighted here. Appendix A Derivation of the Gibbs Sampler The augmented joint distribution is, \displaystyle\exp(-\ell(\bm{\mathscr{{Y}}};\bm{\mathscr{{X}}},\tau)-g(\bm{\mathscr{{Z}}})-\phi(\bm{\mathscr{{Z}}},\bm{\mathscr{{X}}};\rho)-f_{\lambda}(\bm{\mathbf{\lambda}}\mid\bm{\mathbf{\theta}})-f_{\bm{\mathbf{\theta}}}(\bm{\mathbf{\theta}})-f_{\bm{\mathbf{A}}}(\bm{\mathbf{A}})-f_{\tau}(\tau)), \displaystyle s.t.\quad\bm{\mathscr{{X}}}=\mathsf{CP}\left(\bm{\mathbf{\lambda}},{\bm{\mathbf{A}}}^{(1)},{\bm{\mathbf{A}}}^{(2)},\ldots,{\bm{\mathbf{A}}}^{(N)}\right). To enable Gibbs sampling of the spike-and-slab prior, we further introduce the augmented variable \bm{\mathbf{\zeta}}=(\zeta_{1},\ldots,\zeta_{R}) , following p(\zeta_{r}=l)=\omega_{l},\forall l=1,\dots,R . This augmentation variable indicate which slab the component r belongs to, \theta_{r}\mid\zeta_{r}\sim\mathbbm{1}(\zeta_{r}>r)\mathrm{InvGamma}(\alpha_{\theta},\beta_{\theta})+\mathbbm{1}(\zeta_{r}\leq r)\delta_{\theta_{\infty}},\qquad\forall r=1,\dots,R, where \mathbbm{1}(\cdot) is the indicator function. After the augmentation, the joint distribution becomes, \displaystyle\exp(-\ell(\bm{\mathscr{{Y}}};\bm{\mathscr{{X}}},\tau)-g(\bm{\mathscr{{Z}}})-\phi(\bm{\mathscr{{Z}}},\bm{\mathscr{{X}}};\rho)-f_{\lambda}(\bm{\mathbf{\lambda}}\mid\bm{\mathbf{\theta}})-f_{\bm{\mathbf{\theta}}}(\bm{\mathbf{\theta}}\mid\bm{\mathbf{\zeta}})-f_{\bm{\mathbf{\zeta}}}(\bm{\mathbf{\zeta}}\mid\bm{\mathbf{\nu}})-f_{\bm{\mathbf{\nu}}}(\bm{\mathbf{\nu}})-f_{\bm{\mathbf{A}}}(\bm{\mathbf{A}})-f_{\tau}(\tau)), \displaystyle s.t.\quad\bm{\mathscr{{X}}}=\mathsf{CP}\left(\bm{\mathbf{\lambda}},{\bm{\mathbf{A}}}^{(1)},{\bm{\mathbf{A}}}^{(2)},\ldots,{\bm{\mathbf{A}}}^{(N)}\right), where the likelihood is defined as, \ell(\bm{\mathscr{{Y}}};\bm{\mathscr{{X}}},\tau)=\frac{\tau}{2}\lVert\bm{\mathscr{{O}}}\ast(\bm{\mathscr{{Y}}}-\bm{\mathscr{{X}}})\rVert^{2}_{F}, and the priors are defined as, \displaystyle\phi(\bm{\mathscr{{Z}}},\bm{\mathscr{{X}}};\rho) \displaystyle=\frac{1}{2\rho^{2}}\lVert\bm{\mathscr{{Z}}}-\bm{\mathscr{{X}}}\rVert^{2}_{F}, \displaystyle f_{\bm{\mathbf{\lambda}}}(\bm{\mathbf{\lambda}}\mid\bm{\mathbf{\theta}}) \displaystyle=\frac{1}{2}\sum_{r=1}^{R}(\theta_{r})^{-1}\lambda_{r}^{2}, \displaystyle f_{\bm{\mathbf{\theta}}}(\bm{\mathbf{\theta}}\mid\bm{\mathbf{\zeta}}) \displaystyle=\sum_{r=1}^{R}\mathrm{InvGamma}(\alpha_{\theta},\beta_{\theta})^{\mathbbm{1}(\zeta_{r}>r)}\delta_{\theta_{\infty}}^{\mathbbm{1}(\zeta_{r}\leq r)}, \displaystyle f_{\bm{\mathbf{\zeta}}}(\bm{\mathbf{\zeta}}\mid\bm{\mathbf{\nu}}) \displaystyle=\mathrm{Categorical}(\bm{\mathbf{\omega}}), \displaystyle f_{\bm{\mathbf{\nu}}}(\bm{\mathbf{\nu}}) \displaystyle=\prod_{r=1}^{R}\mathrm{Beta}(\nu_{r};1,\beta), \displaystyle f_{\bm{\mathbf{A}}}(\bm{\mathbf{A}}) \displaystyle=\frac{1}{2}\sum_{n=1}^{N}\lVert\bm{\mathbf{A}}^{(n)}\rVert_{F}^{2}, \displaystyle f_{\tau}(\tau) \displaystyle=(1-\alpha_{0})\log\tau+\kappa_{0}\tau. A.1 Latent Variable Steps Sample \tau When sampling \tau , it is not dependent on \phi , thus we have, \displaystyle\tau\mid\cdots \displaystyle\propto\exp(-f(\bm{\mathscr{{Y}}};\bm{\mathscr{{X}}},\tau)-l(\tau)) \displaystyle\propto\exp\left(-\frac{\tau}{2}\sum_{\bm{\mathbf{\underline{{i}}}}\in\Omega}(y_{\bm{\mathbf{\underline{{i}}}}}-x_{\bm{\mathbf{\underline{{i}}}}})^{2}\right)\cdot\exp(-(1-\alpha_{0})\log\tau-\kappa_{0}\tau) \displaystyle\propto\exp\left(-\left(\kappa_{0}+\frac{1}{2}\sum_{\bm{\mathbf{\underline{{i}}}}\in\Omega}(y_{\bm{\mathbf{\underline{{i}}}}}-x_{\bm{\mathbf{\underline{{i}}}}})^{2}\right)\tau\right)\cdot\exp\left(-(1-\alpha_{0}+\frac{|\Omega|}{2})\log\tau\right). This is a Gamma distribution, \tau\mid\dots\sim\mathrm{Gamma}\left(\alpha_{0}+\frac{|\Omega|}{2},\kappa_{0}+\frac{1}{2}\sum_{\bm{\mathbf{\underline{{i}}}}\in\Omega}(y_{\bm{\mathbf{\underline{{i}}}}}-x_{\bm{\mathbf{\underline{{i}}}}})^{2}\right). Sample \bm{\mathbf{A}} The factors \bm{\mathbf{A}} are dependent on f,h,\phi . For CP decomposition, we have, \bm{\mathbf{X}}_{[n]}=\bm{\mathbf{A}}^{(n)}\bm{\mathbf{\Lambda}}\left(\bm{\mathbf{A}}^{(N)}\odot\cdots\odot\bm{\mathbf{A}}^{(n+1)}\odot\bm{\mathbf{A}}^{(n-1)}\odot\cdots\odot\bm{\mathbf{A}}^{(1)}\right)^{\mathsf{T}}, where \bm{\mathbf{\Lambda}}=\text{diag}(\bm{\mathbf{\lambda}}) and \odot is the Khatri-Rao product. For simplicity, we denote, \bm{\mathbf{B}}^{(n)}=\bm{\mathbf{\Lambda}}\left(\bm{\mathbf{A}}^{(N)}\odot\cdots\odot\bm{\mathbf{A}}^{(n+1)}\odot\bm{\mathbf{A}}^{(n-1)}\odot\cdots\odot\bm{\mathbf{A}}^{(1)}\right)^{\mathsf{T}}. The joint distribution becomes, \displaystyle p(\bm{\mathbf{A}}^{(n)}\mid\cdots) \displaystyle\propto\exp\left(-\frac{\tau}{2}\lVert\bm{\mathscr{{O}}}\ast(\bm{\mathscr{{Y}}}-\bm{\mathscr{{X}}})\rVert^{2}_{F}-\frac{1}{2}\lVert\bm{\mathbf{A}}^{(n)}\rVert_{F}^{2}-\frac{1}{2\rho^{2}}\lVert\bm{\mathscr{{Z}}}-\bm{\mathscr{{X}}}\rVert^{2}_{F}\right) \displaystyle\propto\exp\left(-\frac{\tau}{2}\lVert\bm{\mathbf{O}}_{[n]}\ast(\bm{\mathbf{Y}}_{[n]}-\bm{\mathbf{A}}^{(n)}\bm{\mathbf{B}}^{(n)})\rVert^{2}_{F}-\frac{1}{2}\lVert\bm{\mathbf{A}}^{(n)}\rVert_{F}^{2}-\frac{1}{2\rho^{2}}\lVert\bm{\mathbf{Z}}_{[n]}-\bm{\mathbf{A}}^{(n)}\bm{\mathbf{B}}^{(n)}\rVert^{2}_{F}\right). For i=1,\dots,I_{N} , we have \displaystyle p(\bm{\mathbf{a}}^{(n)}_{i:}|\cdots) \displaystyle\propto\exp\left(-\frac{\tau}{2}\lVert\bm{\mathbf{o}}_{[n],i:}\ast(\bm{\mathbf{y}}_{[n],i:}-\bm{\mathbf{a}}^{(n)}_{i:}\bm{\mathbf{B}}^{(n)})\rVert^{2}-\frac{1}{2}\lVert\bm{\mathbf{a}}^{(n)}_{i:}\rVert^{2}-\frac{1}{2\rho^{2}}\lVert\bm{\mathbf{z}}_{[n],i:}-\bm{\mathbf{a}}^{(n)}_{i:}\bm{\mathbf{B}}^{(n)}\rVert^{2}\right) \displaystyle\propto\exp\left(-\frac{1}{2}\bm{\mathbf{a}}^{(n)}_{i:}[\bm{\mathbf{I}}+\tau(\bm{\mathbf{B}}^{(n)}\text{diag}(\bm{\mathbf{o}}_{[n],i:})\bm{\mathbf{B}}^{(n)\mathsf{T}})+\frac{1}{\rho^{2}}(\bm{\mathbf{B}}^{(n)}\bm{\mathbf{B}}^{(n)\mathsf{T}})]\bm{\mathbf{a}}^{(n)\mathsf{T}}_{i:}+\right. \displaystyle\qquad\qquad\qquad\qquad\qquad\qquad\qquad\left.\bm{\mathbf{a}}^{(n)}_{i:}(\tau\bm{\mathbf{y}}_{[n],i:}\text{diag}(\bm{\mathbf{o}}_{[n],i:})\bm{\mathbf{B}}^{(n)\mathsf{T}}+\frac{1}{\rho^{2}}\bm{\mathbf{z}}_{[n],i:}\bm{\mathbf{B}}^{(n)\mathsf{T}})\right). This is a Gaussian distribution, \bm{\mathbf{a}}^{(n)}_{i}|\cdots\sim\mathcal{{N}}(\bm{\mathbf{\mu}}^{(n)}_{i},\bm{\mathbf{\Sigma}}^{(n)}), where, \displaystyle\bm{\mathbf{\Sigma}}^{(n)} \displaystyle=\left(\bm{\mathbf{I}}+\tau(\bm{\mathbf{B}}^{(n)}\text{diag}(\bm{\mathbf{o}}_{[n],i:})\bm{\mathbf{B}}^{(n)\mathsf{T}})+\frac{1}{\rho^{2}}(\bm{\mathbf{B}}^{(n)}\bm{\mathbf{B}}^{(n)\mathsf{T}})\right)^{-1}, \displaystyle\bm{\mathbf{\mu}}^{(n)}_{i} \displaystyle=\bm{\mathbf{\Sigma}}^{(n)}\left(\tau\bm{\mathbf{y}}_{[n],i:}\text{diag}(\bm{\mathbf{o}}_{[n],i:})\bm{\mathbf{B}}^{(n)\mathsf{T}}+\frac{1}{\rho^{2}}\bm{\mathbf{z}}_{[n],i:}\bm{\mathbf{B}}^{(n)\mathsf{T}}\right). We can easily sample from this Gaussian distribution. Sample \bm{\mathbf{\lambda}} We express the CP decomposition as, \displaystyle\bm{\mathscr{{X}}} \displaystyle=\sum_{r=1}^{R}\lambda_{r}\bm{\mathbf{a}}^{(1)}_{:r}\circ\bm{\mathbf{a}}^{(2)}_{:r}\cdots\circ\bm{\mathbf{a}}^{(N)}_{:r} \displaystyle=\lambda_{r}\bm{\mathbf{a}}^{(1)}_{:r}\circ\bm{\mathbf{a}}^{(2)}_{:r}\cdots\circ\bm{\mathbf{a}}^{(N)}_{:r}+\sum_{h=1,h\neq r}^{R}\lambda_{h}\bm{\mathbf{a}}^{(1)}_{:h}\circ\bm{\mathbf{a}}^{(2)}_{:h}\cdots\circ\bm{\mathbf{a}}^{(N)}_{:h}, \displaystyle=\lambda_{r}\bm{\mathscr{{C}}}^{r}+\bm{\mathscr{{D}}}^{r}, where we denote \bm{\mathscr{{C}}}^{r}=\bm{\mathbf{a}}^{(1)}_{:r}\circ\bm{\mathbf{a}}^{(2)}_{:r}\cdots\circ\bm{\mathbf{a}}^{(N)}_{:r} and \bm{\mathscr{{D}}}^{r}=\sum_{h=1,h\neq r}^{R}\lambda_{h}\bm{\mathscr{{C}}}^{h} . For each component r , we have, \displaystyle p(\lambda_{r}\mid\cdots) \displaystyle\propto\exp\left(-\frac{1}{2}\theta_{r}\lambda_{r}^{2}-\frac{\tau}{2}\lVert\bm{\mathscr{{O}}}\ast(\bm{\mathscr{{Y}}}-\lambda_{r}\bm{\mathscr{{C}}}^{r}-\sum_{r=1,h\neq r}\lambda_{h}\bm{\mathscr{{C}}}^{h})\rVert^{2}_{F}-\frac{1}{2\rho^{2}}\lVert\bm{\mathscr{{Z}}}-\lambda_{r}\bm{\mathscr{{C}}}^{r}-\sum_{r=1,h\neq r}\lambda_{h}\bm{\mathscr{{C}}}^{h}\rVert^{2}_{F}\right) \displaystyle\propto\exp\left(-\frac{1}{2}\left[\theta_{r}+\tau\sum_{\bm{\mathbf{\underline{{i}}}}\in\Omega}c_{\bm{\mathbf{\underline{{i}}}}}^{2}+\frac{1}{\rho^{2}}\sum_{\bm{\mathbf{\underline{{i}}}}}c_{\bm{\mathbf{\underline{{i}}}}}^{2}\right]\lambda_{r}^{2}+\left[\tau\sum_{\bm{\mathbf{\underline{{i}}}}\in\Omega}c_{\bm{\mathbf{\underline{{i}}}}}(y_{\bm{\mathbf{\underline{{i}}}}}-d_{\bm{\mathbf{\underline{{i}}}}})+\frac{1}{\rho^{2}}\sum_{\bm{\mathbf{\underline{{i}}}}}c_{\bm{\mathbf{\underline{{i}}}}}(z_{\bm{\mathbf{\underline{{i}}}}}-d_{\bm{\mathbf{\underline{{i}}}}})\right]\lambda_{r}\right). This is a Gaussian distribution, \lambda_{r}|\cdots\sim\mathcal{{N}}(\mu_{r},\sigma_{r}), where, \displaystyle\sigma_{r} \displaystyle=\left(\theta_{r}+\tau\lVert\bm{\mathscr{{O}}}\ast\bm{\mathscr{{C}}}^{r}\rVert^{2}_{F}+\frac{1}{\rho^{2}}\lVert\bm{\mathscr{{C}}}^{r}\rVert^{2}_{F}\right)^{-1}, \displaystyle\mu_{r} \displaystyle=\sigma_{r}\mathsf{Sum}\left(\tau\bm{\mathscr{{O}}}\ast\bm{\mathscr{{C}}}^{r}\ast(\bm{\mathscr{{Y}}}-\bm{\mathscr{{D}}}^{r})+\frac{1}{\rho^{2}}\bm{\mathscr{{C}}}^{r}\ast(\bm{\mathscr{{Z}}}-\bm{\mathscr{{D}}}^{r})\right), with \mathsf{Sum}(\cdot) the sum of all elements. Sample \theta For each component r , the full conditional distribution of \theta_{r} is, \displaystyle p(\theta_{r}\mid\cdots) \displaystyle\propto\exp(-\frac{1}{2}\theta_{r}\lambda_{r}^{2})\cdot\mathrm{InvGamma}(\theta_{r};\alpha_{\theta},\beta_{\theta})^{\mathbbm{1}(\zeta_{r}>r)}\cdot\delta_{\theta_{\infty}}^{\mathbbm{1}(\zeta_{r}\leq r)} \displaystyle\propto\theta_{r}^{-(\alpha_{\theta}+1)}\exp\left(-\left(\beta_{\theta}+\frac{\lambda_{r}^{2}}{2}\right)\theta_{r}^{-1}\right)^{\mathbbm{1}(\zeta_{r}>r)}\cdot\delta_{\theta_{\infty}}^{\mathbbm{1}(\zeta_{r}\leq r)}. Thus, we have, \theta_{r}\mid\cdots\sim\mathrm{InvGamma}\left(\alpha_{\theta}+\frac{1}{2},\beta_{\theta}+\frac{\lambda_{r}^{2}}{2}\right)^{\mathbbm{1}(\zeta_{r}>r)}\cdot\delta_{\theta_{\infty}}^{\mathbbm{1}(\zeta_{r}\leq r)}. Sample \zeta To sample \zeta_{r} , we can marginalize out \theta_{r} . If \zeta_{r}\leq r , we have, \displaystyle p(\zeta_{r}=l\mid\cdots) \displaystyle\propto\int p(\zeta_{r}=l)\cdot p(\theta_{r}\mid\zeta_{r})\cdot p(\lambda_{r}\mid\theta_{r})\mathop{}\!\mathrm{d}\theta_{r} \displaystyle\propto\int\omega_{l}\delta_{\theta_{\infty}}\mathrm{Normal}(\lambda_{r};0,\theta_{r})\mathop{}\!\mathrm{d}\theta_{r} \displaystyle=\omega_{l}\mathrm{Normal}(\lambda_{r};0,\theta_{\infty}). Else, if \zeta_{r}>r , we have, \displaystyle p(\zeta_{r}=l\mid\cdots) \displaystyle\propto\int p(\zeta_{r}=l)\cdot p(\theta_{r}\mid\zeta_{r})\cdot p(\lambda_{r}\mid\theta_{r})\mathop{}\!\mathrm{d}\theta_{r} \displaystyle\propto\int\omega_{l}\mathrm{InvGamma}(\theta_{r};\alpha_{\theta},\beta_{\theta})\cdot\mathrm{Normal}(\lambda_{r};0,\theta_{r})\mathop{}\!\mathrm{d}\theta_{r} \displaystyle=\omega_{l}\cdot\mathrm{Student\mbox{-}t}_{2\alpha_{\theta}}(\lambda_{r};0,\beta_{\theta}/\alpha_{\theta}). Sample \bm{\mathbf{\nu}} From r=1 to R-1 , we have, \displaystyle p(\nu_{r}\mid\cdots) \displaystyle\propto p(\nu_{r})\cdot p(\zeta\mid\nu_{r}) \displaystyle\propto\mathrm{Beta}(\nu_{r};1,\beta)\cdot\prod_{h=r}^{R}\omega_{\zeta_{h}} \displaystyle\propto\nu_{r}^{\sum_{h=r}^{R}\mathbbm{1}(\zeta_{h}=r)}(1-\nu_{r})^{\beta-1+\sum_{h=r+1}^{R}\mathbbm{1}(\zeta_{h}>r)}. This is a Beta distribution, \nu_{r}\mid\cdots\sim\mathrm{Beta}\left(1+\sum_{h=1}^{R}\mathbbm{1}(\zeta_{h}=r),\beta+\sum_{h=1}^{R}\mathbbm{1}(\zeta_{h}>r)\right). Rank adaptation We follow 28 ; 1 to adaptively adjust the number of components in \bm{\mathbf{\lambda}} (the CP rank). At time step i , we adapt the rank with probability p(i)=\exp(\alpha_{0}+\alpha_{1}i) , where \alpha_{0} and \alpha_{1} are hyperparameters. If there are inactive factors, we remove them. If all factors are active, we add a new factor (and associated parameters) from the priors. Details are shown in Algorithm 2 . Input: CP factors \bm{\mathbf{\lambda}},\bm{\mathbf{A}}_{1},\dots,\bm{\mathbf{A}}_{D} , hyperparameters \alpha_{0},\alpha_{1} , current iteration i . if \mathsf{rand}()\leq\exp(\alpha_{0}+\alpha_{1}i) then // Adapt with probability \exp(\alpha_{0}+\alpha_{1}i) if \min(\lVert\lambda_{r}\rVert)<10^{-4} then Remove all components r with |\lambda_{r}|<10^{-4} ; else Add a new component with \lambda_{\mathrm{new}}\sim\mathcal{{N}}(0,1) and \bm{\mathbf{a}}^{(d)}_{\mathrm{new}}\sim\mathcal{{N}}(\bm{\mathbf{0}},\bm{\mathbf{I}}),\forall d=1,\dots,D ; end if end if Algorithm 2 Rank adaptation \mathsf{adapt\_factor}(\bm{\mathbf{\lambda}},\bm{\mathbf{A}}) Appendix B Proof of Theorems B.1 Proof of Theorem 3.1 Proof. In the BCP with CUSP prior, since \lambda_{r} and a^{(n)}_{i_{n}r} are independent, and the means are zero, we have, \displaystyle\mathbb{E}[\lambda_{r}\prod_{n=1}^{N}a^{(n)}_{i_{n}r}]^{2} \displaystyle=\mathbb{E}\lambda_{r}^{2}\prod_{n=1}^{N}\mathbb{E}[a^{(n)}_{i_{n}r}]^{2} \displaystyle\leq\mathbb{E}\lambda_{r}^{2}\prod_{n=1}^{N}\eta_{n}, (18) where \eta_{n} bounds \mathbb{E}[a^{(n)}_{i_{n}r}]^{2} . For the first term, we have \displaystyle\mathbb{E}\lambda_{r}^{2} \displaystyle=\mathbb{E}[\mathbb{E}\lambda_{r}^{2}\mid\theta_{r}] \displaystyle=\mathbb{E}[1-\pi_{r}]\frac{\beta_{\theta}}{\alpha_{\theta}-1}+\mathbb{E}[\pi_{r}]\theta_{\infty}. For the expectation of \pi_{r} , we have, \displaystyle\mathbb{E}[\pi_{r}] \displaystyle=\sum_{l=1}^{r}\mathbb{E}[\omega_{l}] \displaystyle=\sum_{l=1}^{r}\mathbb{E}[\nu_{l}]\prod_{m=1}^{l-1}(1-\mathbb{E}[\nu_{m}]) \displaystyle=\sum_{l=1}^{r}\frac{1}{1+\beta}\left(\frac{\beta}{1+\beta}\right)^{l-1} \displaystyle=1-\left(\frac{\beta}{1+\beta}\right)^{r}. Thus, we have, \mathbb{E}\lambda_{r}^{2}=\left(\frac{\beta}{1+\beta}\right)^{r}\left(\frac{\beta_{\theta}}{\alpha_{\theta}-1}-\theta_{\infty}\right)+\theta_{\infty}. (19) Injecting Eq. 19 into Eq. 18 , we get, \mathbb{E}[\lambda_{r}\prod_{n=1}^{N}a^{(n)}_{i_{n}r}]^{2}\leq\left[\left(\frac{\beta}{1+\beta}\right)^{r}\left(\frac{\beta_{\theta}}{\alpha_{\theta}-1}-\theta_{\infty}\right)+\theta_{\infty}\right]\prod_{n=1}^{N}\eta_{n}. Using the Markov inequality, we have, \displaystyle p((x_{r,\bm{\mathbf{\underline{{i}}}}})^{2}\geq\epsilon) \displaystyle\leq\frac{\mathbb{E}[(x_{r,\bm{\mathbf{\underline{{i}}}}})^{2}]}{\epsilon} \displaystyle\leq\frac{1}{\epsilon}\left[\left(\frac{\beta}{1+\beta}\right)^{r}\left(\frac{\beta_{\theta}}{\alpha_{\theta}-1}-\theta_{\infty}\right)+\theta_{\infty}\right]\prod_{n=1}^{N}\eta_{n}, which concludes the proof. ∎ B.2 Proof of Theorem 3.4 Proof. First, by Bayes’ rule, for any (\bm{\mathscr{{Z}}},\Theta) with \pi_{\rho}(\Theta\mid\bm{\mathscr{{Z}}})>0 , \pi_{\rho,\bm{\mathscr{{Z}}}}(\bm{\mathscr{{Z}}})=\pi_{\rho,\bm{\mathscr{{X}}}}(\Theta)\,\frac{\pi_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta)}{\pi_{\rho}(\Theta\mid\bm{\mathscr{{Z}}})}. Integrating both sides over \bm{\mathscr{{Z}}} yields 1=\pi_{\rho,\bm{\mathscr{{X}}}}(\Theta)\int\frac{\pi_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta)}{\pi_{\rho}(\Theta\mid\bm{\mathscr{{Z}}})}\,d\bm{\mathscr{{Z}}}, hence \pi_{\rho,\bm{\mathscr{{X}}}}(\Theta)=\left(\int\frac{\pi_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta)}{\pi_{\rho}(\Theta\mid\bm{\mathscr{{Z}}})}\,d\bm{\mathscr{{Z}}}\right)^{-1}. (20) Similarly, using the compatibility assumption, \tilde{\pi}_{\rho}(\Theta\mid\bm{\mathscr{{Z}}})=\pi_{\rho}(\Theta\mid\bm{\mathscr{{Z}}}) and \tilde{\pi}_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta)=q_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta) imply \tilde{\pi}_{\rho,\bm{\mathscr{{Z}}}}(\bm{\mathscr{{Z}}})=\tilde{\pi}_{\rho,\bm{\mathscr{{X}}}}(\Theta)\,\frac{q_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta)}{\pi_{\rho}(\Theta\mid\bm{\mathscr{{Z}}})}. Integrating over \bm{\mathscr{{Z}}} yields \tilde{\pi}_{\rho,\bm{\mathscr{{X}}}}(\Theta)=\left(\int\frac{q_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta)}{\pi_{\rho}(\Theta\mid\bm{\mathscr{{Z}}})}\,d\bm{\mathscr{{Z}}}\right)^{-1}. (21) Subtracting ( 20 ) and ( 21 ) in reciprocal form gives \frac{\tilde{\pi}_{\rho,\bm{\mathscr{{X}}}}(\Theta)-\pi_{\rho,\bm{\mathscr{{X}}}}(\Theta)}{\pi_{\rho,\bm{\mathscr{{X}}}}(\Theta)\tilde{\pi}_{\rho,\bm{\mathscr{{X}}}}(\Theta)}=\int\frac{\pi_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta)-q_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta)}{\pi_{\rho}(\Theta\mid\bm{\mathscr{{Z}}})}\,d\bm{\mathscr{{Z}}}. Using again \pi_{\rho,\bm{\mathscr{{Z}}}}(\bm{\mathscr{{Z}}})=\pi_{\rho,\bm{\mathscr{{X}}}}(\Theta)\frac{\pi_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta)}{\pi_{\rho}(\Theta\mid\bm{\mathscr{{Z}}})} , we obtain \frac{\tilde{\pi}_{\rho,\bm{\mathscr{{X}}}}(\Theta)-\pi_{\rho,\bm{\mathscr{{X}}}}(\Theta)}{\tilde{\pi}_{\rho,\bm{\mathscr{{X}}}}(\Theta)}=1-\int\frac{q_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta)}{\pi_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta)}\,\pi_{\rho,\bm{\mathscr{{Z}}}}(\bm{\mathscr{{Z}}})\,d\bm{\mathscr{{Z}}}, which rearranges, \frac{\pi_{\rho,\bm{\mathscr{{X}}}}(\Theta)}{\tilde{\pi}_{\rho,\bm{\mathscr{{X}}}}(\Theta)}=\int\frac{q_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta)}{\pi_{\rho}(\bm{\mathscr{{Z}}}\mid\Theta)}\,\pi_{\rho,\bm{\mathscr{{Z}}}}(\bm{\mathscr{{Z}}})\,d\bm{\mathscr{{Z}}}. Taking logarithm and expectation w.r.t. \Theta\sim\pi_{\rho,\bm{\mathscr{{X}}}} yields ( 16 ). Pinsker’s inequality concludes the TV bound. ∎ B.3 Proof of Section 3.2.3 Proof. By the triangle inequality, \big|\mathbb{E}_{\tilde{\pi}_{\rho,\bm{\mathscr{{X}}}}}[f]-\mathbb{E}_{\pi_{0,\bm{\mathscr{{X}}}}}[f]\big|\leq\big|\mathbb{E}_{\tilde{\pi}_{\rho,\bm{\mathscr{{X}}}}}[f]-\mathbb{E}_{\pi_{\rho,\bm{\mathscr{{X}}}}}[f]\big|+\big|\mathbb{E}_{\pi_{\rho,\bm{\mathscr{{X}}}}}[f]-\mathbb{E}_{\pi_{0,\bm{\mathscr{{X}}}}}[f]\big|. For the first term, by the characterization of the total variation distance |\mathbb{E}_{P}[f]-\mathbb{E}_{Q}[f]|\leq 2\|f\|_{\infty}D_{\mathrm{TV}}(P\,\|\,Q) for bounded measurable f , we have, \big|\mathbb{E}_{\tilde{\pi}_{\rho,\bm{\mathscr{{X}}}}}[f]-\mathbb{E}_{\pi_{\rho,\bm{\mathscr{{X}}}}}[f]\big|\leq 2\|f\|_{\infty}\,D_{\mathrm{TV}}\left(\tilde{\pi}_{\rho,\bm{\mathscr{{X}}}}\,\|\,\pi_{\rho,\bm{\mathscr{{X}}}}\right). Using the Pinsker’s inequality D_{\mathrm{TV}}(P\,\|\,Q)\leq\sqrt{\frac{1}{2}\mathrm{KL}(P\,\|\,Q)} , we have, \displaystyle\big|\mathbb{E}_{\tilde{\pi}_{\rho,\bm{\mathscr{{X}}}}}[f]-\mathbb{E}_{\pi_{0,\bm{\mathscr{{X}}}}}[f]\big| \displaystyle\leq\big|\mathbb{E}_{\pi_{\rho,\bm{\mathscr{{X}}}}}[f]-\mathbb{E}_{\pi_{0,\bm{\mathscr{{X}}}}}[f]\big|+2\|f\|_{\infty}\,D_{\mathrm{TV}}\left(\tilde{\pi}_{\rho,\bm{\mathscr{{X}}}}\,\|\,\pi_{\rho,\bm{\mathscr{{X}}}}\right) \displaystyle\leq\big|\mathbb{E}_{\pi_{\rho,\bm{\mathscr{{X}}}}}[f]-\mathbb{E}_{\pi_{0,\bm{\mathscr{{X}}}}}[f]\big|+\|f\|_{\infty}\,\sqrt{2D_{\mathrm{KL}}\left(\tilde{\pi}_{\rho,\bm{\mathscr{{X}}}}\,\|\,\pi_{\rho,\bm{\mathscr{{X}}}}\right)}. ∎ Appendix C Generalization to Tensor Train and Tensor Ring Decompositions The DiffBCP framework is largely agnostic to the specific low-rank decomposition. Replacing CP with other decompositions such as TT ( 27 ) or TR ( 53 ) only requires changing the contraction map \bm{\mathscr{{X}}}(\Theta) that connects latent factors to the reconstructed tensor; the likelihood p(\bm{\mathscr{{Y}}}\mid\bm{\mathscr{{X}}},\tau) , the augmented variable block on \bm{\mathscr{{Z}}} , and the overall split Gibbs framework remain unchanged. Concretely, for an N -th order tensor \bm{\mathscr{{X}}}\in\mathbb{R}^{I_{1}\times\cdots\times I_{N}} , a TT decomposition writes each entry as x_{\bm{\mathbf{\underline{{i}}}}}=\bm{\mathscr{{G}}}^{(1)}_{i_{1}}\bm{\mathscr{{G}}}^{(2)}_{i_{2}}\cdots\bm{\mathscr{{G}}}^{(N)}_{i_{N}}, where \bm{\mathscr{{G}}}^{(n)}\in\mathbb{R}^{R_{n-1}\times I_{n}\times R_{n}} are the TT cores with R_{0}=R_{N}=1 ; TR relaxes the boundary to R_{0}=R_{N} and replaces the matrix product with a trace. A key observation is that, conditional on all other cores, each core \bm{\mathscr{{G}}}^{(n)} enters the reconstruction linearly . Placing an isotropic Gaussian prior on the entries of each core therefore preserves Gaussian conjugacy for its full conditional given \bm{\mathscr{{Y}}} , \bm{\mathscr{{Z}}} , \tau , and the other cores, yielding the same matrix-normal update form as the CP factor update in Eq. 7 , with \bm{\mathbf{B}}^{(n)} replaced by the appropriate contraction of the remaining cores. The CUSP rank-shrinkage prior generalizes analogously: it can be placed on the slices of \bm{\mathscr{{G}}}^{(n)} along the rank dimensions R_{n-1},R_{n} to shrink redundant TT/TR ranks, and the Gibbs updates of the CUSP auxiliaries remain unchanged because they depend only on the prior structure, not on the specific form of \bm{\mathscr{{X}}}(\Theta) . The diffusion-prior block in Eq. 12 is independent of the choice of decomposition, since it only depends on \bm{\mathscr{{X}}} as a noisy observation of \bm{\mathscr{{Z}}} via the coupling \phi(\bm{\mathscr{{Z}}},\bm{\mathscr{{X}}};\rho) . Consequently, the theoretical results in Theorems 3.4 and 3.2.3 also hold verbatim, as they are stated in terms of the augmented posterior \pi_{\rho}(\bm{\mathscr{{Z}}},\Theta) without any CP-specific structure. A full empirical study of DiffBCP for TT/TR decompositions is left to future work. Appendix D Experiments D.1 Image Inpainting and Denoising Implementations For baseline models, we use their official implementations. BCP, BTR, tCTV, and GLON are implemented in MATLAB. We run them on a server with Intel Xeon Silver 4316 CPU@2.30GHz CPU and 512 GB RAM. HLRTF, DeepTensor, and our method are implemented in PyTorch. Hyperparameters Bayesian tensor decomposition including BCP and BTR uses fully Bayesian inference, so they do not require extensive hyperparameter tuning. We choose CP rank 100 and TR rank 30, which are sufficiently large for the 256\times 256\times 3 images. For other baselines, we tune their hyperparameters for the best performance on the validation set. For our method, we re-arrange images into patches of shape 16\times 16\times 3 with strite 8 , so the resulting image tensor has shape 16\times 16\times 3\times 961 . We set the CP rank as 200 and adaptively tune the rank during sampling. The hyperparameters for the CUSP prior are set as follows, \alpha_{0}=$1\text{\times}{10}^{-3}$,\,\kappa_{0}=$1\text{\times}{10}^{-3}$,\,\beta=5.0,\,\alpha_{\theta}=2.0,\,\beta_{\theta}=2.0,\,\theta_{\infty}=$1\text{\times}{10}^{-3}$. Most of these hyperparameters are noninformative and we do not tune them. The constant for the coupling parameter is set as c=100.0 , and we further clip \rho into [0.3,10.0] following 48 . We study the sensitivity to both c and \rho_{\min} in Section D.5 . For the Gibbs sampler, we run 100 iterations in total with 40 burn-in iterations. We collect one sample every four iterations after burn-in. Evaluation We report averaged value of peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), and learned perceptual image patch similarity (LPIPS). PSNR and SSIM metrics are computed using the implementation from the MONAI library ( 3 ) with default parameters. LPIPS is computed using the implementation in the VQGAN project 1 1 1 https://github.com/CompVis/taming-transformers . D.2 Comparison with Diffusion Posterior Samplers We further compare DiffBCP against representative diffusion posterior samplers, including DPS ( 8 ) and PnP-DM ( 48 ) , on the FFHQ inpainting benchmark. We use the same pre-trained diffusion checkpoint and the same masks as in Section D.1 , so that all three methods share an identical observation model and prior network. For PnP-DM and DiffBCP, both of which produce posterior samples via a split Gibbs framework, we report two evaluation modes. The single-sample reconstruction uses a single posterior sample as the reconstruction, which directly reflects the quality of a single draw from the posterior. The posterior-mean reconstruction averages the collected samples after burn-in (see Section D.1 for the sampling schedule), and is closer in spirit to a minimum-mean-squared-error estimator. DPS does not produce a posterior distribution, and is therefore evaluated in the single-sample regime only. Table 3 : Comparison with diffusion posterior samplers (DPS and PnP-DM) on FFHQ inpainting. PSNR \uparrow , SSIM \uparrow , and LPIPS \downarrow are reported, with SSIM and LPIPS multiplied by 100 for readability. “Single-sample reconstruction” denotes the reconstruction from a single posterior sample; “Posterior-mean reconstruction” denotes the posterior-mean estimate averaged over the collected samples. DPS does not produce multiple posterior samples and is therefore evaluated in the single-sample regime only. Within each block, bold marks the best value per column. Uniform(0.7) Uniform(0.9) Stripe Irregular Method PSNR SSIM LPIPS PSNR SSIM LPIPS PSNR SSIM LPIPS PSNR SSIM LPIPS Single-sample reconstruction DPS ( 8 ) 30.75 87.31 15.61 26.98 78.81 21.22 27.37 85.27 14.84 29.87 88.70 12.67 PnP-DM ( 48 ) 29.45 70.87 24.65 27.21 65.30 31.91 25.82 68.20 25.42 28.04 71.04 22.79 DiffBCP 31.49 85.94 21.31 27.80 77.24 33.67 27.51 81.36 23.93 29.84 85.53 19.71 Posterior-mean reconstruction PnP-DM ( 48 ) 33.20 88.92 17.30 28.41 81.22 25.88 27.30 86.10 17.74 30.56 89.38 14.60 DiffBCP 32.13 88.83 17.70 28.28 81.18 28.93 27.91 85.11 19.89 30.34 88.60 15.98 Table 3 summarizes the results. Under single-sample evaluation, DiffBCP attains the best PSNR on three of the four masks (Uniform 0.7/0.9 and Stripe) and is essentially tied with DPS on Irregular, while consistently improving over PnP-DM on PSNR and SSIM across all four masks. Compared with DPS, however, DiffBCP trails on SSIM and LPIPS in all four masks. We interpret this as a pixel-vs-perceptual trade-off: the explicit low-rank CP structure regularizes each individual posterior sample and brings it closer to the underlying signal in \ell_{2} sense, but it also discourages the kind of high-frequency texture that perceptual metrics (SSIM and especially LPIPS) reward. DPS, which collapses to a single MAP-like reconstruction guided by the diffusion prior, is comparatively well aligned with this perceptual axis. Under posterior-mean evaluation, DiffBCP is competitive with PnP-DM across all metrics, with the two methods alternating as the best across the twelve metric/mask cells. D.3 Ablation Studies We ablate the two main components of DiffBCP — the diffusion-prior block on \bm{\mathscr{{Z}}} and the CUSP shrinkage prior on the CP factor weights — on the FFHQ inpainting benchmark from Section D.1 . Table 4 reports posterior-mean reconstruction quality for the Full model, a variant without the diffusion-prior block, and a series of variants where CUSP is replaced by a fixed CP rank. For such case, we replace the CUSP prior with simple Gaussian priors on the CP factors. Table 4 : Ablation study on FFHQ inpainting. “Full” is our default DiffBCP with both the CUSP shrinkage prior and the diffusion-prior block, using an initial CP rank of R=200 . “w/o DM” removes the diffusion-prior block while keeping CUSP. “rank= R , w/ CUSP” keeps CUSP active but starts from an initial CP rank of R . “rank= R ” disables CUSP and fixes the CP rank at R . The Full row (highlighted in green) achieves the best value in every column; the other rows are ordered to isolate the contribution of each component. Uniform(0.7) Uniform(0.9) Stripe Irregular Method PSNR SSIM LPIPS PSNR SSIM LPIPS PSNR SSIM LPIPS PSNR SSIM LPIPS DiffBCP (Full) 32.13 88.83 17.70 28.28 81.18 28.93 27.91 85.11 19.89 30.34 88.60 15.98 Ablating the diffusion-prior block DiffBCP (w/o DM) 32.05 88.00 18.88 28.10 79.24 32.52 25.82 79.35 28.97 28.64 85.28 21.39 CUSP under rank misspecification (adaptive vs. fixed rank) DiffBCP (rank=10, w/ CUSP) 29.60 84.69 23.86 27.64 79.40 31.41 26.51 79.38 28.51 28.12 82.62 25.58 DiffBCP (rank=10) 26.35 75.17 37.39 25.83 73.42 40.75 23.60 68.80 44.17 25.23 72.68 40.64 DiffBCP (rank=100) 31.79 87.96 18.99 28.09 79.20 32.28 25.56 78.42 29.76 28.33 84.44 22.36 DiffBCP (rank=200) 32.09 87.85 19.06 28.06 78.80 33.07 25.84 79.55 28.92 28.75 85.52 21.30 DiffBCP (rank=300) 32.11 87.58 19.33 28.01 78.62 33.46 25.95 79.89 28.83 28.92 85.80 21.10 Contribution of the diffusion-prior block. Comparing Full and “w/o DM” shows that the diffusion prior contributes only a small PSNR gain on uniformly random masks (e.g., +0.08 dB on Uniform 0.7, +0.18 dB on Uniform 0.9), but a substantially larger gain on structured corruption: +2.09 dB on Stripe and +1.70 dB on Irregular, with the LPIPS gap widening even more (e.g., 19.89 vs. 28.97 on Stripe). This pattern is consistent with the intuition that uniformly missing pixels are mostly recoverable from low-rank structure alone, whereas stripe and irregular masks remove contiguous spatial structure that the data-driven diffusion prior is uniquely positioned to fill in. CUSP under rank misspecification. The remaining rows isolate the role of CUSP by removing the shrinkage prior and fixing the CP rank. The pure “rank=10” variant collapses across all masks, reflecting severe under-parameterization. Activating CUSP on top of the same initial rank of 10 (“rank=10, w/ CUSP”) substantially mitigates this failure. A residual gap to Full remains, which we attribute to the limited Gibbs budget used in the ablation: CUSP introduces and activates new components incrementally, and at 100 Gibbs iterations a chain that starts at R=10 has not yet reached its equilibrium rank — the corresponding trajectory in Fig. 4 is still expanding past iteration 100 and only plateaus around iteration 400 . By contrast, the Full model starts at R=200 (close to or above the equilibrium for these masks), so its CP factor pool only needs to be shrunk, which converges within the same 100 -iteration budget. The practical takeaway is that CUSP makes the model robust to misspecified initial rank but does not eliminate it as a hyperparameter when the sampling budget is tight; a moderately large initial rank remains preferable, and an under-specified initial rank can be compensated by lengthening the chain. Finally, simply increasing the fixed rank to 100 , 200 , or 300 without CUSP closes the gap on uniform masks but does not reach Full on the structured masks, confirming that the contribution of CUSP is not reducible to simply allocating a larger CP rank. D.4 Effective Rank Evolution under CUSP Figure 4 : Effective CP rank as a function of Gibbs iteration on FFHQ inpainting with the Uniform(0.9) mask, for four initial ranks R\in\{10,100,200,300\} . Thick lines are the median across 10 images; thin lines are individual images. Regardless of whether the chain starts from an under-specified ( R=10 ) or over-specified ( R=300 ) initial rank, CUSP drives the effective rank toward a common band of active components. To complement the static ablation in Section D.3 , we track how the effective CP rank evolves over the course of the Gibbs sampler when CUSP is enabled. For each setting we run 10 FFHQ images and record the active component count |\{r:|\lambda_{r}|\geq 10^{-4}\}| at every iteration (cf. Algorithm 2 ). We extend the chain to 500 Gibbs iterations in this analysis because rank adaptation under CUSP converges noticeably more slowly than the reconstruction metrics. Fig. 4 shows the characteristic behavior on the Uniform(0.9) mask. The chain initialized at R=10 monotonically expands its effective rank — CUSP activates additional components in response to residual fitting error — while the chains initialized at R\in\{100,200,300\} all shrink their effective rank. By 500 iterations the four trajectories collapse onto a narrow common band, with the spread reflecting genuine per-image variability in the underlying low-rank structure together with the slow tail of rank adaptation when starting far above equilibrium. This is a direct empirical confirmation that CUSP is bidirectionally adaptive : it prunes redundant components when over-specified and expands the active set when under-specified, removing the need to choose the initial CP rank carefully. D.5 Hyperparameter Sensitivity Table 5 reports posterior-mean reconstruction quality under perturbations of the coupling constant c and the lower clip \rho_{\min} for DiffBCP, alongside the corresponding sensitivity of PnP-DM ( 48 ) to its own scheduling and noise hyperparameters. Table 5 : Sensitivity to scheduling hyperparameters on FFHQ inpainting (posterior-mean reconstruction). For DiffBCP, the defaults are the coupling constant c=100 and the lower clip \rho_{\min}=0.3 ; for PnP-DM, the defaults are \rho_{\min}=0.1 and the observation noise \sigma set to the ground-truth value \sigma=0.05 . Default configurations are highlighted in green; all other entries change a single hyperparameter and keep the rest at the default value. Uniform(0.7) Uniform(0.9) Stripe Irregular Method PSNR SSIM LPIPS PSNR SSIM LPIPS PSNR SSIM LPIPS PSNR SSIM LPIPS DiffBCP — varying coupling constant c and lower clip \rho_{\min} DiffBCP ( c=100 , \rho_{\min}=0.3 , default) 32.13 88.83 17.70 28.28 81.18 28.93 27.91 85.11 19.89 30.34 88.60 15.98 DiffBCP ( c=50 ) 31.93 88.82 17.63 27.69 80.03 29.58 27.91 85.15 19.79 30.35 88.69 15.88 DiffBCP ( c=30 ) 31.89 88.79 17.69 26.83 77.51 32.60 27.90 85.17 19.83 30.35 88.60 15.87 DiffBCP ( \rho_{\min}=0.1 ) 33.04 86.80 16.22 28.31 80.90 29.64 27.71 83.92 21.61 30.01 87.66 17.39 PnP-DM — varying lower clip \rho_{\min} and observation noise \sigma PnP-DM ( \rho_{\min}=0.1 , \sigma=0.05 , default) 33.20 88.92 17.30 28.41 81.22 25.88 27.30 86.10 17.74 30.56 89.38 14.60 PnP-DM ( \rho_{\min}=0.3 ) 29.48 81.72 25.80 25.44 73.50 33.37 26.20 81.34 24.15 28.89 79.05 21.30 PnP-DM ( \sigma=0.025 ) 33.56 89.56 16.31 28.78 82.30 24.68 27.30 86.39 17.12 30.61 89.70 13.90 PnP-DM ( \sigma=0.1 ) 32.05 86.78 20.37 27.07 77.60 29.73 30.31 88.21 16.75 27.20 84.99 19.74 DiffBCP is stable across c and \rho_{\min} . Sweeping the coupling constant c\in\{30,50,100\} moves Uniform 0.7 PSNR by at most 0.24 dB and Stripe/Irregular PSNR by at most 0.05 dB. On the most ill-posed mask (Uniform 0.9), c=30 degrades by 1.45 dB relative to c=100 , but no setting catastrophically fails. Reducing \rho_{\min} from the default 0.3 to 0.1 actually improves Uniform 0.7 PSNR by 0.91 dB while losing 0.20 dB on Stripe and 0.33 dB on Irregular — a small re-balancing rather than a regime change. PnP-DM is more sensitive to scheduling. By contrast, increasing PnP-DM’s \rho_{\min} from the default 0.1 to 0.3 causes a sharp collapse: PSNR drops by 3.72 dB on Uniform 0.7 and by 2.97 dB on Uniform 0.9. The noise-adaptive coupling schedule in DiffBCP, in which \rho is automatically set by the inferred precision \tau ( Section 3.2.2 ), removes the need for delicate manual scheduling of the diffusion noise level. PnP-DM benefits from carefully tuned observation noise. We additionally vary the observation-noise parameter \sigma that PnP-DM passes to its diffusion denoiser. With the ground-truth value \sigma=0.05 already used in the default row, doubling to \sigma=0.1 degrades all four masks (e.g., -1.15 dB on Uniform 0.7), while halving to \sigma=0.025 improves PnP-DM further and matches or surpasses DiffBCP (Full) on most cells (e.g., Uniform 0.7 PSNR 33.56 vs. 32.13 ). We report this row openly: it confirms that a well-tuned PnP-DM, with \sigma chosen below the true noise to drive more aggressive denoising, can outperform DiffBCP on uniform masks. The point of this comparison is not to claim universal superiority, but to highlight a different operating mode: DiffBCP automatically infers \tau from the data and couples \rho accordingly, so no analogous hand-tuning of \sigma is required. We view the tuning-free regime as the relevant axis for practical deployment, especially in settings where the true noise level is unknown. D.6 Out-of-Distribution and High-Resolution Images Datasets We test our algorithm on out-of-distribution high-resolution images. We choose three images with 2048\times 2048 resolution, including Marseille 2 2 2 https://www.pexels.com/photo/aerial-drone-view-of-urban-buildings-from-top-18644280/ , Tokyo 3 3 3 https://www.flickr.com/photos/trevor_dobson_inefekt69/29314390837 , and Westerlund 4 4 4 https://science.nasa.gov/asset/hubble/westerlund-2/ . We generate the masks in the same way with Section D.1 , and use the same iid Gaussian noise with \sigma=0.05 for denoising. Implementations In this experiment, we compare with PuTT ( 24 ) , as it shows SOTA performances for such high-dimensional data. We use the official implementation of PuTT in PyTorch. Additionally, we compare with BCP ( 52 ) as a direct comparison to CP decomposition. For our method, recall that the image size ( 2048\times 2048 ) is inconsistent with the training size of the diffusion model ( 256\times 256 ). In specific, the reconstructed tensor \bm{\mathscr{{X}}} has shape 2048\times 2048\times 3 , while the augmented tensor \bm{\mathscr{{Z}}} has shape 256\times 256\times 3 . Here we use bicubic interpolation for resizing. When compute the coupling distant Eq. 5 , we downsample \bm{\mathscr{{X}}} to 256\times 256\times 3 . When sampling CP factors Eqs. 6 and 7 , we upsample \bm{\mathscr{{Z}}} back to 2048\times 2048\times 3 . Hyperparameters PuTT learns the Quantized Tensor Train (QTT) representations in a coarse-to-fine manner. We set the downsampling resolution as [64,128,256,512,1024,2048] , which means that the image is downsampled to 64\times 64 at the coarsest level and upsampled in sequence. The total number of iterations is set as 2560 , and we upsample the image at 64,128,256,512,1024 iterations. The learning rate is 8\text{\times}{10}^{-3} using Adam optimizer and batch size 262144 . The maximum QTT rank is set as 100 . For BCP and our method, we reshape the images into 64\times 32\times 64\times 32\times 3 tensors. For BCP, we set the initial CP rank as 100 , because it quickly exceeds the maximum memory limit (512 GB) when the rank is larger. Besides, even with rank 100, we find BCP quickly shrinks the effective rank. For our method, we set the initial CP rank as 500 . Other hyperparameters are the same as in Section D.1 . Note that due to the different rank definition of QTT and CP, our CP format still yields larger compression rate than QTT. Evaluation The evaluation is the same as in Section D.1 . We run each experiment with five different random seeds and report the averaged results. D.7 Computational Cost Table 6 reports wall-clock time and peak GPU memory per image on a single A100 GPU, for the FFHQ 256\times 256 setup of Section D.1 and the Marseille 2048\times 2048 setup of Section D.6 . Table 6 : Wall-clock time and peak GPU memory per image, measured on a single A100 GPU. FFHQ uses 256\times 256 images ( Section D.1 ); Marseille uses 2048\times 2048 images ( Section D.6 ). FFHQ ( 256{\times}256 ) Marseille ( 2048{\times}2048 ) Method Time Peak Mem. Time Peak Mem. HLRTF 11.7 s 593 MB 137 s 12.8 GB DeepTensor 27.3 s 736 MB 456 s 35.3 GB PnP-DM 37.4 s 744 MB 109 s 5.3 GB DiffBCP 239 s 821 MB 250 s 12.5 GB DiffBCP is slower than PnP-DM, reflecting the cost of running full-batch CP factor updates. In the high-resolutional Marseille case, DiffBCP runs in 250 s with 12.5 GB peak memory, which is 1.8\times faster and 2.8\times more memory-efficient than the strongest deep tensor baseline DeepTensor ( 456 s, 35.3 GB). The main bottleneck of DiffBCP is the full-batch Gibbs update on \bm{\mathbf{A}} and \bm{\mathbf{\lambda}} . As noted in the conclusion, replacing this with stochastic mini-batch sampling is a natural direction to further reduce runtime and memory, particularly when scaling to even larger tensors. D.8 More Visualizations Original Observe BCP BTR HLRTF DeepTensor tCTV GLON DiffBCP Figure 5 : More visualization for FFHQ and ImageNet datasets.