Normalization Equivariance for Arbitrary Backbones, with Application to Image Denoising

Youssef Saied, François Fleuret · 2026

Read Normalization Equivariance for Arbitrary Backbones, with Application to Image Denoising by Youssef Saied, François Fleuret (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08193.txt.

Introduction

Youssef Saied and François Fleuret generalize a robustness property for image-to-image models. A normalization equivariant function scales its output when the input is scaled. It shifts its output when the input is shifted. That helps when test images differ in brightness or contrast from training data.

Older methods forced every internal layer to obey the property. That added cost and ruled out standard parts such as softmax attention. Their Wrapped Normalization Equivariance takes a simpler route. It normalizes the input, runs any backbone untouched, and denormalizes the output. They prove the wrapper captures the whole class of such functions. On blind denoising, it improved robustness with no added GPU cost.

Catalog record

CREATORYoussef Saied, François Fleuret
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE100 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.08193

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Normalization Equivariance for Arbitrary Backbones, with Application to Image Denoising Youssef Saied, François Fleuret Abstract Normalization Equivariance (NE) is a structural prior that improves robustness to distribution shift in image-to-image tasks. A function f f is normalization equivariant iff f ⁡ ( a ​ y + b ​ 𝟏 ) = a ​ f ​ ( y ) + b ​ 𝟏 f(ay+b\mathbf{1})=af(y)+b\mathbf{1} for all a > 0 a>0 and b ∈ ℝ b\in\mathbb{R} . Existing NE methods constrain every internal layer to NE-compatible operations. These constraints add runtime cost and exclude standard transformer components such as softmax attention and LayerNorm. We introduce Wrapped Normalization Equivariance (WNE), a parameter-free wrapper that normalizes the input, applies any backbone, and denormalizes the output. We prove every NE function admits this factorization, so the wrapper exactly parameterizes the class of NE functions. On blind denoising, wrapping CNN and transformer architectures improves robustness under noise-level mismatch with no measurable GPU overhead, while architectural NE baselines are up to 1.6 × 1.6\times slower. 1 Introduction Equivariance priors improve robustness to distribution shift in denoising and related image-to-image tasks. Scale equivariance (SE) and the strictly stronger normalization equivariance (NE) are properties shared by many classical denoisers ( Rudin et al. 1992 ; Buades et al. 2005 ; Dabov et al. 2007 ; Gu et al. 2014 ) : SE: \displaystyle f(ay)= \displaystyle af(y) \displaystyle\text{for }a>0. (1) NE: \displaystyle f(ay+b\mathbf{1})= \displaystyle af(y)+b\mathbf{1} \displaystyle\text{for }a>0,\,b\in\mathbb{R}. (2) These equivariances were recently adopted to improve neural network robustness in blind denoising, where the noise level is unknown at test time and may differ from training ( Mohan et al. 2020 ; Herbreteau et al. 2023 ) . This robustness has since motivated applications beyond denoising, including inverse problems and diffusion-style pipelines ( Kadkhodaie & Simoncelli 2021 ; Hong et al. 2024 ; Guth et al. 2025 ; Levac et al. 2025 ) . Existing methods enforce SE in neural networks by removing biases and leaving only positively 1-homogeneous operations ( Mohan et al. 2020 ) . Enforcing NE additionally requires preserving the affine action y\mapsto ay+b\mathbf{1} through every layer, e.g., via affine-constrained convolutions, special nonlinearities, and affine residuals ( Herbreteau et al. 2023 ) . Both approaches rule out standard transformer components—softmax and LayerNorm do not commute with y\mapsto ay+b\mathbf{1} . The NE-specific layers also add runtime cost (Table 2 ). We show that internal-layer constraints are unnecessary. Every NE function admits a normalize-process-denormalize factorization (Characterization 1 ). Using the characterization, we construct a parameter-free wrapper (WNE) that enforces input-output NE around any backbone without modifying it, including transformers (Figure 1 ). In blind denoising under noise-level mismatch, WNE matches architectural NE trends on DnCNN. WNE also brings the same robustness pattern to SwinIR and Restormer. In our GPU benchmarks, WNE adds no measured overhead. y T_{\mathrm{NE}} g_{\theta} T_{\mathrm{NE}}^{-1} \hat{x} \tilde{y} \mu(y),\;\mathrm{std}(y) Figure 1: Normalization-equivariant wrapper ( WNE ). Given a noisy input y , we compute instance statistics \mu(y) and \mathrm{std}(y) , normalize to \tilde{y}=T_{\mathrm{NE}}(y) , apply an arbitrary backbone g_{\theta} , and denormalize with the stored statistics to produce \hat{x}=\mathrm{std}(y)\,g_{\theta}(\tilde{y})+\mu(y)\mathbf{1} . This enforces input-output normalization equivariance without modifying the backbone. Our contributions: • Method: parameter-free drop-in wrapper enforcing NE on any backbone, including transformers (Section 3.1 ). • Theory: characterization showing that normalize-process-denormalize completely parameterizes the NE function class (Section 3.2 ). • Experiments and analysis: mismatch-robustness gains across CNN and transformer denoisers with negligible runtime cost; a normalized-coordinate analysis explains the trend (Sections 4 – 5 ). Code: The implementation is available in the repository YoussefSaied/normalization_equivariance . 2 Related Work width 1.55in attr /Interpolate false eval/b_swinir_10_vs_wne_swinir_10_comparison_pngs/noisy_train_sigma10.png Noisy training image \sigma=10 width 1.55in attr /Interpolate false eval/b_swinir_10_vs_wne_swinir_10_comparison_pngs/noisy_test_sigma90.png Noisy test image \sigma=90 width 1.55in attr /Interpolate false eval/b_swinir_10_vs_wne_swinir_10_comparison_pngs/denoised_swinir.png Test image denoised by SwinIR width 1.55in attr /Interpolate false eval/b_swinir_10_vs_wne_swinir_10_comparison_pngs/denoised_swinir_wne.png Test image denoised by SwinIR-WNE (ours) Figure 2: SwinIR qualitative denoising under noise-level mismatch. Models are trained at \sigma_{\mathrm{train}}=10 and evaluated at \sigma_{\mathrm{test}}=90 , far beyond the training noise. The unwrapped Baseline SwinIR degrades severely, while SwinIR-WNE remains stable. Equivariance priors: scale and normalization equivariance. Two related equivariance priors appear in denoising and related tasks. Scale equivariance (SE), or positive 1 -homogeneity, requires f(ay)=af(y) for a>0 . Mohan et al. 2020 propose SE bias-free CNN denoisers, inspiring similar bias-free designs in later work ( Zhang et al. 2022 ; Zamir et al. 2022 ) . Scale equivariant denoisers also serve as implicit priors in inverse problems ( Kadkhodaie & Simoncelli 2021 ) and appear in energy-based probability density and diffusion models ( Guth et al. 2025 ) . Normalization equivariance (NE) is strictly stronger than SE, requiring f(ay+b\mathbf{1})=af(y)+b\mathbf{1} for a>0,b\in\mathbb{R} . Herbreteau & Kervrann 2024 survey NE properties across supervised and self-supervised methods, noting that some classical denoisers (e.g., TV, non-local means) are NE ( Rudin et al. 1992 ; Buades et al. 2005 ) while others such as BM3D ( Dabov et al. 2007 ) and WNNM ( Gu et al. 2014 ) satisfy SE but not NE. Herbreteau et al. 2023 introduce NE as a robustness prior for denoising, and NE predictors have also been leveraged in plug-and-play MRI reconstruction ( Hong et al. 2024 ) and diffusion-based posterior samplers learned from noisy measurements ( Levac et al. 2025 ) . Enforcing normalization equivariance. For clarity, we describe three levels at which NE can be enforced. Architecture-level: Herbreteau et al. 2023 constrain every internal operation to NE-compatible families (affine-constrained convolutions, sorting nonlinearities, affine residuals); this is incompatible with attention and LayerNorm. Objective-level: Levac et al. 2025 embed an approximate NE property into a SURE-based loss to learn diffusion models from noisy measurements alone (no clean targets), enabling denoiser generalization below the measurement noise level. Their setting is self-supervised and complementary to ours. Input-output-level: (this work) we enforce NE analytically around an arbitrary backbone. Our if and only if characterization (Characterization 1 ) shows that normalize-process-denormalize reparameterizes the full NE function class rather than restricting it. Canonicalization and normalize-process-denormalize. A general recipe for equivariant maps is to canonicalize the input to a group-orbit representative, apply an arbitrary function, and map back ( Kaba et al. 2023 ; Mondal et al. 2023 ) . In our setting, the orbit representative is obtained by removing the global brightness and contrast degrees of freedom. Characterization 1 shows that this construction parameterizes the full NE function class for the affine action y\mapsto ay+b\mathbf{1} . Reversible Instance Normalization (RevIN) uses a related normalize-process-denormalize template, motivated empirically by distribution shift in time-series forecasting ( Kim et al. 2022 ; Liu et al. 2022 ) . We show that the same template, with global \mu and \mathrm{std} statistics, is exactly the form taken by every normalization-equivariant map (Characterization 1 ). Single-noise blind denoising. We use blind denoising as a controlled stress test for robustness to unknown corruption strength. Following Mohan et al. 2020 ; Herbreteau et al. 2023 , we train at a single \sigma_{\mathrm{train}} and test at \sigma_{\mathrm{test}}\neq\sigma_{\mathrm{train}} , probing out-of-distribution generalization rather than interpolation within a trained \sigma -range. The same robustness matters in plug-and-play reconstruction, where \sigma controls the denoising strength ( Zhang et al. 2022 ) and is usually a tuned hyperparameter. In dynamic preconditioned PnP this is sharpened: the iteration-dependent preconditioner

Read the complete text