Cross-Frequency Implicit Neural Representation with Self-Evolving Parameters

Chang Yu, Yisi Luo, Kai Ye, Xile Zhao, Deyu Meng · 2025

Read Cross-Frequency Implicit Neural Representation with Self-Evolving Parameters by Chang Yu, Yisi Luo, Kai Ye, Xile Zhao, Deyu Meng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-10929.txt.

Introduction

Chang Yu and co-authors offer a new way to store visual data with neural networks, published in 2025. Older methods keep data in its raw space, where high and low detail parts are mixed. They also need a user to set key values by hand, such as a rate or a rank, before training starts.

Their method, CF-INR, first splits data into four parts with a Haar wavelet step, then learns each part on its own. A new scheme updates the rank and rate values on its own for each part. Tests cover image fitting, filling gaps, noise removal, and cloud removal. The authors report that their method beats leading prior methods on each of these tasks.

Catalog record

CREATORChang Yu, Yisi Luo, Kai Ye, Xile Zhao, Deyu Meng
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE96 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-10929

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Cross-Frequency Implicit Neural Representation with Self-Evolving Parameters Chang Yu, Yisi Luo, Kai Ye, Xile Zhao, Deyu Meng Abstract Implicit neural representation (INR) has emerged as a powerful paradigm for visual data representation. However, classical INR methods represent data in the original space mixed with different frequency components, and several feature encoding parameters (e.g., the frequency parameter ω \omega or the rank R R ) need manual configurations. In this work, we propose a self-evolving cross-frequency INR using the Haar wavelet transform (termed CF-INR), which decouples data into four frequency components and employs INRs in the wavelet space. CF-INR allows the characterization of different frequency components separately, thus enabling higher accuracy for data representation. To more precisely characterize cross-frequency components, we propose a cross-frequency tensor decomposition paradigm for CF-INR with self-evolving parameters, which automatically updates the rank parameter R R and the frequency parameter ω \omega for each frequency component through self-evolving optimization. This self-evolution paradigm eliminates the laborious manual tuning of these parameters, and learns a customized cross-frequency feature encoding configuration for each dataset. We evaluate CF-INR on a variety of visual data representation and recovery tasks, including image regression, inpainting, denoising, and cloud removal. Extensive experiments demonstrate that CF-INR outperforms state-of-the-art methods in each case. I Introduction Implicit neural representation (INR) [ 1 , 2 ] has recently emerged as a powerful paradigm for continuously representing signals, offering advantages such as compactness, resolution independence, and differentiability. The use of INR has attracted significant attention across diverse fields, such as low-level vision [ 3 , 4 ] , graphics [ 5 ] , medical imaging [ 6 , 7 ] , remote sensing [ 8 ] , PDE solving [ 9 ] , etc. Unlike traditional grid-based discrete representations, INR learns a continuous function in the form of inputting a spatial coordinate and outputting the corresponding value using deep neural networks, which provide an implicit and continuous representation of data with greater flexibility and differentiability, therefore enabling diverse applications across fields. Fig. 1: The frequency decoupling of CF-INR enables more accurate continuous data representation. Top: fitting a multispectral image using different INRs (WIRE [ 10 ] , SIREN [ 11 ] , and the proposed frequency decoupled CF-INR), along with zoom-in figures and the corresponding error maps. Bottom: the wavelet coefficients learned by CF-INR with the corresponding Fourier spectrum. Classical INR methods typically represent data in the original space (e.g., image space), where different frequency components are usually mixed [ 11 , 4 , 12 ] . Specifically, one of the classical choices is to utilize a multilayer perceptron (MLP) to map an arbitrary spatial coordinate to the corresponding value [ 13 , 11 ] , which implicitly represents the data and encodes the local smoothness (i.e., input coordinates that are closer to each other result in more similar outputs [ 4 ] ). It was shown that traditional MLPs with ReLU activation fail to capture high-frequency components under the INR framework due to the spectral bias towards low-frequency components [ 13 ] . One common approach to enhance the representation ability of MLPs for learning high-frequency details is to introduce specialized mappings. For instance, the well-known SIREN method [ 11 ] constructs a differentiable MLP for continuous representation by stacking multiple linear layers with the sinusoidal activation function \sin(\omega\cdot) , where \omega is a global tunable frequency parameter that benefits high-frequency information capture in natural images and scenes, such as texture and edge details. The rationale of using the sinusoidal activation function for INR is that an MLP with sinusoidal functions (under certain conditions) is equivalent to a kernel regression with a diagonal shift-invariant kernel from the neural tangent kernel perspective [ 14 ] , while conventional activations such as ReLU lead to a non-diagonal kernel [ 13 ] . Hence, the sinusoidal activation function-based MLP [ 11 ] tends to more effectively represent high-frequency information and has become a widely considered baseline for INR methods and applications [ 15 , 16 ] . Recently, Luo et al. [ 4 ] proposed a low-rank tensor function representation based on SIREN, which parameterizes the INR using the tensor decomposition by pre-defining a suitable rank vector R for the given data. Despite their demonstrated effectiveness, existing INR methods with a global frequency parameter \omega face a fundamental limitation—they often neglect the intrinsic multi-frequency nature of real-world data. Real-world data inherently exhibit heterogeneous frequency characteristics, making the use of a single global frequency parameter suboptimal for accurate representation. Although adjusting \omega could shift the frequency preference of the INR model towards specific signal characteristics, it still neglects the frequency multiplicity inside a signal. The intrinsic limitation necessitates the development of a fundamentally different INR paradigm that can account for the frequency multiplicity of a signal by modeling different frequency components separately. On the other hand, the requirement for manual configuration of the frequency parameter \omega and the tensor rank R [ 4 ] introduces substantial hyperparameter optimization overhead. Current practices rely on heuristic parameter tuning, which demands domain expertise and may fail to guarantee cross-dataset generalization, where static parameter sets often prove inadequate for capturing diverse properties of different datasets. To address these fundamental challenges, we propose a self-evolving cross-frequency INR by using the Haar wavelet transform (termed CF-INR). The Haar wavelet transform effectively decomposes the input signal into four distinct frequency components (i.e., wavelet coefficients). By designing dedicated INRs tailored to represent different wavelet coefficients, we can effectively encode cross-frequency features, enabling independent characterizations of different frequency components in the wavelet space. Consequently, the frequency-decoupled CF-INR encodes the characteristics of various frequencies, thereby effectively capturing both coarse-grained and fine-grained data structures to obtain higher accuracy for signal representation (see Fig. 1 for examples). Customized with the frequency decoupling, we further propose a self-evolving cross-frequency tensor decomposition paradigm for CF-INR, which automatically updates the rank parameter R and the frequency parameter \omega for each wavelet coefficient that enables precise characterizations of cross-frequency features. In particular, the self-evolving CF-INR enjoys three essential advantages for continuous data representation. First, the cross-frequency tensor decomposition paradigm tailored for CF-INR enhances the computational efficiency and effectively captures the intricate intra- and inter-relationships among different wavelet coefficients, thus promoting the data recovery performance through intrinsic knowledge sharing among wavelet coefficients. Second, by tailoring different cross-frequency parameters ( \omega_{1} - \omega_{4} ) and cross-frequency ranks ( R_{1} - R_{4} ) for distinct wavelet coefficients, CF-INR holds intrinsic superiority for heterogeneous cross-frequency feature encoding that benefits a more meticulous data characterization. Third, the cross-frequency parameters ( \omega_{1} - \omega_{4} ) and cross-frequency ranks ( R_{1} - R_{4} ) are further automatically updated and evolved toward the desired cross-frequency features under self-evolution, with such update rules being derived from theoretical analysis. Specifically, we have established two innovative theoretical frameworks that facilitate our understanding of CF-INR—the cross-frequency tensor rank (CF-Rank) and the cross-frequency Laplacian smoothness. In terms of CF-Rank, we show that the low-rankness of different wavelet coefficients varies, and hence introduce the cross-frequency nuclear norm as a theoretical convex surrogate of CF-Rank to automatically update the rank of each wavelet coefficient during optimization. In terms of smoothness, we develop the theoretical Laplacian bound for the four wavelet coefficients represented by CF-INR,

Read the complete text