Spectral Energy Centroid: a Metric for Improving Performance and Analyzing Spectral Bias in Implicit Neural Representations

Tomasz Dądela, Adam Kania, Maciej Rut, Przemysław Spurek · 2026

Read Spectral Energy Centroid: a Metric for Improving Performance and Analyzing Spectral Bias in Implicit Neural Representations by Tomasz Dądela, Adam Kania, Maciej Rut, Przemysław Spurek (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12709.txt.

Introduction

Dądela and three colleagues introduce the Spectral Energy Centroid, a metric for spectral bias in implicit neural representations. Such models use multi-layer perceptrons to model smooth signals in compact, smooth form. Yet those nets carry a low-frequency bias that blocks learning of small details, so it must be tuned through the embedding layer. Prior tuning before training ignored model depth. The centroid gauges target image frequency and model spectral bias, clarifying how it, depth and scores relate.

Catalog record

CREATORTomasz Dądela, Adam Kania, Maciej Rut, Przemysław Spurek
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54938
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.12709

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Spectral Energy Centroid: a Metric for Improving Performance and Analyzing Spectral Bias in Implicit Neural Representations Tomasz Dądela, Adam Kania, Maciej Rut, Przemysław Spurek Abstract Implicit Neural Representations (INRs) model continuous signals using multilayer perceptrons (MLPs), enabling compact, differentiable, and high-fidelity representations of data across diverse domains. However, due to the low-frequency bias of MLPs that prevents effective learning of small details, the model’s frequency must be carefully tuned through the embedding layer. Prior work established that this tuning can be performed before training based on the target signal, but it did not account for the significant effect of model depth, indicating that our understanding of the relationship between frequency and INR performance remains limited. To gain insights into this relationship, we utilize the Spectral Energy Centroid (SEC) metric that quantifies the frequency of target images and the spectral bias of INR models. We show that SEC is a versatile tool for INR analysis, demonstrating its utility across three tasks: (1) a data-driven strategy (SEC-Conf) for hyperparameter selection that outperforms existing heuristics and is robust to model depth, (2) a reliable proxy for signal complexity, and (3) effective alignment of spectral biases across diverse INR architectures. Figure 1: Visual comparison of performance of a large (4-layer) Fourier model after 1000 steps. The left block shows crops of the full image (right) for the default configuration of embedding frequency, and ones selected by FreSh and SEC-conf (SEC-conf is an example application of SEC). Leveraging Energy centroids (SEC), we achieve improved performance, with SEC-conf resulting in the sharpest image. Implicit Neural Representations (INRs) have become a vital tool for scene modeling, robotics, and generative tasks 21 , representing signals as continuous functions parameterized by MLPs. However, standard MLPs suffer from a low-frequency bias, making it difficult to capture fine details 22 ; 13 . To address this, architectures like Siren 17 , Fourier 19 , and Finer 6 introduce architectural inductive biases that facilitate the learning of fine details, in particular through a high-frequency input mapping controlled by an embedding frequency parameter. However, in practice, selecting optimal embedding frequency parameter values is computationally expensive. Optimal settings vary significantly across target images 3 , forcing practitioners to resort to costly hyperparameter sweeps or to rely on default values from original publications. This challenge is compounded in architectures like Finer or Wire 16 , where multiple frequency-related hyperparameters jointly influence performance, making it difficult to know which ones to tune. The FreSh 3 method represents the first attempt to mitigate this issue and simplify embedding frequency parameter selection for INR models by aligning the frequency of the model with the target image. FreSh assumes that for optimal learning, frequencies present in the image and the untrained model should be the same and aligns them by selecting an embedding frequency parameter that minimizes Wasserstein distance. This approach, while effective in certain settings, does not generalize to some particularly high-frequency models such as Wire and degrades in performance when model depth is modified. This degradation suggests a flaw in the assumption made by FreSh regarding the alignment of model and target signal frequencies. Based on our experiments, the relationship between the frequencies of the target signal and the model is not direct, but can be learned from data. In this work, we investigate the spectral bias of INRs and its impact on performance across different target signals. To quantify the frequency content of target images and the spectral bias of INR models, we utilize the Spectral Energy Centroid metric (SEC). We show that SEC is a general-purpose tool for INR spectral analysis, demonstrating its utility across three tasks. We demonstrate that model architecture influences spectral bias, a dependency that undermines existing heuristics like FreSh which doesn’t have a mechanism to account for model size. To address this, we propose a robust, data-driven strategy for embedding layer configuration (SEC-conf) that effectively handles varying model sizes, as shown in fig. 1 . Furthermore, we provide a framework for aligning spectral biases across diverse architectures, demonstrating that such alignment can enable older models to match the performance of newer ones in specific settings. Finally, we validate SEC as a reliable proxy for signal complexity. Our main contributions are as follows: • We utilize SEC to quantify the frequency of images and the spectral bias of INR models, revealing a strong dependency between model depth and spectral bias. • We propose a data-driven strategy for hyperparameter selection (called SEC-conf) and alignment of spectral bias across architectures, outperforming existing heuristics. • We demonstrate that SEC serves as a reliable proxy for signal complexity, strongly correlating with reconstruction quality. 1 Related works Spectral bias refers to the tendency of neural networks to learn low-frequency components of a signal more rapidly than high-frequency ones ( 22 ; 13 ; 15 ; 2 ) . This phenomenon has been observed not only in MLPs but also in more complex architectures, such as diffusion models 20 . Spectral bias is often cited as one explanation for the generalization ability of neural networks 15 . However, it poses a significant challenge for INRs, as it suppresses high-frequency signals. Implicit Neural Representations (INRs) represent signals - ranging from images and videos 7 to 3D scenes 8 and tabular data 10 - as continuous functions parameterized by MLPs. In this study, we focus on INRs for image representation, as their moderate computational requirements enable us to conduct a large-scale benchmark across diverse architectures and configurations. INRs learn a mapping from spatial or temporal coordinates to signal values (e.g., color or density). Unlike in standard learning scenarios, INR training involves dense supervision (e.g., every pixel in an image) with the explicit goal of high-fidelity signal reconstruction. In this overfitting regime, spectral bias becomes a critical bottleneck, hindering the capture of fine details and removing it to enable learning of a broad range of frequencies is a central focus in INR research 17 ; 19 ; 16 ; 6 ; 3 . This can be partially achieved through deeper models, as it was theoretically shown depth expands the set of representable frequencies, though with diminishing magnitude for higher harmonics 23 . However, many state-of-the-art approaches primarily solve this issue with a high-frequency embedding in the input layer, governed by a hyperparameter we refer to as the embedding frequency parameter . Siren 17 is one of the earliest and most influential INR architectures. It employs sinusoidal activations throughout the network, enabling it to represent high-frequency signals effectively. Its first layer applies a scaled sinusoidal mapping, \sin(\omega_{s}W\mathbf{x}+\mathbf{b}) , where \omega_{s} serves as the primary frequency parameter controlling the network’s bandwidth 1 1 1 We deviate from the original notation to avoid collisions between Siren , Finer , and Wire . . Although all layers use sine activations, mainly the first layer affects the frequency bias, as later layers use relatively small scales. Fourier features 19 utilize a fixed high-frequency embedding of the input coordinates, typically followed by an MLP with ReLU activations. The embedding utilizes frequencies sampled from a Gaussian distribution, where the standard deviation \sigma directly controls the spectral bias (see eq. 7 ). Wire 16 employs a continuous complex Gabor wavelet as its activation, which is governed by two hyperparameters:

Read the complete text