From Numbers to Perception, Energy Decay Curves Prediction
Imran Muhammad, Gerald Schuller · 2026
Read From Numbers to Perception, Energy Decay Curves Prediction by Imran Muhammad, Gerald Schuller (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20968.txt.
Introduction
I. Muhammad and Gerald Schuller predict energy decay curves for room impulse responses from room geometry and material properties. Predicting room echoes remains hard due to high audio size and the need for perceptual accuracy. Their neural network design predicts multi-band energy decay curves straight from geometry and materials, using a custom composite loss that optimizes both energy tiers and decay slopes in the log domain. That ensures predicted curves follow physical decay principles while staying sensitive to reverberation time and early reflections.
Catalog record
| CREATOR | Imran Muhammad, Gerald Schuller |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 13043 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.20968
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Numbers to Perception, Energy Decay Curves Prediction Imran Muhammad, Gerald Schuller Abstract Abstract Predicting Room Impulse Responses (RIRs) remains a challenge due to the high dimensionality of audio signals and the need for perceptual accuracy. This paper introduces a neural network framework that predicts multi-band Energy Decay Curves (EDCs) directly from room geometry and material properties. Unlike standard models, our framework employs a custom composite loss function that optimizes for both energy levels and decay slopes in the log-domain. This ensures the predicted curves adhere to physical decay principles while maintaining high sensitivity to reverberation time and early reflections. Results demonstrate that the model successfully approximates ground-truth acoustics with minimal error in T_{30} and clarity indices. The approach offers a computationally efficient alternative to traditional simulations, facilitating realistic audio rendering for interactive virtual environments. Introduction Room impulse responses are fundamental to spatial audio rendering, immersive virtual environments, and professional acoustic design. Key acoustic descriptors, such as reverberation times ( T_{30} ), early decay time (EDT), and clarity ( C_{50} ), are conventionally derived from RIRs or their corresponding energy decay curves, which describe the temporal evolution of sound energy following an acoustic excitation [ 7 ] . Classical room-acoustic modeling typically relies on computationally intensive simulations, such as ray tracing, the image-source method (ISM), or wave-based solvers [ 14 ] . While geometric software like Pyroomacoustics [ 12 ] and others [ 13 , 1 , 8 ] offer faster alternatives to physical measurements, they often involve a trade-off between speed and physical accuracy, particularly regarding frequency-dependent absorption and low-frequency wave phenomena. This has prompted a surge in data-driven approaches that aim to approximate complex room acoustics using neural networks. Recent deep learning research in this domain generally falls into three categories: (i) scalar parameter prediction from geometric descriptors [ 2 , 11 ] , (ii) direct RIR waveform synthesis or completion [ 9 , 5 ] , and (iii) generative modeling for data augmentation [ 6 , 10 ] . While waveform-level prediction is common, RIRs are high-dimensional signals, making direct synthesis prone to phase inconsistencies and non-physical artifacts. Previous work by the authors [ 3 , 4 ] addressed this by using EDCs as a compact intermediate representation, utilizing a Long Short-Term Memory (LSTM) network to map room geometry to broadband decay patterns. In this work, we significantly advance this framework by introducing a physically-constrained 1D-Convolutional Neural Network (CNN) decoder . This architecture provides three major improvements over previous LSTM-based models. First, we transition from broadband modeling to multi-band prediction , estimating EDCs across 24 one-third octave bands (100 Hz to 20 kHz). Second, we achieve a 90% reduction in model complexity , decreasing the parameter count from approximately 90 million to 9 million, thereby facilitating real-time interactive applications. Finally, we introduce a custom composite loss function operating in the decibel domain. By incorporating a slope penalty (finite difference with a stride of 50 samples), we effectively suppress the ”staircase” artifacts common in sequential models and ensure that the predicted EDCs adhere to the physical principle of monotonic energy decay. We evaluate our framework on a dataset of 6,000 simulated rooms with varied geometries and frequency-dependent materials. Objective metrics demonstrate that the predicted T_{30} values are largely within the 5% Just Noticeable Difference (JND) threshold. Furthermore, we reconstruct full RIRs using a stochastic ”sticky” random sign method [ 4 ] , which is validated through spectral and temporal correlation analysis. The results indicate that the proposed ConvNet architecture, guided by physically-motivated loss, provides a robust and efficient alternative for perceptually-accurate acoustic modeling. Methodology The proposed framework maps room geometric and material features to frequency-dependent energy decay curves using a 1D-Convolutional Neural Network (CNN). In contrast to our previous work utilizing Recurrent Neural Networks (LSTM) [ 3 ] , this architecture enforces physical decay constraints through a custom loss function and an integrated interpolation-based decoder. Dataset Generation and Preprocessing A dataset of 6,000 shoebox rooms was simulated using the Pyroomacoustics library [ 12 ] for distinct room configurations as input room features, with each room defined by its length ( L ), width ( W ), height ( H ), source and receiver positions in three dimensions (i.e. X , Y , and Z ), and frequency-dependent absorption coefficients averaged for all walls. These parameters were varied over a range of realistic values (see Table 1 ) to simulate various acoustic environments. The distribution of reverberation times within the generated dataset is shown in Fig. 1 which illustrated that the distribution of T_{60} values is non-uniformly distributed which is a physical consequence of the simulation parameters. This non-uniformity ensures the model is heavily trained on typical room conditions while remaining exposed to rarer, highly reverberant cases, improving its robustness for general purpose auralization. • Frequency-Dependent Absorption: Unlike broadband models, we assign distinct absorption coefficients per surface, corresponding to one-third octave bands from 100 Hz to 20 kHz. • Normalization: Input features are scaled using MinMax normalization to the range [0,1] . The target EDCs are computed via the Schroeder integral in reverse time and normalized. Figure 1: Histogram showing the distribution of T_{60} values across the room dataset. Table 1: Range of simulated room acoustic features used as input parameters for model training. Parameter Range / Values Dimensions ( L\times W\times H ) 3-6 m \times 3-6 m \times 2.5-4 m Source–Receiver Distances 1–4 m Wall Absorptions 0.14–0.65 (100–20 kHz) Total Room Configurations 6000 ConvNet Architecture The model transitions from a sequential LSTM to a 1D-CNN decoder, as illustrated in the architecture flow diagram in Fig. 2 , to reduce the parameter count from 90 million to 9 million (a 90% reduction). Figure 2: Conv. Neural Network Flow Diagram 1. Encoder: A multi-layer perceptron (MLP) compresses the 16-dimensional input feature vector into a high-dimensional latent space. 2. 1D-CNN Decoder: This latent representation is decoded through three 1D-convolutional layers. To avoid the ”staircase” artifacts observed in recurrent architectures, we utilize linear interpolation ( F.interpolate ) to upsample the latent features to the target sequence length. 3. Output Layer: A Sigmoid activation function is applied to the final layer to bound the energy values between (0,1) , ensuring that the predicted EDC remains within physically plausible energy limits. Log-Domain Loss with Slope Penalty To align the training objective with human perception, the model is optimized in the decibel domain: y_{dB}=10\log_{10}(y+\epsilon) . We propose a composite loss function \mathcal{L}_{t} : \mathcal{L}_{t}=\text{MSE}(\hat{y}_{dB},y_{dB})+\alpha\cdot\text{MSE}(\Delta\hat{y}_{dB},\Delta y_{dB}) (1) The first term ensures absolute level accuracy. The second term, the Slope Penalty , computes the finite difference with a stride k=50 : \Delta y_{dB}[n]=y_{dB}[n+k]-y_{dB}[n] (2) With \alpha=0.2 , this term penalizes non-monotonic fluctuations, forcing the model to learn the local rate of decay (slope) rather than just point-wise values. RIR Reconstruction To reconstruct a full Room Impulse Response (RIR) from the predicted EDC, we differentiate the energy curve to obtain the magnitude envelope. Polarity is assigned using the Random Sign-Sticky (RSS) method [ 4 ] . A stickiness parameter of p=0.9 is used to maintain sign continuity, preserving the spectral balance and low-frequency coherence necessary for a perceptually faithful auralization. Evaluation and Results We evaluate the proposed ConvNet-based multi-band framework using objective signal-level metrics and derived room