Audio Spoof Detection with GaborNet

Waldemar Maciejko · 2026

Read Audio Spoof Detection with GaborNet by Waldemar Maciejko (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19209.txt.

Introduction

Maciejko examines spoof detection through GaborNet, a bank of Gabor filters. Time-domain processing has gained ground, exemplified by SincNet, whose layer convolves sinc functions with the input. Finite sinc length distorts frequency, as windowing does. Gabor filters replace sinc functions, but their complex outputs need squared modulus and Gaussian Lowpass Pooling. GaborNet and its modifications are tested within the RawNet2 and RawGAT-ST architectures for audio spoof detection. Audio augmentation via codecs, room responses, and noise is tested.

Catalog record

CREATORWaldemar Maciejko
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35429
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.19209

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Audio Spoof Detection with GaborNet Waldemar Maciejko Abstract An direction of development in the extraction of features from audio signals is based on processing raw samples in the time domain. Such an approach appears to be effective, especially in the era of neural networks. An example is SincNet . In this solution, the core of the neural network layer is a set of sinc functions that are convolved with the input signal. Due to the finite length of sinc functions , distortions appear in the frequency domain of the convolved signal, the same as in the case of windowing the signal. Recently, a new approach has been developed that uses Gabor filters to replace sinc functions . Due to the complex results, further modifications had to be applied, such as squared modulus or Gaussian Lowpass Pooling. In this work, an ingestion layer based on a bank of Gabor filters , named GaborNet , and its modifications are intensively examined within the popular RawNet2 and RawGAT-ST architectures. These have been developed for the purpose of audio spoof detection . Another issue that has been investigated was audio augmentation using codec conversions, room responses, and additive noises. [type=editor, auid=000, bioid=1, prefix=PhD, orcid=0009-0008-2355-3042] keywords audio spoof detection ,SincNet ,GaborNet ,audio augmentation ,Gabor filters ,sinc function 1 Introduction Modern speech synthesis (TTS) or voice conversion (VC) algorithms effectively learn the target speaker’s spectral characteristics. While these algorithms have various positive uses, they can also be used to spoof audio or spread disinformation. This presents a potential vulnerability for both media users and automated speaker recognition systems as indicated by Gupta ( 6 ) . This reiterates the need for the continued development of algorithms to detect audio spoofing. Since the advent of neural networks, the methods of extracting information from audio signals have been significantly transformed. Throughout the progression of audio classification, approaches that employ different variations of time-frequency features, derived from digital signal processing transformations, have emerged as a traditional means of audio representation. The most widely used features based on mel-spectrograms are computed using the squared modulus of the short-term Fourier transform (STFT). Subsequently, the spectrum gets filtered through a bank of triangular bandpass filters arranged on the mel scale (which is almost logarithmic). This process imitates the non-linear way humans perceive sound frequency 4 . This kind of features seems insufficient in the age of neural networks. Specifically, as input features for Convolutional Neural Networks (CNNs), they face several problems. Fixed spectral regions limit the input layer’s view due to the Fourier Transform rule’s defined frequency bands (index of band × sampling rate/window length). Furthermore, this method smooths the speech spectrum, which may prevent the extraction of essential narrow-band features, resulting in an inadequate signal representation 16 . A novel tactic that works directly on the waveform has recently been introduced. In this advanced methodology, the parameters of the filter bank can be learned, similar to the weights of a neural network layer, which are updated with each iteration of the training loop based on the computed gradient of the loss function. As a result, the feature extraction stage has evolved to become the initial layer of the neural network. Among the best-documented techniques that use learnable parameters is SincNet 16 . This architecture has been tested in many tasks, such as speaker recognition 16 8 and audio spoof detection 21 18 19 . Another more sophisticated solution named the Learnable Frontend for Audio Classification (LEAF) has shown efficacy in multiple fields like language, speaker, and emotion recognition. However, research in its application to audio spoof detection is notably lacking. In this study, LEAF has been thoroughly assessed for audio spoof detection, presenting a suitable alternative to SincNet. The Gabor filter bank, a crucial component of LEAF that can be learned, is referred to as GaborNet in comparison to SincNet. This paper incorporates various versions of ingestion layers into the newly developed RawNet2 and RawGAT-ST deep neural networks. It provides an evaluation of these networks under complex conditions. Another factor that was scrutinized was data augmentation, a prevalent technique employed during the training phase that contributes to the development of a generalized model. An appropriate Machine Learning algorithm is able to learn the internal representation of objects when the training dataset is sufficiently representative. In the case of audio, the key factors include bandwidth, codec distortions, and acoustic environment. A neural network cannot extrapolate such conditions to test samples if they are significantly different from training examples. Classification systems based on Deep Neural Networks, working on real live audio data, face the following challenges: lossy compression (selected spectrum with limited range and nonlinear quantization) and channel effects (packet loss, noise). The remainder of this paper is structured as follows. Section 2 discusses related works. Section 3 details the two architectures explored in this paper, RawNet2 and RawGAT-ST, and explains their modifications with different versions of LEAF serving as the ingestion layer. Section 4 presents detailed information about the experiments conducted, their results, and the conclusions drawn from them. 2 Related works The RawNet architecture was developed to enhance data extraction from audio. It utilized a conventional convolutional layer with 128 filters directly applied to raw audio. This kind of approach was used for text-independent speaker recognition. In this solution, all parameters of filters are learned during the training stage 8 . Higher layers utilize Residual Blocks (ResNet), which use skip connections to stabilize the training process and extract more discriminative knowledge. Another improvement was the use of identity mapping 7 , as well as Gated Recurrent Units (GRU) to aggregate frame-level features into a single utterance-level embedding 8 . These strategies indicate that directly learning discriminative knowledge from raw audio using convolutional neural network layers (CNN) can be more effective for speaker recognition than using hand-engineered spectral features. Mirco Ravanelli and Yoshua Bengio introduced a new kind of one-dimensional convolutional layer named SincNet, where the first layer performs a set of time-domain convolutions between the framed input audio and a predefined kernel function 16 . Convolution in the time domain corresponds to filtration in the frequency domain. The Fourier Transform of a normalized sinc function has a rectangular characteristic. Deploying a band-pass filter bank with rectangular characteristics leads to separation of the input signal into multiple components. Each filter in the bank is defined by learnable f_{1} (low) and f_{2} (high) cut-off frequencies. Learnable parameters can be initialized based on values allocated on the mel-scale. It has been proven that SincNet leads to faster convergence of learning curves and limits the number of parameters to learn in the first convolutional layer 16 . Another phase in the evolution of the RawNet architecture involved applying higher blocks of ResNets and a technique called Feature Map Scaling (FMS). FMS, a form of Attention Mechanism, aims to choose only those filters that convey significant and distinguishing information 9 . The use of SincNet as an ingestion layer in an application developed for audio spoofing detection was first presented by H. Tak et al. 21 . The authors noticed that, at that time, systems had poor capability to detect the A17 type of attack (the Voice Conversion system was judged to have the highest spoofing

Read the complete text