RawTFNet: A Lightweight CNN Architecture for Speech Anti-spoofing
\authorblockN Yang Xiao \authorrefmark 1, Ting Dang \authorrefmark 1, Rohan Kumar Das \authorrefmark 2 \authorblockA \authorrefmark 1The University of Melbourne, Australia \authorblockA \authorrefmark 2Fortemedia Singapore, Singapore · 2025
Read RawTFNet: A Lightweight CNN Architecture for Speech Anti-spoofing by \authorblockN Yang Xiao \authorrefmark 1, Ting Dang \authorrefmark 1, Rohan Kumar Das \authorrefmark 2 \authorblockA \authorrefmark 1The University of Melbourne, Australia \authorblockA \authorrefmark 2Fortemedia Singapore, Singapore (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-08227.txt.
Introduction
Yang Xiao, Ting Dang, and Rohan Kumar Das build a light speech anti-spoofing model in a 2025 paper. Speaker verification systems can be fooled by fake audio. Transformer detectors catch fakes well but demand heavy computing. Their network, RawTFNet, is a compact convolutional model that works on raw sound. It splits feature handling between time and frequency views to catch fine traces of synthetic speech.
Tests run on two ASVspoof 2021 benchmark sets, covering phone-like and deepfake audio. RawTFNet matches leading systems on detection quality, they report, while using far fewer resources. Code and trained models will be shared publicly for reuse.
Catalog record
| CREATOR | \authorblockN Yang Xiao \authorrefmark 1, Ting Dang \authorrefmark 1, Rohan Kumar Das \authorrefmark 2 \authorblockA \authorrefmark 1The University of Melbourne, Australia \authorblockA \authorrefmark 2Fortemedia Singapore, Singapore |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-08227
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RawTFNet: A Lightweight CNN Architecture for Speech Anti-spoofing \authorblockN Yang Xiao \authorrefmark 1, Ting Dang \authorrefmark 1, Rohan Kumar Das \authorrefmark 2 \authorblockA \authorrefmark 1The University of Melbourne, Australia \authorblockA \authorrefmark 2Fortemedia Singapore, Singapore Abstract Automatic speaker verification (ASV) systems are often affected by spoofing attacks. Recent transformer-based models have improved anti-spoofing performance by learning strong feature representations. However, these models usually need high computing power. To address this, we introduce RawTFNet, a lightweight CNN model designed for audio signals. The RawTFNet separates feature processing along time and frequency dimensions, which helps to capture the fine-grained details of synthetic speech. We tested RawTFNet on the ASVspoof 2021 LA and DF evaluation datasets. The results show that RawTFNet reaches comparable performance to that of the state-of-the-art models, while also using fewer computing resources. The code and models will be made publicly available. 1 Introduction In recent years, deep learning technologies have greatly improved speech generation methods such as text-to-speech (TTS) [ 1 ] and voice conversion (VC) [ 2 ] . These technologies bring many advantages, especially for speech applications. However, they also create risks when used to generate fake speech that imitates a target speaker. Modern TTS and VC systems can now produce speech that sounds highly natural, which makes it easier to attack voice-based systems. As a result, automatic speaker verification (ASV) systems face growing threats from such synthetic speech [ 3 , 4 , 5 ] . To reduce these risks, researchers have focused on anti-spoofing methods that can detect fake voices. The ASVspoof challenge [ 6 ] has become an important platform in this field. It provides standard datasets, rules, and evaluation methods to help the research community develop and compare anti-spoofing systems. Deep learning-based speech anti-spoofing methods can be divided into two main types: feature-based and end-to-end approaches. Feature-based methods use pre-designed representations such as linear-frequency cepstral coefficients (LFCC) [ 7 ] , cochlear filter cepstral coefficient and instantaneous frequency [ 8 ] and constant-Q transform (CQT) based representations [ 9 , 10 ] . These features help to capture the unique patterns of fake speech for detection. On the other hand, end-to-end approaches work directly with raw audio signals [ 11 , 12 , 13 ] . They do not depend on handcrafted features and have shown strong generalization and performance. As a result, many recent studies focus on end-to-end models. For example, RawNet2 [ 14 ] uses time-domain convolution to learn features from raw waveforms. Attention-based models, like AASIST [ 15 ] , apply graph attention networks to better capture both local and global speech features across time and frequency. Similarly, Rawformer [ 16 ] combines convolutional layers with transformers, using self-attention to detect important clues for fake speech. Although these models perform well, they often need large computing resources. This makes them hard to use in real-world systems, especially where low power and fast processing are required. Therefore, it is important to find a balance between accuracy and efficiency for practical deployment. To improve efficiency in speech processing tasks, researchers have proposed several lightweight convolutional neural network (CNN) architectures. For example, BC-ResNet [ 17 ] applies depthwise separable convolutions to reduce both model size and computational cost, while maintaining strong performance. Similarly, the TDNN [ 18 ] captures temporal structures in speech by applying convolution over time steps. These models are widely used in tasks such as ASV due to their good balance between speed and accuracy. However, although these architectures are efficient, they are not specifically tailored for speech anti-spoofing. Most of them concentrate on temporal features or use global representations, without focusing on the unique characteristics of synthetic speech. In practice, fake speech signals often contain subtle but important artifacts that are distributed across both time and frequency dimensions [ 19 ] . Standard CNNs, which process the input uniformly or emphasize only one dimension, may overlook these subtle patterns. To handle the challenges of speech anti-spoofing, a task-specific model that can separate time and frequency information is needed. Inspired by time-frequency attention [ 20 ] , we propose Time-Frequency Convolutions (TF-Convs), a 1D convolution-based module. It processes feature maps in two branches: one for time and another for frequency. This allows the model to capture detailed patterns in both dimensions while keeping computation low. We further propose a new anti-spoofing architecture (RawTFNet) that combines both efficiency and task-specific design. First, we use a Sinusoidal Convolution [ 21 ] layer and some SE-Res2Net blocks as the frontend, which effectively captures local patterns and enhances feature diversity. Then, the resulting feature map is processed by the TF-Convs module. Finally, the combined features are passed into the classifier. This architecture is designed to detect the fine-grained artifacts while keeping the model efficient. We tested RawTFNet on the ASVspoof 2021 LA and DF datasets. The results show that RawTFNet works directly on raw features and reaches comparable accuracy to state-of-the-art (SOTA) models, while using only 70K parameters. Figure 1: Overview of the proposed RawTFNet architecture for speech anti-spoofing. (a) The model begins with a Sinc layer followed by four DWS SE-Res2Blocks to extract low-level features. These are then processed by stacked TF-Conv blocks and a final Conv1D layer for classification. (b) The DWS SE-Res2Block integrates depthwise separable convolutions, a Res2Net module with dilation, and a squeeze-and-excitation block to enhance channel-wise attention and efficiency. (c) The TF-Conv module separates feature maps along time and frequency dimensions using 1D depthwise convolutions, followed by pooling and pointwise convolution before merging. We fix the TF-Conv layer number ‘N’ to 9 in this work. 2 Proposed RawTFNet To address the limitations of existing lightweight speech anti-spoofing models that do not explicitly separate time and frequency information, we propose a task-specific architecture for anti-spoofing called RawTFNet. Inspired by the time-frequency nature of speech signals, RawTFNet is designed to better capture fine-grained artifacts using dimension-aware processing. Fig. 1 (a) illustrates the overall structure of the proposed RawTFNet. In particular, we introduce a novel TF-Convs module that separates the analysis of time and frequency using 1D depthwise convolutions. Additionally, to improve the representation of local and contextual information, we integrate DWS SE-Res2Blocks that enhance feature diversity and channel attention with low computation. 2.1 Frontend The frontend in RawTFNet is designed to extract low-level spectro-temporal features directly from raw audio. We adopt a modified version of RawNet2 [ 14 ] to perform this task. First, the raw waveform is passed through a set of trainable Sinc filters [ 21 ] (with 70 filters in total), which act as learnable band-pass filters. This converts the signal into a two-dimensional feature map of frequency and time bins. Next, the extracted features are refined through a series of convolutional layers. The resultant output passes through a ResNet block with 32 filters to capture early patterns. Then, it is processed by three SE-Res2Net blocks with 64 filters each, which enhance feature diversity using multiple receptive fields. To further improve efficiency, we replace standard 2D convolutions with DWS convolutions. This leads to the use of DWS SE-Res2Net blocks, as shown in Fig. 1 (b), which reduce computation while preserving performance. Each block also includes a squeeze-and-excitation (SE) module [ 22 ] to strengthen important channel-wise information. As a