Audio Editing Features as User-Centric Privacy Defenses Against Large Language Model (LLM)-Based Emotion Inference Attacks
Mohd. Farhan Israk Soumik School of Computing Southern Illinois University Carbondale, IL, 62901 [email protected], W.K.M Mithsara School of Computing Southern Illinois University Carbondale, IL, 62901 [email protected], Abdur R. Shahid School of Computing Southern Illinois Unive · 2025
Read Audio Editing Features as User-Centric Privacy Defenses Against Large Language Model (LLM)-Based Emotion Inference Attacks by Mohd. Farhan Israk Soumik School of Computing Southern Illinois University Carbondale, IL, 62901 [email protected], W.K.M Mithsara School of Computing Southern Illinois University Carbondale, IL, 62901 [email protected], Abdur R. Shahid School of Computing Southern Illinois Unive (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18727.txt.
Introduction
Mohd Farhan Israk Soumik and co-authors test whether simple sound edits can shield feelings from AI eavesdroppers, in a 2025 paper. Voice tools are everywhere, and models can now guess a speaker's emotions from a clip, a private signal most people never mean to share. Heavy privacy tools often break usability, so adoption lags.
The team survey popular phone editing apps and pick two features found in nearly all: pitch shifting and tempo change. They test both against attack models, from plain neural networks to large language models, and check whether the edits can be undone. Across three data sets, the edits blurred emotion cues well while keeping speech usable. The authors sketch a light on-device design so the shield can run on ordinary phones.
Catalog record
| CREATOR | Mohd. Farhan Israk Soumik School of Computing Southern Illinois University Carbondale, IL, 62901 [email protected], W.K.M Mithsara School of Computing Southern Illinois University Carbondale, IL, 62901 [email protected], Abdur R. Shahid School of Computing Southern Illinois Unive |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-18727
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Audio Editing Features as User-Centric Privacy Defenses Against Large Language Model (LLM)-Based Emotion Inference Attacks Mohd. Farhan Israk Soumik School of Computing Southern Illinois University Carbondale, IL, 62901 [email protected], W.K.M Mithsara School of Computing Southern Illinois University Carbondale, IL, 62901 [email protected], Abdur R. Shahid School of Computing Southern Illinois University Carbondale, IL, 62901 [email protected], Ahmed Imteaj School of Computing Southern Illinois University Carbondale, IL, 62901 [email protected] Abstract The rapid proliferation of speech-enabled technologies, including virtual assistants, video conferencing platforms, and wearable devices, has raised significant privacy concerns, particularly regarding the inference of sensitive emotional information from audio data. Existing privacy-preserving methods often compromise usability and security, limiting their adoption in practical scenarios. This paper introduces a novel, user-centric approach that leverages familiar audio editing techniques, specifically pitch and tempo manipulation, to protect emotional privacy without sacrificing usability. By analyzing popular audio editing applications on Android and iOS platforms, we identified these features as both widely available and usable. We rigorously evaluated their effectiveness against a threat model, considering adversarial attacks from diverse sources, including Deep Neural Networks (DNNs), Large Language Models (LLMs), and and reversibility testing. Our experiments, conducted on three distinct datasets, demonstrate that pitch and tempo manipulation effectively obfuscates emotional data. Additionally, we explore the design principles for lightweight, on-device implementation to ensure broad applicability across various devices and platforms. August 24, 2026 1 Introduction The interconnection between human emotion and audio is profound and intricate. Audio can evoke, amplify, and manipulate feelings through tones, rhythms, and frequencies [ 1 ] . Acoustic details and voice inflections convey emotions more effectively than words. The prevalence of audio in our daily lives has increased due to advancements in modern communication technologies, particularly high-speed internet and mobile networking like 4G and 5G. These technologies have enabled the transmission of superior audio quality and seamless transmission, which has become the cornerstone of platforms like video conferencing, podcasts, and Voice-over-IP(VoIP) services. Video conferencing and streaming platforms like Zoom, Google Meet, Twitch, and social media have contributed to this expansion. AI-powered Personalized Virtual Assistants(e.g Alexa, Siri) and Large Language Models (LLMs) are gaining ground, making voice commands and interactions more ubiquitous while increasing the significance of audio as a data format [ 2 ] . We are slowly embracing the world of virtual reality(VR), augmented reality(AR), and immersive technologies, which are considered Extended Reality [ 3 ] [ 4 ] . Audio is a critical component for creating fully immersive experiences. Spatial audio, which lets users perceive sound directionally in 3D, has become crucial in AR and VR environments for more realistic and engaging interactions. In VR gaming, dynamic audio effects synchronize sound with virtual objects and movements, enhancing immersion. Machine learning optimizes audio processing for immersive technologies, including real-time noise cancellation, voice recognition, and personalized soundscapes. As new disruptive technologies proliferate, audio gains relevance but also brings emerging security concerns. Audio recordings reveal content and sensitive private information, like emotions or geographic locations, from background noise and vocal cues, emphasizing audio privacy [ 5 ] . Systems like Siri and Alexa use Speech Emotion Recognition (SER) to infer users’ affective states for applications like mental health monitoring and interactive entertainment [ 6 ] . However, these systems are vulnerable to inference attacks that extract sensitive attributes like identity and gender from audio signals [ 6 ] . Even Federated Learning, considered more secure, has been shown to be susceptible to inference attacks on audio data [ 7 ] . Video conferencing platforms are also susceptible to attacks that extract personal attributes from audio, video, drawing, and writing data [ 8 , 9 ] . Emerging VR devices present additional challenges due to their extensive sensor integrations, including audio. Attackers can exploit vocalizations in VR environments to fingerprint users and infer sensitive attributes like age, emotion, and personality using machine learning [ 10 , 11 , 12 ] . To mitigate the inference of sensitive attributes and information from speech data, researchers have proposed diverse privacy-preserving methods. These include sanitizing sensitive features to obscure private information, employing cryptographic techniques, and incorporating privacy-by-design principles to balance privacy and utility. Techniques such as differential privacy, disentangled representation learning, and deep neural network-based obfuscation have been explored to protect against attribute inference attacks, including gender and emotion recognition [ 13 , 14 , 15 ] . Frameworks leveraging advanced methods like hierarchical noise addition, task-relevant data transformation, and genetic programming have also been proposed to ensure privacy in speech-based systems, including federated learning, voice user interfaces, and smart speakers [ 16 ] . If we closely analyze these works, it becomes evident that they primarily achieve privacy by identifying and separating sensitive features of speech audio data using machine learning models. These models often involve computationally intensive architectures, such as autoencoders, to extract and isolate sensitive attributes. Once identified, these attributes are privatized using security measures like encryption or differential privacy. While some approaches allow users to define varying levels of privacy (e.g., high, medium, low) for different types of sensitive attributes, this often requires an understanding of the technical implications of these settings. Such reliance on user expertise or awareness may limit the accessibility and usability of these solutions, especially for non-technical users. This paper proposes a novel approach to privacy preservation in audio-based emotion recognition attacks. Unlike existing works, it focuses on usability and aims to develop a method that can be adopted by users with minimal training or technical expertise. WE envisioned that the approach will be system-wide and not confined to specific applications or platforms, such as Apple Intelligence [ 17 ] . Equally important, utilizing such features to modify audio files will have minimal impact on user acceptability, as users are already employing these features for fun and utility, thereby blurring the gap between usability and privacy protection. To achieve this goal, we begin our study by analyzing audio editing applications available on the Google Play Store [ 18 ] and Apple App Store [ 19 ] to identify common audio editing features. The rationale for this step lies in the fact that billions of people already use devices integrated into either the Android [ 20 ] or iOS [ 21 ] ecosystems. We hypothesize that leveraging familiar tools and workflows will enhance the usability and adoption of our proposed approach. Our analysis reveals that many of these applications include features to modify pitch and tempo values through intuitive means, such as sliders. Building on this insight, we explore the potential of using systematic pitch and tempo manipulation as the foundation of a user-centric privacy-preservation mechanism. To rigorously evaluate the feasibility of this approach, we design a threat model that incorporates a diverse range of attack vectors, including various AI models based on Deep Neural Networks (DNNs), Large Language Models (LLMs), and reversibility testing using audio editing applications. In the evaluation, we utilize three distinct datasets to assess the generalizability of the proposed features in protecting privacy. Furthermore, we investigate potential biases (e.g., demographic biases) in the effectiveness of privacy protection and evaluate the approach’s resilience against various attack types. Our extensive experiments demonstrate promising results, indicating that pitch and tempo manipulation can serve as an effective, user-friendly privacy-preserving mechanism against