Can You Trust What You See? Alpha Channel No-Box Attacks on Video Object Detection
Ariana Yi, Ce Zhou, Liyang Xiao, Qiben Yan, [0.2em] Mission San Jose High School · 2025
Read Can You Trust What You See? Alpha Channel No-Box Attacks on Video Object Detection by Ariana Yi, Ce Zhou, Liyang Xiao, Qiben Yan, [0.2em] Mission San Jose High School (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-19574.txt.
Introduction
Ariana Yi and three co-authors reveal an attack that hides malicious video content inside the transparency channel of a video file. Their method, alpha-Cloak, fuses a target video into a harmless-looking one through the alpha channel of RGBA video. Human viewers see only the innocent footage, while object detectors see the hidden content.
The attack needs no access to the target model's design, parameters, or outputs, and leaves no visible artifacts. The authors first surveyed how widely common formats and players support alpha channels, then built a fusion method that stays compatible and stealthy. Tested against five leading detectors, a vision-language model, and a large multimodal model, the attack succeeded every time, exposing an overlooked weakness in video perception systems.
Catalog record
| CREATOR | Ariana Yi, Ce Zhou, Liyang Xiao, Qiben Yan, [0.2em] Mission San Jose High School |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-19574
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Can You Trust What You See? Alpha Channel No-Box Attacks on Video Object Detection Ariana Yi, Ce Zhou, Liyang Xiao, Qiben Yan, [0.2em] Mission San Jose High School Abstract As object detection models are increasingly deployed in cyber-physical systems such as autonomous vehicles (AVs) and surveillance platforms, ensuring their security against adversarial threats is essential. While prior work has explored adversarial attacks in the image domain, those attacks in the video domain remain largely unexamined, especially in the no-box setting. In this paper, we present α \alpha -Cloak , the first no-box adversarial attack on object detectors that operates entirely through the alpha channel of RGBA videos. α \alpha -Cloak exploits the alpha channel to fuse a malicious target video with a benign video, resulting in a fused video that appears innocuous to human viewers but consistently fools object detectors. Our attack requires no access to model architecture, parameters, or outputs, and introduces no perceptible artifacts. We systematically study the support for alpha channels across common video formats and playback applications, and design a fusion algorithm that ensures visual stealth and compatibility. We evaluate α \alpha -Cloak on five state-of-the-art object detectors, a vision-language model, and a multimodal large language model (Gemini-2.0-Flash), demonstrating a 100% attack success rate across all scenarios. Our findings reveal a previously unexplored vulnerability in video-based perception systems, highlighting the urgent need for defenses that account for the alpha channel in adversarial settings. I Introduction Artificial intelligence (AI) models are increasingly integrated into cyber-physical systems, empowering tasks such as obstacle avoidance in autonomous driving, environmental sensing in smart homes, and intelligent motion control in robotics. With the rapid advancement of AI, large language models (LLMs) are also being adopted in these domains [ 27 ] . Due to their low cost and portability, camera sensors have become one of the most widely used sensing modalities in such systems. As a result, computer vision tasks involving both images and videos play a critical role in system functionality. Despite these advancements, security vulnerabilities persist due to the inherent weaknesses of AI models. To address practical and generalizable threats, black-box adversarial attacks have been widely studied [ 2 , 4 , 16 , 24 ] . However, existing black-box attacks often suffer from key limitations, including excessive query requirements, low efficiency, and reduced success rates and confidence levels [ 26 ] . While some black-box attacks have been extended to the physical world [ 29 , 28 ] , they remain constrained by real-world challenges such as physical access and continuous control. Recently, Xia et al. [ 26 ] proposed AlphaDog, a no-box universal attack, which exploits the previously overlooked alpha channel in images to achieve 100% success rate and confidence with high stealth. However, their work focuses solely on the image domain, leaving the video domain unexplored. Notably, various video formats, such as Apple ProRes 4444 (.mov), HEVC (.hevc), WebM (.webm), OpenEXR (.exr), and Animated PNG (.apng), also support alpha channels. In the video domain, the alpha channel functions similarly to that in images. It works as a transparent layer enabling seamless blending of visual elements. It plays a critical role in video editing, web development, and graphic design. In this paper, inspired by AlphaDog [ 26 ] , we propose the first no-box adversarial attack in the video domain, called \alpha -Cloak , which targets object detection systems commonly deployed in cyber-physical environments. Unlike the image domain, the video domain presents two unique challenges. First, most video players use black or gray backgrounds by default, rather than white, and not all video formats support alpha channels. To address this, we conduct extensive preliminary experiments to identify compatible video formats and analyze the background colors used by popular video players. Second, embedding an adversarial image into a video is non-trivial because videos consist of multiple frames, not a single static image. To overcome this, we design a novel fusion algorithm that combines a benign video and a malicious adversarial video. By carefully tuning key parameters, our method ensures the malicious content remains completely invisible to human observers while still being detected by AI models. We evaluate \alpha -Cloak on five widely used object detection models, one vision-language model (VLM), and extend our analysis to an LLM with visual capabilities. Because the adversarial content is embedded structurally within the video format, the attack remains robust across diverse models and video players, achieving a 100% success rate in all experiments. Our contributions are summarized as follows: • We present \alpha -Cloak , the first no-box adversarial attack on object detection models processing video inputs. It requires no model queries, architecture knowledge, parameter access, or output feedback during generation. • We demonstrate that adversarially perturbed videos can cause object detection models to consistently perceive a target malicious video while human viewers see only the original benign content. Unlike perturbation-based methods, \alpha -Cloak introduces no visible noise for humans or detectors. • We validate our approach across a broad range of vision and language models, including various types of object detection models, a VLM, and a multimodal LLM (Gemini-2.0-Flash). We achieve a 100% attack success rate across all cases. This highlights the broad applicability and robustness of our attack across diverse architectures and modalities. II Background In this section, we present background information on the RGBA video format and the role of the alpha channel. We then describe how such videos are rendered by video playback applications and processed by models. II-A RGBA Video Format and Alpha Channel Digital videos have pixel formats that define the color and transparency information for each frame. Two pixel formats of the RGB color model are RGB and RGBA. The RGB format stores red, green, and blue channels that determine the color of each pixel. In an RGB video, each pixel stores values for these three channels, enabling the rendering of a wide spectrum of colors. RGBA extends this format by adding a fourth channel, the alpha channel. Fig. 1 : An example of alpha channel blending illustrates how the alpha value interacts with the RGB channels and the background color to control pixel transparency and the final color seen in video display applications. The alpha channel represents the transparency level of each pixel and typically ranges from 0 to 255 in 8-bit encoding. A value of 255 indicates full opacity, while a value of 0 denotes complete transparency. Intermediate values result in varying degrees of partial transparency. In this paper, we normalize the alpha channel values to a range between 0 and 1 for consistency in the blending calculations. When an RGBA video is rendered, pixels with alpha values less than 1 reveal the underlying background of the video player, with the RGB values blended as an overlay. The final color of each pixel displayed to viewers is computed through an element-wise alpha compositing operation, combining the original RGB values with the background color of the video player. Formally, for each pixel in the rendered video, the resulting 3-element vector P is calculated as a weighted combination of the pixel’s original RGB values C_{\text{RGB}} and the background color C_{\text{BG}} , using the normalized alpha value \alpha\in[0,1] as the blending factor. The compositing formula is: P=\alpha\cdot{C_{\text{RGB}}}+(1-\alpha)\cdot