Improving Adversarial Robustness via Activation Amplification and Attenuation

Taïga GONÇALVES, Yongsong HUANG, Tomo MIYAZAKI, Shinichiro OMACHI · 2026

Read Improving Adversarial Robustness via Activation Amplification and Attenuation by Taïga GONÇALVES, Yongsong HUANG, Tomo MIYAZAKI, Shinichiro OMACHI (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-27784.txt.

Description

Adversarial attacks fool neural networks through non-robust features. Earlier defences prune, mask, or recalibrate those features. Taïga Gonçalves and three colleagues take a different route in 2026. Their plug-in module, A3, learns to scale activation signals up or down. The scaling needs few added parameters. It can be inserted into networks with minimal changes.

A learnable mask and a factor read from the signals themselves set each scale. Flipping one sign switches between the two modes. In the up mode, signals are amplified. In the down mode, they are attenuated. The amplified outputs serve as negative references for new contrastive and ranking losses. Experiments expose a useful coupling. Training the model to fail on amplified signals makes it more robust on attenuated ones. Across backbones, datasets, and training methods, robustness improved consistently. Added compute and memory costs stayed negligible next to rival plug-in defences.

Catalog record

CREATORTaïga GONÇALVES, Yongsong HUANG, Tomo MIYAZAKI, Shinichiro OMACHI
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.27784

Browse the full library · About the Tower of Babel