Improving Adversarial Robustness via Activation Amplification and Attenuation
Taïga GONÇALVES, Yongsong HUANG, Tomo MIYAZAKI, Shinichiro OMACHI · 2026
Read Improving Adversarial Robustness via Activation Amplification and Attenuation by Taïga GONÇALVES, Yongsong HUANG, Tomo MIYAZAKI, Shinichiro OMACHI (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-27784.txt.
Description
Adversarial attacks fool neural networks through non-robust features. Earlier defences prune, mask, or recalibrate those features. Taïga Gonçalves and three colleagues take a different route in 2026. Their plug-in module, A3, learns to scale activation signals up or down. The scaling needs few added parameters. It can be inserted into networks with minimal changes.
A learnable mask and a factor read from the signals themselves set each scale. Flipping one sign switches between the two modes. In the up mode, signals are amplified. In the down mode, they are attenuated. The amplified outputs serve as negative references for new contrastive and ranking losses. Experiments expose a useful coupling. Training the model to fail on amplified signals makes it more robust on attenuated ones. Across backbones, datasets, and training methods, robustness improved consistently. Added compute and memory costs stayed negligible next to rival plug-in defences.
Catalog record
| CREATOR | Taïga GONÇALVES, Yongsong HUANG, Tomo MIYAZAKI, Shinichiro OMACHI |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.27784