Sample-aware RandAugment: Search-free Automatic Data Augmentation for Effective Image Recognition Publication type: generic article
Anqi Xiao 1, Weichen Yu 2, Hongyuan Yu 3 ✉ · 2025
Read Sample-aware RandAugment: Search-free Automatic Data Augmentation for Effective Image Recognition Publication type: generic article by Anqi Xiao 1, Weichen Yu 2, Hongyuan Yu 3 ✉ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-08004.txt.
Introduction
A search-free image data booster that fits each sample is built by Anqi Xiao, Weichen Yu, and Hongyuan Yu in a 2025 arXiv paper. Auto boosters tune photo tweaks to make nets learn wider. Old kinds search too long or fit too stiffly. Their SRA scores each training photo's hardness and picks tweaks to match. A lopsided tweak plan makes the score count more.
On ImageNet with a standard net, top score hit a best mark for search-free kinds. Pretrained nets from it also lifted object spotting. No knob tuning was needed to move sets.
Catalog record
| CREATOR | Anqi Xiao 1, Weichen Yu 2, Hongyuan Yu 3 ✉ |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-08004
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Sample-aware RandAugment: Search-free Automatic Data Augmentation for Effective Image Recognition Publication type: generic article Anqi Xiao 1, Weichen Yu 2, Hongyuan Yu 3 ✉ Abstract Automatic data augmentation (AutoDA) plays an important role in enhancing the generalization of neural networks. However, mainstream AutoDA methods often encounter two challenges: either the search process is excessively time-consuming, hindering practical application, or the performance is suboptimal due to insufficient policy adaptation during training. To address these issues, we propose Sample-aware RandAugment (SRA), an asymmetric, search-free AutoDA method that dynamically adjusts augmentation policies while maintaining straightforward implementation. SRA incorporates a heuristic scoring module that evaluates the complexity of the original training data, enabling the application of tailored augmentations for each sample. Additionally, an asymmetric augmentation strategy is employed to maximize the potential of this scoring module. In multiple experimental settings, SRA narrows the performance gap between search-based and search-free AutoDA methods, achieving a state-of-the-art Top-1 accuracy of 78.31% on ImageNet with ResNet-50. Notably, SRA demonstrates good compatibility with existing augmentation pipelines and solid generalization across new tasks, without requiring hyperparameter tuning. The pretrained models leveraging SRA also enhance recognition in downstream object detection tasks. SRA represents a promising step towards simpler, more effective, and practical AutoDA designs applicable to a variety of future tasks. Our code is available at https://github.com/ainieli/Sample-awareRandAugment . ∎ 1 Introduction Automatic data augmentation (AutoDA) is ubiquitous in training methods, capable of autonomously adjusting and exploring optimal augmentation policies tailored to various target tasks ( Cubuk et al. 2019 ) . It enhances the generalization of neural networks for image recognition by filling in the missing data in the target distribution ( Lim et al. 2019 ; Ratner et al. 2017 ) . However, current AutoDA methods typically suffer from excessive search time required prior to application in training ( Cubuk et al. 2019 ; Tian et al. 2020 ; Cubuk et al. 2020 ) , or the implementation of dynamically adjusting policies that come at the expense of significant search overheads ( Zhou et al. 2021 ; Zhang et al. 2019 ; Kuriyama 2023 ) . Additionally, complex optimization strategies present obstacles that hinder widespread adoption and limit the applicability of AutoDA across different tasks ( Li et al. 2020 ; Liu et al. 2021a ; Hounie et al. 2023 ) . An emerging trend in the field of AutoDA is the pursuit of methods that balance simplicity with effectiveness. With the advent of policy transferring strategies ( Cubuk et al. 2019 ; Lim et al. 2019 ) , AutoDA can be applied without notable performance degradation. In addition, substantial reductions in search space also allow manual tuning to avoid time-consuming search from scratch ( Cubuk et al. 2020 ) . These advancements boost the development of search-free AutoDA methods ( Müller and Hutter 2021 ; LingChen et al. 2020 ; Wightman et al. 2021 ) . Search-free augmentation strategies show great potential by generating randomly augmented samples of original images. Nevertheless, their ability to achieve peak performance is often constrained by their inherent simplicity ( Cubuk et al. 2020 ; Müller and Hutter 2021 ) . We identify two primary issues prevalent in current AutoDA methods: 1) For search-based methods, the complicated time-consuming search process sets barriers to broader applications, and 2) For search-free methods, suboptimal performance often results from the deficient flexibility to adapt and adjust the policy dynamically during training. We find that search-free AutoDA methods are favored in practical scenarios (such as the training of new types of architectures) due to their simplicity for adoption, which motivates us to design a flexible, search-free method capable of generating effective input for image recognition without substantially increasing the complexity and cost of the training process. To this end, we develop a search-free, sample-aware AutoDA method named Sample-aware RandAugment (SRA). We hypothesize that the core idea of improving the performance of search-free AutoDA hinges on focusing on samples that are particularly valuable for determining the decision boundaries during training ( Nguyen et al. 2015 ; Du et al. 2024 ) . To achieve this, we propose an asymmetric training strategy that divides the original batch into two sub-batches, applying distinct augmentation policies for exploration and refinement, respectively. During the exploration phase, random augmentation is used to explore the target data distribution and improve the representation ability of the target model. While in the refinement phase, a heuristic module Magnitude Instructor Score (MIS) is proposed to assess the difficulty of each sample in the sub-batch, which enables SRA to generate more hard samples that are crucial for refining the decision boundaries. Both sub-batches are used to update target model weights. The proposed SRA is evaluated on CIFAR ( Krizhevsky et al. 2009 ) and ImageNet ( Russakovsky et al. 2015 ) benchmarks. Experiments on convolutional neural networks (CNN), vision Transformers, and newly rising state space model-based vision Mamba architectures demonstrate that SRA outperforms existing search-free AutoDA methods in diverse settings. Moreover, it achieves competitive or even better performance compared to search-based state-of-the-art methods. Notably, SRA achieves a Top-1 accuracy of 78.31% on ImageNet using ResNet-50, surpassing the search-free state-of-the-art by 0.24% without relying on extensive tricks. Additionally, it is compatible with frameworks such as repeated augmentation ( Hoffer et al. 2020 ) and multi-view contrastive learning ( Kurtuluş et al. 2023 ) . Without requiring any tuning of training hyperparameters, SRA boosts accuracy on both the fine-grained image classification benchmark ( Bossard et al. 2014 ) and the long-tailed image classification benchmark ( Liu et al. 2019 ) . These results highlight that SRA has strong compatibility with existing training pipelines and robust generalization to new tasks. The pretrained model using SRA also performs well in downstream object detection tasks on the COCO dataset ( Lin et al. 2014 ) . As a search-free method, SRA is ready for out-of-the-box applications. The key contributions of this work are summarized as follows: Figure 1: Training pipeline of the proposed Sample-aware RandAugment (SRA). MIS is the proposed scoring module to evaluate the difficulty of samples. • We propose Sample-aware RandAugment (SRA), a search-free, sample-aware automatic data augmentation method that bridges the gap between well-performed yet time-consuming search-based methods and simpler, yet sub-optimal, search-free ones. SRA shows competitive or better performance compared to search-based designs in various settings, showcasing the effectiveness of the proposed search-free design. • We propose a heuristic module, Magnitude Instructor Score (MIS), which dynamically evaluates the difficulty of the original training data to guide SRA in generating hard samples contributing to improved decision boundaries during training. The proposed MIS also provides new insights into sample-awareness in data augmentation, emphasizing how different samples can be prioritized for augmentation. • We present an asymmetric data augmentation strategy that applies two distinct augmentation policies within a single batch, with one focusing on exploring the training data distribution and the other on refining it. This asymmetric approach introduces a novel perspective, suggesting that hybrid data augmentation designs can unlock the full potential of data augmentation in neural network training. 2 Related Work Automatic data augmentation (AutoDA) has emerged as a powerful technique, significantly improving performance in image recognition. It is typically controlled by a set of policy parameters that define the types of