Balancing Accuracy, Calibration, and Efficiency in Active Learning with Vision Transformers Under Label Noise

Moseli Mots’oehli, Hope Mogale, Kyungim Baek · 2025

Read Balancing Accuracy, Calibration, and Efficiency in Active Learning with Vision Transformers Under Label Noise by Moseli Mots’oehli, Hope Mogale, Kyungim Baek (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-04375.txt.

Description

Moseli Mots'oehli and co-authors study how vision transformers fare when labels are noisy and labeling budgets are tight, in a 2025 paper. Active learning picks the most useful images to label next. Real labels, though, often contain errors. Calibration, knowing when a model is unsure, matters as much as raw accuracy. Transformer behavior under these stresses was largely unexplored.

The team tested several transformer sizes and patch settings against Swin variants. Two standard image data sets carried graded levels of symmetric label noise. Accuracy, calibration, and efficiency were tracked together. Results show which configurations bend without breaking. Practitioners with small budgets gain selection guidance. The study also warns where noise quietly ruins confidence estimates.

Catalog record

CREATORMoseli Mots’oehli, Hope Mogale, Kyungim Baek
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-04375

Browse the full library · About the Tower of Babel