Semi-Supervised Masked Autoencoders: Unlocking Vision Transformer Potential with Limited Data
Atik Faysal 1 , Mohammad Rostami 1 , Reihaneh Gh. Roshan 2 , Nikhil Muralidhar 2 and Huaxia Wang 1 · 2026
Read Semi-Supervised Masked Autoencoders: Unlocking Vision Transformer Potential with Limited Data by Atik Faysal 1 , Mohammad Rostami 1 , Reihaneh Gh. Roshan 2 , Nikhil Muralidhar 2 and Huaxia Wang 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20072.txt.
Description
Atik Faysal and colleagues train vision transformers when labelled images are scarce. Vision transformers are powerful but data-hungry. Many real collections have abundant unlabelled images and few labelled ones. The authors propose a semi-supervised masked autoencoder framework for exactly that regime.
Their method, SSMAE, jointly optimises two tasks. Masked image reconstruction learns from all images, labelled or not. Classification learns from the labelled few, aided by pseudo-labels chosen dynamically for the rest. Dynamic selection aims to use only trustworthy guessed labels. Strong performance with little labelling would widen where transformers can be deployed, from medicine to ecology. The work balances self-supervision against label noise. Tags are the scarce thing, not shots. Most frames come with no tag at all. The method learns from both kinds. The scarce tags still guide the whole net. The rest is learned from raw shots with no tags.
Catalog record
| CREATOR | Atik Faysal 1 , Mohammad Rostami 1 , Reihaneh Gh. Roshan 2 , Nikhil Muralidhar 2 and Huaxia Wang 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-20072