REViT: Roto-reflection Equivariant Convolutional Vision Transformer

Sheir A. Zaheer, Alexander C. Holston, Chan Y. Park · 2026

Read REViT: Roto-reflection Equivariant Convolutional Vision Transformer by Sheir A. Zaheer, Alexander C. Holston, Chan Y. Park (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-25318.txt.

Description

A vision model should react in a fixed, known way when an image is turned or flipped. That trait is called equivariance, and transformers make it hard to enforce. Sheir Zaheer, Alexander Holston, and Chan Park propose REViT in 2026. Its attention is built from convolutions set up to respect the group of turns and flips. Feature maps then turn along with the input instead of scrambling, so the sense of which way is up survives each layer.

Tests on image classification compare the design against earlier networks built for the same trait. The authors report that their simpler build beats those past approaches for discrete roto reflection equivariance. They frame it as a practical path for fields like medical scans and robotics. In such fields, which way a structure faces carries real meaning that plain networks must relearn from data each time.

Catalog record

CREATORSheir A. Zaheer, Alexander C. Holston, Chan Y. Park
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.25318

Browse the full library · About the Tower of Babel