ReGLA: Efficient Receptive-Field Modeling with Gated Linear Attention Network

Junzhou Li, Manqi Zhao, Yilin Gao, Zhiheng Yu, Yin Li, Dongsheng Jiang, Li Xiao · 2026

Read ReGLA: Efficient Receptive-Field Modeling with Gated Linear Attention Network by Junzhou Li, Manqi Zhao, Yilin Gao, Zhiheng Yu, Yin Li, Dongsheng Jiang, Li Xiao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05262.txt.

Description

Phone and camera vision models need speed on high-resolution images, where transformers often run too slowly. Junzhou Li and 6 co-authors present ReGLA in this 2026 computer vision paper, a family of light hybrid networks. Convolutions cover local features with little cost, while gated linear attention covers the whole picture at linear cost.

The design rests on three parts: a module holding a large receptive field without heavy convolution. A ReLU-based gated attention block boosts local representation, and a multi-teacher distillation strategy raises downstream performance. The mid-sized model hit about 81 percent top-1 accuracy on ImageNet at small input size, running in about five milliseconds at higher resolution. Against rivals of similar size it gained roughly three points on object detection and three and a half on semantic segmentation, making it a strong choice for high-resolution edge vision.

Catalog record

CREATORJunzhou Li, Manqi Zhao, Yilin Gao, Zhiheng Yu, Yin Li, Dongsheng Jiang, Li Xiao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-05262

Browse the full library · About the Tower of Babel