ReGLA: Efficient Receptive-Field Modeling with Gated Linear Attention Network
Junzhou Li, Manqi Zhao, Yilin Gao, Zhiheng Yu, Yin Li, Dongsheng Jiang, Li Xiao · 2026
Read ReGLA: Efficient Receptive-Field Modeling with Gated Linear Attention Network by Junzhou Li, Manqi Zhao, Yilin Gao, Zhiheng Yu, Yin Li, Dongsheng Jiang, Li Xiao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05262.txt.
Description
Phone and camera vision models need speed on high-resolution images, where transformers often run too slowly. Junzhou Li and 6 co-authors present ReGLA in this 2026 computer vision paper, a family of light hybrid networks. Convolutions cover local features with little cost, while gated linear attention covers the whole picture at linear cost.
The design rests on three parts: a module holding a large receptive field without heavy convolution. A ReLU-based gated attention block boosts local representation, and a multi-teacher distillation strategy raises downstream performance. The mid-sized model hit about 81 percent top-1 accuracy on ImageNet at small input size, running in about five milliseconds at higher resolution. Against rivals of similar size it gained roughly three points on object detection and three and a half on semantic segmentation, making it a strong choice for high-resolution edge vision.
Catalog record
| CREATOR | Junzhou Li, Manqi Zhao, Yilin Gao, Zhiheng Yu, Yin Li, Dongsheng Jiang, Li Xiao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-05262