Octopus : Enhancing the Spatial-Awareness of Vision SSMs with Multi-Dimensional Scans and Traversal Selection
Kunal Mahatha, Ali Bahri, Pierre Marza, Sahar Dastani, Maria Vakalopoulou, Stergios Christodoulidis, Jose Dolz, Christian Desrosiers, [0.6em] ILLS, LIVIA, ÉTS Montréal, Canada · 2026
Read Octopus : Enhancing the Spatial-Awareness of Vision SSMs with Multi-Dimensional Scans and Traversal Selection by Kunal Mahatha, Ali Bahri, Pierre Marza, Sahar Dastani, Maria Vakalopoulou, Stergios Christodoulidis, Jose Dolz, Christian Desrosiers, [0.6em] ILLS, LIVIA, ÉTS Montréal, Canada (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-00904.txt.
Description
Kunal Mahatha and colleagues introduce OCTOPUS, an architecture keeping global context and local spatial structure in images while keeping linear cost. State space models offer global text links at linear cost, but their causal setup breaks spatial links among pixels or patches in vision. Standard SSMs link distant patches while ignoring correlated neighbors, failing local spatial unity. OCTOPUS performs discrete reoccurrence along eight main ways, forward or backward in horizontal, vertical, and diagonal paths, exchanging signals across connected regions while keeping distant patches apart.
Catalog record
| CREATOR | Kunal Mahatha, Ali Bahri, Pierre Marza, Sahar Dastani, Maria Vakalopoulou, Stergios Christodoulidis, Jose Dolz, Christian Desrosiers, [0.6em] ILLS, LIVIA, ÉTS Montréal, Canada |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47277 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.00904