Octopus : Enhancing the Spatial-Awareness of Vision SSMs with Multi-Dimensional Scans and Traversal Selection

Kunal Mahatha, Ali Bahri, Pierre Marza, Sahar Dastani, Maria Vakalopoulou, Stergios Christodoulidis, Jose Dolz, Christian Desrosiers, [0.6em] ILLS, LIVIA, ÉTS Montréal, Canada · 2026

Read Octopus : Enhancing the Spatial-Awareness of Vision SSMs with Multi-Dimensional Scans and Traversal Selection by Kunal Mahatha, Ali Bahri, Pierre Marza, Sahar Dastani, Maria Vakalopoulou, Stergios Christodoulidis, Jose Dolz, Christian Desrosiers, [0.6em] ILLS, LIVIA, ÉTS Montréal, Canada (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-00904.txt.

Description

Kunal Mahatha and colleagues introduce OCTOPUS, an architecture keeping global context and local spatial structure in images while keeping linear cost. State space models offer global text links at linear cost, but their causal setup breaks spatial links among pixels or patches in vision. Standard SSMs link distant patches while ignoring correlated neighbors, failing local spatial unity. OCTOPUS performs discrete reoccurrence along eight main ways, forward or backward in horizontal, vertical, and diagonal paths, exchanging signals across connected regions while keeping distant patches apart.

Catalog record

CREATORKunal Mahatha, Ali Bahri, Pierre Marza, Sahar Dastani, Maria Vakalopoulou, Stergios Christodoulidis, Jose Dolz, Christian Desrosiers, [0.6em] ILLS, LIVIA, ÉTS Montréal, Canada
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47277
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.00904

Browse the full library · About the Tower of Babel