Beyond ZOH: Advanced Discretization Strategies for Vision Mamba

Fady Ibrahim, Guangjun Liu, Guanghui Wang · 2026

Read Beyond ZOH: Advanced Discretization Strategies for Vision Mamba by Fady Ibrahim, Guangjun Liu, Guanghui Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-20606.txt.

Introduction

Ibrahim, Liu, and Wang compare six discretization schemes inside Vision Mamba, a state space model that uses zero-order hold, treating inputs as constant between samples, which weakens temporal fidelity in dynamic settings. The schemes are ZOH, FOH, BIL, POL, HOH, and RK4. Across classification, segmentation, and detection, polynomial interpolation and higher-order hold gain most accuracy at higher cost. Bilinear gives gains over zero-order hold with extra overhead, the best trade-off, and the authors recommend it as the baseline for state space vision models.

Catalog record

CREATORFady Ibrahim, Guangjun Liu, Guanghui Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34029
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.20606

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Beyond ZOH: Advanced Discretization Strategies for Vision Mamba Fady Ibrahim, Guangjun Liu, Guanghui Wang Abstract Vision Mamba, as a state space model (SSM), employs a zero-order hold (ZOH) discretization, which assumes that input signals remain constant between sampling instants. This assumption degrades temporal fidelity in dynamic visual environments and constrains the attainable accuracy of modern SSM-based vision models. In this paper, we present a systematic and controlled comparison of six discretization schemes instantiated within the Vision Mamba framework: ZOH, first-order hold (FOH), bilinear/Tustin transform (BIL), polynomial interpolation (POL), higher-order hold (HOH), and the fourth-order Runge–Kutta method (RK4). We evaluate each method on standard visual benchmarks to quantify its influence in image classification, semantic segmentation, and object detection. Our results demonstrate that POL and HOH yield the largest gains in accuracy at the cost of higher training-time computation. In contrast, the BIL provides consistent improvements over ZOH with modest additional overhead, offering the most favorable trade-off between precision and efficiency. These findings elucidate the pivotal role of discretization in SSM-based vision architectures and furnish empirically grounded justification for adopting BIL as the default discretization baseline for state-of-the-art SSM models. 1 Introduction State Space Models (SSMs), such as Vision Mamba (ViM), have received significant attention in recent years [ 11 ] [ 18 ] . ViM presents a promising alternative to Vision Transformers (ViTs), which leverage their ability to capture complex dependencies, but at a quadratic rate of calculations due to their attention mechanisms [ 10 ] [ 14 ] [ 31 ] . SSMs have near-linear scalability in sequence length and hardware-efficient processing [ 11 ] . Mamba has recently been adapted to computer vision tasks; ViM [ 33 ] , Vmamba [ 18 ] , and VideoMamba [ 16 ] demonstrate Mamba’s ability to handle long-range dependencies while addressing the computational and memory bottlenecks faced by Transformer-based models in the visual domain. Despite their efficiency, Mamba models used for vision inherit a limitation from classical control theory, the use of zero-order hold (ZOH) for continuous-to-discrete conversion [ 30 ] . ZOH assumes that input values remain constant between samples—an assumption that oversimplifies visual data, where spatial signals exhibit continuous variation, sharp edges, textures, and structured frequency content. While ZOH simplifies implementation and guarantees stability, it introduces discretization lag and truncation errors that accumulate across long sequences of image patches or tokens. To address these limitations, this work systematically investigates a controlled and hardware-aware study of advanced discretization strategies that better capture continuous dynamics within Mamba-based visual systems. We implement and evaluate six discretization methods within the ViM framework: 1. Zero-Order Hold (ZOH) – The baseline method used in original ViM implementations, serving as a reference point for comparison [ 30 ] . 2. First-Order Hold (FOH) – A linear interpolation method that models smoother transitions between samples [ 30 ] . 3. Bilinear/Tustin Transform (BIL) – A signal processing technique that converts stable analog filters into equivalent digital filters, allowing analog designs to be implemented digitally, preserving stability [ 3 ] [ 21 ] . 4. Polynomial Interpolation (POL) – A higher-order approximation that fits polynomial curves through sample points, improving temporal smoothness [ 7 ] [ 2 ] . 5. Higher-Order Hold (HOH) – An extension of FOH using higher-degree polynomials to better approximate complex temporal variations [ 24 ] . 6. Runge–Kutta 4 (RK4) – A fourth-order integration method providing high-precision discretization for systems with fast-changing dynamics [ 5 ] . By integrating these methods within a unified CUDA-based execution framework that preserves identical memory access patterns, kernel fusion, and scan-based recurrence across methods, we analyze how each affects model accuracy, training stability, and generalization across benchmark datasets such as ImageNet-1k [ 9 ] , Cifar100 [ 15 ] , ADE20K [ 32 ] , and MS COCO [ 17 ] . This work establishes a foundational understanding of how numerical methods, often overlooked in architectural design, directly influence the performance and stability of modern state space visual models. This work establishes discretization as a first-class design decision in ViM and provides the first hardware-consistent benchmark of numerical integration methods for state-space vision models. Although the work in this paper is based on ViM, the proposed discretization methods can be directly applied to other SSMs as well. The contributions of this paper are threefold: 1. Identifying the limitations introduced by ZOH in current ViM and formally characterizing its impact on visual modeling. 2. Implementing and evaluating five advanced discretization strategies (six including ZOH) within the ViM framework across large-scale classification, segmentation, and detection benchmarks. 3. Demonstrating that while POL and HOH methods yield the highest accuracy, BIL provides a balanced improvement in precision and efficiency. 2 Related Work In foundational SSM frameworks, the conversion from continuous to discrete time uses a fixed discretization rule. This ensures that the model can handle continuous input x(t) by propagating information through hidden states h(t) . Modern SSM architectures, such as Vision Mamba (ViM) [ 33 ] , VMamba [ 18 ] , and its derivatives [ 13 ] [ 28 ] [ 27 ] [ 29 ] operate using this structured fixed discretization step. The fundamental SSM layer introduced in [ 23 ] relies on this continuous-to-discrete system translation. The original Mamba research [ 11 ] , while focusing on content-dependent selection, maintains that SSMs were originally defined as discretizations of continuous systems. The standard and most commonly cited discretization technique across modern SSM architectures is the ZOH method. The ZOH method is predicated on the assumption that the input remains constant over a given time interval \Delta . This method transforms the continuous system parameters, such as the evolution matrix \boldsymbol{A} and input matrix \boldsymbol{B} , into their discrete counterparts. ZOH discretization is utilized implicitly in many prominent SSM models and extensions, including Mamba [ 11 ] , Structured State Space Sequence (S4) models [ 29 ] [ 27 ] , VMamba [ 18 ] , and VideoMamba [ 16 ] . The general framework of State Space Models allows for various discretization methods. One line of work explored simplifying the complexity of state matrices themselves, while later research focused on integrating an alternative discretization method beyond ZOH to enhance model expressivity [ 1 ] [ 22 ] . This is similar in concept to BIL (Tustin’s method) [ 21 ] : • Real Valued Simplification [ 23 ] : The Mega model, a derivative of S4, represented the discretization of continuous system parameters as an Exponential Moving Average (EMA) term, which led to a simplification of the SSM model that only focused on real-valued parameters, reducing computational cost. • Trapezoidal Discretization (Mamba-3) [ 1 ] : The work experimented with the use of trapezoidal discretization (trapezoidal/Euler’s rule) [ 22 ] as an improvement to the core SSM components within Mamba for large language modeling. The complex valued SSMs, when discretized using the general trapezoidal rule, yielded an equivalent real valued SSM equipped with data-dependent Rotary Positional Embeddings (RoPE) [ 12 ] [ 20 ] . The successful application of this method resulted in precise algorithmic reasoning, with which previous SSM variants struggled. [ 1 ] . In summary, prior work on state space models for vision has largely treated

Read the complete text