Induced Numerical Instability: Hidden Costs in Multimodal Large Language Models
Wai Tuck Wong, Jun Sun, Arunesh Sinha · 2026
Read Induced Numerical Instability: Hidden Costs in Multimodal Large Language Models by Wai Tuck Wong, Jun Sun, Arunesh Sinha (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-04453.txt.
Introduction
Wong and colleagues expose a new failure mode in multimodal language models: induced numerical instability. They optimize a loss that maximizes instability at inference, then build images that degrade model output sharply. Tests on leading vision language models across Flickr30k, MMVet, TextVQA, VQAv2, POPE, and COCO show large drops even from tiny input changes. The attack differs from standard adversarial perturbations, since harm arrives indirectly through numerical instability rather than direct output manipulation. The work highlights a failure vector that current robustness thinking misses.
Catalog record
| CREATOR | Wai Tuck Wong, Jun Sun, Arunesh Sinha |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59789 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.04453
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Induced Numerical Instability: Hidden Costs in Multimodal Large Language Models Wai Tuck Wong, Jun Sun, Arunesh Sinha Abstract The use of multimodal large language models has become widespread, and as such the study of these models and their failure points has become of utmost importance. We study a novel mode of failure that causes degradation in performance indirectly by optimizing a loss term that seeks to maximize numerical instability in the inference stage of these models. We apply this loss term as the optimization target to construct images that, when used on multimodal large language models, cause significant degradation in the output. We validate our hypothesis on state of the art models large vision language models (LLaVa-v1.5-7B, Idefics3-8B, SmolVLM-2B-Instruct) against standard datasets (Flickr30k, MMVet, TextVQA, VQAv2, POPE, COCO) and show that performance degrades significantly, even with a very small change to the input image, compared to baselines. Our results uncover a fundamentally different vector of performance degradation, highlighting a failure mode not captured by adversarial perturbations. 1 Introduction Large language models (LLMs) have seen widespread deployment in recent years in many practical domains, from interfacing with customers through chatbots ( 1 ) , solving problems in healthcare ( 3 ) , to improving productivity in software engineering ( 30 ; 24 ) . These large language models are further equipped with tools (connected via the Model Context Protocol) to allow them to carry out tasks in the real world ( 20 ) , allowing them to solve problems end-to-end completely autonomously as agents ( 27 ) , often carrying out sensitive and critical tasks in the real world, such as governance in mission-critical systems ( 7 ) . As their name suggests, LLMs rely on storing and loading a large number of parameters in memory on the order of billions to hundreds of billions ( 34 ) . This is often computationally and memory intensive ( 21 ) . Using the standard float precision and without further optimizations, standard consumer GPUs can only store a model with about 6 billion parameters in memory (at 4 bytes per parameter, assuming 24GiB of VRAM). An optimization utilized in these models is to work with half precision , at 2 bytes per parameter, effectively reducing the VRAM requirements by half. Further motivating this is the fact that computation is often much faster, as it can exploit hardware with SIMD (Single Instruction, Multiple Data) capabilities, which can process twice as many numbers simultaneously when using half-precision, leading to higher throughput ( 23 ) . This leads us to our first notion of instability. When a real number cannot be represented exactly in floating-point, it is rounded to the nearest representable value. At the implementation level , this means that the data type of the tensors results in rounding errors as operations are performed with finite precision, contributing to errors in the final output. Although the imprecision brought about by this optimization is often tolerable, this imprecision can, in fact, cause unintended behavior in the underlying systems. We motivate this example with a simple multilayer perceptron (MLP) y=Wx+c . Indeed, even for such a simple MLP, when we observe the simple primitive operations of addition and multiplication (Fig. 1 ) of half-precision numbers, these operations can lead to imprecision in the output. Our second notion of instability comes at the function level , where small changes in the input to the model can have large changes in the output. These errors are inherent within the parameters of the trained model and the operations in the model itself and, more importantly, cannot be solved by increasing the precision of the underlying data types (see the example in Fig. 2 ). We note that these errors constitute a distinct class of performance degradation and are different from adversarial perturbations, where in traditional adversarial attacks, we seek to maximize the loss of a model directly, whereas the approach of targeting numerical instability maximizes the magnitude change in output of a model. This effect is further exacerbated in multimodal large language models, such as large vision language models (LVLMs), where the visual input (an image) is typically projected into a latent space that is compatible with the text transformer. These soft embeddings are continuous in nature and can be sensitive to numerical perturbations, hence small changes in the image input may lead to unexpected errors downstream. In this work, we leverage this insight and evaluate how numerical instability can affect performance of LVLMs. Specifically, we construct a method that induces numerical instability caused at both the implementation and functional level just from the input by modifying the image used in a text and image prompt when used for inference in a LVLM. We propose a novel computationally efficient loss function that serves as a proxy to the actual numerical instability, and optimize it via a whitebox, gradient-based approach. We show that the numerical imprecision caused by this modification causes significant degradation in performance in a wide range of tasks, specifically on standard image captioning and visual question and answer (VQA) datasets, in a manner that is different from traditional adversarial perturbations. Figure 1 : We sample 300 input pairs, drawn uniformly from logarithmic space for multiplication and from linear space for addition, respectively, starting from the minimum and to the maximum positive values of a half-precision ( \mathrm{float16} ) number. We compare the absolute differences when we perform operations with both full and half precision as the data type We see that numerical imprecision generally increases as values increase for multiplication, meaning larger inputs values yield more numerical errors. Figure 2 : A two-layer \tanh network illustrating how a small input perturbation \delta produces amplified change at the output due to asymmetric activation saturation. When x_{1}=x_{2}=0 and x_{2} is perturbed slightly by \delta , the output becomes y=-2\tanh(4\delta) . In this example the output around this region is around 8x the initial magnitude of the input perturbation, demonstrating local sensitivity at that region that is inherent within the network that cannot be resolved by increasing floating point precision. 2 Related Work 2.1 On Robustness in LVLMs Recent studies have explored the robustness of LVLMs, inspired by their leading performance on visual question answering tasks ( 18 ) . Current evaluations for robustness of LVLMs show that even simple Gaussian noise patches ( 33 ) can cause degraded performance in LVLMs, and other more advanced methods of evaluation of robustness are derived from techniques used in adversarial attacks on machine learning models ( 8 ) which looks at maximizing the classification or task-based loss for a perturbed input. The techniques used for white-box attacks vary and include gradient-based attacks on the visual encoder portion of the LVLM ( 22 ) and gradient-based approaches using APGD ( 5 ; 6 ) . Our evaluation here is orthogonal to the attack techniques in literature; in particular, while these approaches aim to adversarially target the performance on a specific task (classification loss as an example), our goal is not task based, but inherent within the system itself, resulting in vastly different perturbations meant to induce numerical errors to affect task performance generically (see Fig. 3 ). Lipschitz-constrained networks have been explored in adversarial