Numerical Instability and Chaos: Quantifying the Unpredictability of Large Language Models

Chashi Mahiul Islam 1 , Alan Villarreal 1 , Mao Nishino 2 , Shaeke Salman 1 , Xiuwen Liu 1 · 2026

Read Numerical Instability and Chaos: Quantifying the Unpredictability of Large Language Models by Chashi Mahiul Islam 1 , Alan Villarreal 1 , Mao Nishino 2 , Shaeke Salman 1 , Xiuwen Liu 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-13206.txt.

Introduction

Islam, Villarreal, Nishino, Salman, and Liu trace language-model surprises to finite floating-point rounding, tracking how rounding errors move through Transformer layers. They identify a chaotic avalanche effect in early layers, where tiny perturbations either amplify rapidly or vanish entirely. Beyond single errors, models show three scale-dependent regimes: stable, where small perturbations die out; chaotic, where rounding errors drive outputs apart; and signal-dominated, where true input variation overrides numerical noise.

Catalog record

CREATORChashi Mahiul Islam 1 , Alan Villarreal 1 , Mao Nishino 2 , Shaeke Salman 1 , Xiuwen Liu 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32862
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.13206

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Numerical Instability and Chaos: Quantifying the Unpredictability of Large Language Models Chashi Mahiul Islam 1 , Alan Villarreal 1 , Mao Nishino 2 , Shaeke Salman 1 , Xiuwen Liu 1 Abstract As Large Language Models (LLMs) are increasingly integrated into agentic workflows, their unpredictability stemming from numerical instability has emerged as a critical reliability issue. While recent studies have demonstrated the significant downstream effects of these instabilities, the root causes and underlying mechanisms remain poorly understood. In this paper, we present a rigorous analysis of how unpredictability is rooted in the finite numerical precision of floating-point representations, tracking how rounding errors propagate, amplify, or dissipate through Transformer computation layers. Specifically, we identify a chaotic “avalanche effect” in the early layers, where minor perturbations trigger binary outcomes: either rapid amplification or complete attenuation. Beyond specific error instances, we demonstrate that LLMs exhibit universal, scale-dependent chaotic behaviors characterized by three distinct regimes: 1) a stable regime, where perturbations fall below an input-dependent threshold and vanish, resulting in constant outputs; 2) a chaotic regime, where rounding errors dominate and drive output divergence; and 3) a signal-dominated regime, where true input variations override numerical noise. We validate these findings extensively across multiple datasets and model architectures. I Introduction The deployment of Large Language Models (LLMs) has rapidly evolved from isolated inference systems to complex, distributed multi-agent architectures where multiple AI agents collaborate to solve sophisticated tasks [ 26 , 28 ] . Multi-agent LLM systems improve performance through collaborative problem-solving [ 1 , 27 ] , but they exhibit high failure rates that cannot be attributed solely to algorithmic limitations. Wu et al. [ 27 ] report that AutoGen-based workflows fail to converge on 23% of collaborative tasks, with agents producing contradictory outputs despite identical prompts. Similarly, Hong et al. [ 11 ] document non-reproducible outputs in 31% of MetaGPT planning tasks across identical hardware configurations. These failures share a common signature: unpredictability that persists even with fixed random seeds, manifesting most severely when agents exchange intermediate representations. We hypothesize that a significant fraction of these multi-agent failures stem from numerical instability induced by floating-point computation across heterogeneous infrastructure. In modern LLM deployments, floating-point arithmetic is neither associative nor deterministic across diverse hardware [ 6 ] . When agents communicate by exchanging embeddings across cloud environments with diverse GPU architectures, numerical discrepancies arise from non-deterministic parallel reduction orders [ 2 ] , hardware-specific implementations [ 17 ] , and accumulation of rounding errors through deep network layers. The Oak Ridge National Laboratory documents that “the variability from non-deterministic reductions will produce unique and non-reproducible results with each run using identical inputs” [ 20 ] . Zhuang et al. [ 31 ] demonstrate that GPU-based training produces non-reproducible results in 100% of trials across different hardware. This impact is amplified by the extreme sensitivity of LLMs. Hahn [ 8 ] proves that self-attention mechanisms have condition numbers that grow exponentially with sequence length. Kim et al. [ 13 ] demonstrate empirically that LLMs are “extremely sensitive to assigned prompts,” with 13.78% of correct answers becoming incorrect solely due to minor prompt perturbations. This sensitivity extends to embeddings: Vijayaraj [ 24 ] shows that perturbations of magnitude 10^{-3} in normalized embedding space cause diagnostic prediction flips in 12.4% of clinical cases. Prior work has documented numerical instability in deep learning, and multi-agent system fragility [ 20 , 31 , 27 , 7 ] , but a gap remains: we lack a principled understanding of how floating-point rounding errors interact with LLM computation to produce unpredictable outputs . Existing work treats numerical instability as an engineering nuisance to be mitigated through deterministic execution modes [ 18 ] or higher precision arithmetic, without characterizing the underlying dynamics. This paper addresses this gap through rigorous analysis of numerical stability in LLM inference. Our contributions are: 1. Identification of Chaotic Dynamics. We demonstrate that LLMs exhibit chaotic behavior where perturbations at the scale of floating-point epsilon ( \sim 10^{-14} ) either amplify exponentially or attenuate completely within early Transformer layers, with directional absolute condition numbers exceeding 10^{6} . 2. Characterization of Three Stability Regimes. We identify three distinct operating regimes: Constant Regions where output is bitwise-constant; Chaotic Regions with extreme sensitivity; and Signal-Dominated Regions where input variations override numerical noise. 3. Empirical Validation. We validate findings across multiple combinations of settings, including architectures (Llama-3.1-8B, GPT-OSS-20B), datasets (TruthfulQA, AdvBench), and floating-point precision (BFloat16, FP32, and FP64), demonstrating universal phenomena rather than model-specific artifacts. As LLMs are integrated into safety-critical applications [ 21 , 27 ] , understanding boundaries between reliable and chaotic operation becomes essential. Our characterization provides practitioners with principled guidance for building robust multi-agent systems. II Related Work II-A Numerical Stability in Deep Learning Goldberg [ 6 ] established that floating-point operations are neither associative nor commutative, while Demmel and Nguyen [ 2 ] proved parallel reductions are inherently non-deterministic. Recent work documented these issues in deep learning: Zhuang et al. [ 31 ] showed non-reproducible results across identical seeds, Nagarajan et al. [ 15 ] quantified 40%+ variance in deep RL, and Shanmugavelu et al. [ 20 ] demonstrated non-deterministic weight evolution. Yuan et al. [ 30 ] systematically characterized numerical sources of nondeterminism in LLM inference and proposed mitigation strategies. While quantization studies [ 3 , 5 , 29 ] extensively analyzed reduced-precision arithmetic, we examine inherent instability at full Float32 precision . II-B Sensitivity and Chaos in Neural Networks Hahn [ 8 ] proved Transformer condition numbers grow exponentially with sequence length. Recent work explored chaos in neural networks: Liu et al. [ 14 ] deliberately exploited chaotic dynamics for improved performance, Terada and Toyoizumi [ 22 ] showed chaos facilitates Bayesian sampling in RNNs, and Engelken et al. [ 4 ] computed Lyapunov spectra for recurrent networks. However, these focus on beneficial chaos or RNN-specific dynamics, not unintended chaos from floating-point errors in Transformers. For adversarial robustness, Wallace et al. [ 25 ] discovered universal triggers and Zou et al. [ 32 ] achieved 80%+ jailbreak rates, but these involve semantic-level perturbations rather than numerical instabilities. II-C LLM Robustness and Multi-Agent Systems Kim et al. [ 13 ] showed 13.78% of correct answers flip due to persona changes, while Vijayaraj [ 24 ] found 10^{-3} magnitude perturbations cause 12.4% diagnostic flips. Tuck et al. [ 23 ] measured embedding sensitivity for adversarial detection, but focused on semantic perturbations. In multi-agent systems, Wu et al. [ 27 ] reported 23% AutoGen failure rates and Hong et al. [ 11 ] documented 31% non-reproducible MetaGPT outputs. Guo et al. [ 7 ] identified brittle communication behaviors but attributed failures to algorithmic factors rather than numerical instability. Unlike quantization studies that examine reduced precision [ 3 , 5 ] or work deliberately exploiting chaos [ 22 , 14 ] , we characterize unintended chaotic behaviors from floating-point rounding at Float32 . While prior sensitivity analyses [ 8 , 23 ] focus on theoretical bounds or semantic perturbations, and Yuan et al. [ 30 ] address determinism in inference pipelines, we provide the first systematic layer-wise analysis showing machine-epsilon perturbations ( \sim 10^{-14} ) either amplify to around 10^{-6}\times or vanish, defining three operating regimes (Constant, Chaotic, Signal-Dominated)

Read the complete text