Analysis of LLM Vulnerability to GPU Soft Errors: An Instruction-Level Fault Injection Study

Duo Chai, Zizhen Liu, Shuhuai Wang, Songwei Pei, Cheng Liu · 2026

Read Analysis of LLM Vulnerability to GPU Soft Errors: An Instruction-Level Fault Injection Study by Duo Chai, Zizhen Liu, Shuhuai Wang, Songwei Pei, Cheng Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19912.txt.

Description

Duo Chai and four colleagues test how fragile language models are to hardware faults. Language models demand heavy computation and memory from modern graphics processors. Shrinking transistors and lower voltages make those processors more prone to soft errors, random bit flips from radiation or noise. A single flipped bit can corrupt a model's output silently.

The team runs an instruction-level fault injection study on graphics processors. They flip bits at chosen points and watch how model behaviour changes. The study maps which instructions and layers are most vulnerable. Knowing the weak points guides protections, from checksums to selective hardening. As models enter safety-critical roles, such resilience data becomes essential.

Catalog record

CREATORDuo Chai, Zizhen Liu, Shuhuai Wang, Songwei Pei, Cheng Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-19912

Browse the full library · About the Tower of Babel