Analysis of LLM Vulnerability to GPU Soft Errors: An Instruction-Level Fault Injection Study
Duo Chai, Zizhen Liu, Shuhuai Wang, Songwei Pei, Cheng Liu · 2026
Read Analysis of LLM Vulnerability to GPU Soft Errors: An Instruction-Level Fault Injection Study by Duo Chai, Zizhen Liu, Shuhuai Wang, Songwei Pei, Cheng Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19912.txt.
Description
Duo Chai and four colleagues test how fragile language models are to hardware faults. Language models demand heavy computation and memory from modern graphics processors. Shrinking transistors and lower voltages make those processors more prone to soft errors, random bit flips from radiation or noise. A single flipped bit can corrupt a model's output silently.
The team runs an instruction-level fault injection study on graphics processors. They flip bits at chosen points and watch how model behaviour changes. The study maps which instructions and layers are most vulnerable. Knowing the weak points guides protections, from checksums to selective hardening. As models enter safety-critical roles, such resilience data becomes essential.
Catalog record
| CREATOR | Duo Chai, Zizhen Liu, Shuhuai Wang, Songwei Pei, Cheng Liu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-19912