A Systematic Evaluation of Environmental Flakiness in JavaScript Tests
Negar Hashemi 1 , Amjed Tahir 1 , August Shi 2 , Shawn Rasheed 3 , Rachel Blagojevic 1 · 2026
Read A Systematic Evaluation of Environmental Flakiness in JavaScript Tests by Negar Hashemi 1 , Amjed Tahir 1 , August Shi 2 , Shawn Rasheed 3 , Rachel Blagojevic 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-19098.txt.
Description
Flaky tests waste time, and environment changes are a neglected cause. Negar Hashemi, with four co-authors, systematically evaluates that cause in 2026 for JavaScript. Test suites ran across varied environments. Three factors were manipulated. Operating system, Node.js version, and browser each got tested.
Over sixty projects showed environmental flakiness. Operating-system issues dominated, with browser and Node.js issues also common. Combined operating-system and Node.js problems formed a further group. To mitigate the problem, the authors built js-env-sanitizer. It skips and reports environmental flaky tests instead of failing them. Continuous-integration builds can then succeed without full reruns. The tool scores high accuracy with minimal overhead. It supports Jest, Mocha, and Vitest.
Catalog record
| CREATOR | Negar Hashemi 1 , Amjed Tahir 1 , August Shi 2 , Shawn Rasheed 3 , Rachel Blagojevic 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-19098