StreamGuard: Low-Overhead Resilience for Real-time HPC Data Streams Conference: 2026 International Conference on Supercomputing; July 06–09, 2026; Belfast, United Kingdom 2026 International Conference on Supercomputing (ICS ’26), July 06–09, 2026, Belfast, United Kingdom DOI: 10.1145/3797905.3807872 ISBN: 979-8-4007-2522-7/2026/07 CCS: Hardware Fault tolerance CCS: Information systems Data streaming CCS: Software and its engineering Checkpoint / restart
Hai Duc Nguyen, Bogdan Nicolae, Tekin Bicer, Amal Gueroudji, Matthieu Dorier, Kyle Chard, Ian Foster · 2026
Read StreamGuard: Low-Overhead Resilience for Real-time HPC Data Streams Conference: 2026 International Conference on Supercomputing; July 06–09, 2026; Belfast, United Kingdom 2026 International Conference on Supercomputing (ICS ’26), July 06–09, 2026, Belfast, United Kingdom DOI: 10.1145/3797905.3807872 ISBN: 979-8-4007-2522-7/2026/07 CCS: Hardware Fault tolerance CCS: Information systems Data streaming CCS: Software and its engineering Checkpoint / restart by Hai Duc Nguyen, Bogdan Nicolae, Tekin Bicer, Amal Gueroudji, Matthieu Dorier, Kyle Chard, Ian Foster (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30848.txt.
Description
Hai Duc Nguyen and six colleagues present StreamGuard, a system that keeps real-time scientific data streams running on failure-prone supercomputers. Such streams feed live results back to running experiments, but hardware faults, network disruptions and slow workers can break their timing. StreamGuard strengthens the producer-consumer pattern, where one stage generates data and the next processes it, with two techniques that work together.
The first is dynamic, asynchronous checkpointing that saves progress without pausing computation. The second watches each worker's progress, spots slow ones and shifts their tasks elsewhere before they fall behind. In experiments, the approach cut the impact of failures and slowdowns by up to 6× while adding less than 1% overhead when nothing went wrong.
Catalog record
| CREATOR | Hai Duc Nguyen, Bogdan Nicolae, Tekin Bicer, Amal Gueroudji, Matthieu Dorier, Kyle Chard, Ian Foster |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.30848