Towards Experiment Execution in Support of Community Benchmark Workflows for HPC CCS: Computing methodologies Distributed computing methodologies CCS: Computing methodologies Distributed algorithms

Gregor von Laszewski, Wesley Brewer, Sean R. Wilkinson, Andrew Shao, J.P. Fleischer, Harshad Pitkar, Christine R. Kirkpatrick, Geoffrey C. Fox · 2025

Read Towards Experiment Execution in Support of Community Benchmark Workflows for HPC CCS: Computing methodologies Distributed computing methodologies CCS: Computing methodologies Distributed algorithms by Gregor von Laszewski, Wesley Brewer, Sean R. Wilkinson, Andrew Shao, J.P. Fleischer, Harshad Pitkar, Christine R. Kirkpatrick, Geoffrey C. Fox (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-22294.txt.

Description

Gregor von Laszewski and co-authors present workflow templates to ease shared benchmark testing on supercomputers in a 2025 paper. Groups need to show what large machines can do, but benchmarks are few and hard to run the same way across sites. Templates that adapt to each task offer a way out.

Drawing on decades of practice, the team list common usage patterns for such templates. They argue that simple tools for managing experiments, inside the wider workflow, boost flexibility, above all in teaching. Two independently built tools with large overlap back the claim. Both were tested on tasks from cloud masking to quake prediction and fluid flow stand-ins. The authors call the craft benchmark carpentry.

Catalog record

CREATORGregor von Laszewski, Wesley Brewer, Sean R. Wilkinson, Andrew Shao, J.P. Fleischer, Harshad Pitkar, Christine R. Kirkpatrick, Geoffrey C. Fox
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE130 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-22294

Browse the full library · About the Tower of Babel