Enabling users to work sustainably on shared institute computing resources
Niclas Eich, Johannes Erdmann, Martin Erdmann, Benjamin Fischer, Paul Gilles, Tim Hauptreif, Jan Kelleter · 2026
Read Enabling users to work sustainably on shared institute computing resources by Niclas Eich, Johannes Erdmann, Martin Erdmann, Benjamin Fischer, Paul Gilles, Tim Hauptreif, Jan Kelleter (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22799.txt.
Introduction
Eich and six colleagues describe a user-centered route to greener shared computing at the VISPA physics cluster. The cluster sits in a 1970s building, where hardware upgrades alone would save little energy. Job-level energy tracking, weekly reports, carbon footprints, and scheduling into periods of high renewable power let researchers see and trim their own impact voluntarily. Memory records from earlier runs curb oversized requests, and simulations test how far awareness and choice can cut emissions over time.
Catalog record
| CREATOR | Niclas Eich, Johannes Erdmann, Martin Erdmann, Benjamin Fischer, Paul Gilles, Tim Hauptreif, Jan Kelleter |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49719 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.22799
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Enabling users to work sustainably on shared institute computing resources Niclas Eich, Johannes Erdmann, Martin Erdmann, Benjamin Fischer, Paul Gilles, Tim Hauptreif, Jan Kelleter Abstract The VISPA project is a self-managed, mid-scale computing cluster that supports physics data analysis in research and teaching. Because the cluster is housed in a 1970s institute building with limited retrofit options, conventional efficiency upgrades would yield only minor energy savings. We therefore target sustainability primarily through user-centric measures. A monitoring system now records per-job energy consumption, while real-time data on the renewable share of the German power grid enable ‘green-window’ scheduling. Users can query their individual energy consumption and carbon footprints, receive weekly reports, and tag jobs by project for aggregate accounting; memory records from previous runs help avoid oversubscription. All options are voluntary, fostering a cultural shift rather than imposing hard constraints. A simulation framework evaluates the potential impact of these measures. Together, the technological and behavioral interventions aim at medium- to long-term reductions in greenhouse-gas emissions by increasing resource awareness within the scientific community. keywords Sustainability, Scientific Computing 1 Introduction The VISPA project is a prototype mid-sized institute computing cluster designed to meet local physics-data analysis needs in both research and teaching 23 . Operated in a self-managed fashion, the VISPA cluster offers young researchers a broad playground for experimenting with new structures and ideas in shared computing. Numerous technological developments have been successfully implemented over the past 15 years and published. Three milestones attracted particular attention: first, a web-based user interface developed since 2010 that lets users obtain a desktop-like programming environment and computing resources with minimal effort 5 ; 4 ; 9 ; 22 ; 11 , second the 2016 early deployment of 20 GPUs dedicated to spread knowledge on training deep neural networks 10 , and third fast plotting of terabytes of data using a caching system with SSD hard disks, which was developed in 2021 8 . The VISPA project currently lists roughly 3,000 registered users, although only a small fraction makes continuous use of the cluster. The user base consists of roughly 50 to 100 students who, during the semester, tackle numerical homework aligned with their courses – ranging from short analyses of lab data to neural-network training – as well as about 15 research-group members who access VISPA’s compute power directly for their scientific projects. Job orchestration is handled by the HTCondor batch system 21 . Following a 2023 workshop on sustainability in the digital transformation of research on matter and the universe 6 , the question of sustainability in VISPA’s operation received serious attention for the first time. Two main topics were discussed as the workshop: (1) technological advances for optimizing energy use, both in terms of compute performance and heat recovery, and (2) a cultural shift among scientists toward ensuring that the resources consumed in a physics data analysis remain in reasonable proportion to the expected scientific gain. We would like to note here that high-performance data centers have been addressing similar issues for over 10 years and that there are numerous publications providing guidance on more sustainable computing. As an example from these publications, we mention the temporal coupling of compute jobs to the price of electricity 24 ; 15 . As an example from physics, we note the effort of the Know your footprint initiative, which enables an interactive estimation of greenhouse-gas emissions based on the activities of particle physicists 16 . Unlike modern high-performance data centers -- many of which achieve outstanding PUE 1 1 1 PUE: Power Usage Effectiveness ratings – the VISPA cluster resides in a building dating back to the 1970s, whose cooling system serves several other computing systems and for which the energy consumption could not be influenced or even determined. Such technological constraints leave very limited room for constructional efficiency upgrades, a situation typical for in-house departmental clusters. A major difference to a data center is that VISPA is not required to run at full load continuously. High demand occurs only intermittently, which provides flexibility in job scheduling. Given these conditions, our primary opportunity for improving VISPA’s sustainability lies in fostering a cultural shift. We focus on ways to support the user community – via technical features – in increasing their awareness of resource usage and its balance against scientific benefit. Simultaneously, as cluster admins, we are committed to running the system on renewable energy wherever possible, thereby setting a positive example. Our overarching goal is a medium- to long-term reduction in greenhouse-gas emissions, achieved indirectly by raising awareness among our users. This paper presents concrete improvement measures. First, we deployed an additional energy-monitoring setup. Power consumption reported by individual cluster components via on-board sensors is cross-checked by energy-metering power strips. We use these data to estimate the energy footprint of individual compute jobs. In addition, we query the Fraunhofer Institute for Solar Energy Systems ISE (Freiburg, Germany) for real-time and forecasted shares of renewables in the German power grid. The institute supplies a ‘traffic-light’ indicator: green for a high share of renewable energy, yellow for a medium share, and red for predominantly fossil-based generation 2 . We intend to provide equivalent local-grid information once it becomes available. Several new features specifically target user awareness. All are opt-in; none are enforced. Users can: • Query their own energy consumption on the VISPA cluster for any time span; • Choose sustainability options at job submission: run immediately, or defer execution until the share of renewables is high; • Assign each job to a project category, allowing aggregate energy accounting at the project level; • Display maximum memory usage in previously submitted jobs to support how much memory to request and hence ensure optimal sharing with other computing jobs. Regarding the last point, users must specify an estimated memory requirement during job submission to enable efficient resource allocation, allowing multiple jobs to share a node and run in parallel when the combined memory usage fits within the node’s capacity. The request must exceed actual usage, yet should not reserve excessive capacity at the expense of other jobs. Since many submissions are repetitions with minor changes, VISPA displays memory usage for similar past jobs, helping users pick a realistic value. To assess the impact of all measures, we have built a flexible simulation framework. The following sections describe the VISPA compute cluster in detail and outline the technological developments that enable its more sustainable usage. 2 VISPA computing cluster The VISPA project’s resources include a range of services, including a central access point (portal), 13 worker nodes with various computing power and memory capacity (CPUs and GPUs), storage management, and network functionalities ( Figure 1 ). A rather recent extensive description can be found in reference 8 . The first step toward a more sustainable operation of the VISPA cluster was the implementation of an energy consumption monitoring system. For this purpose, we use metered power distribution units 2 2 2 PDU: metered power distribution unit (PDUs) that provide real-time measurements of power, voltage and current of nearly all components. Due to the limited number of power ratings, monitoring was restricted to 12 out of the 13 worker nodes where one node classified as worker-medium was excluded (Figure 1