Enhancing Energy Efficiency in Scientific Workflows through CFD based PIVAEs
Ali Zahir, Ashiq Anjum, Mark Wilkinson, Jeyan Thiyagalingam · 2026
Read Enhancing Energy Efficiency in Scientific Workflows through CFD based PIVAEs by Ali Zahir, Ashiq Anjum, Mark Wilkinson, Jeyan Thiyagalingam (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-23850.txt.
Introduction
Ali Zahir and colleagues chase energy savings in high performance computing without throttling science. Their AI assisted scheduler pairs fluid flow simulation with a physics informed variational autoencoder. That pairing makes lifelike synthetic workloads linking heat behavior to scheduling choices. Sorting workflows by resource profile, they test locality aware and speculative aware strategies. They find a sweet spot: trimming CPU speed by around fifteen percent yields up to ten percent energy savings. Turnaround grows only about five percent.
Catalog record
| CREATOR | Ali Zahir, Ashiq Anjum, Mark Wilkinson, Jeyan Thiyagalingam |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 77180 |
| LICENSE | http://creativecommons.org/publicdomain/zero/1.0/ |
| RIGHTS | CC0 |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.23850
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Enhancing Energy Efficiency in Scientific Workflows through CFD based PIVAEs Ali Zahir, Ashiq Anjum, Mark Wilkinson, Jeyan Thiyagalingam Abstract The growing complexity and scale of scientific workflows in high performance computing (HPC) environments have led to significant challenges in managing energy consumption without compromising computational performance. Traditional scheduling strategies often fail to account for the complex interplay between thermal dynamics, workload diversity, and system scalability—leading to inefficient and unsustainable energy usage. This paper introduces a novel, scalable, and AI-assisted scheduling framework for optimizing energy consumption in high-performance computing (HPC) environments without compromising performance. Central to our approach is the integration of Computational Fluid Dynamics (CFD) with a Physics-Informed Variational Autoencoder (PIVAE), enabling the generation of physically realistic synthetic workload data that bridges the gap between thermodynamic behavior and scheduler decision-making in complex, multi-scale HPC environments. By categorizing workflows based on resource utilization profiles, we evaluate the impact of multiple scheduling strategies such as Locality Aware and Speculative Aware Scheduling on system performance and energy efficiency.These workflows—ranging from event reconstruction to anomaly detection—represent diverse computational intensities, demonstrating the adaptability of the proposed method across varying scientific domains. Our results show that modest reductions in CPU performance (e.g., to 15%) can yield substantial energy savings (up to 10%) with only minor turnaround time increases (approximately 5–6%), identifying an optimal operational sweet spot. This work demonstrates how physics-informed generative modeling can enable adaptive, sustainable, and data-efficient scheduling decisions for next-generation HPC infrastructures. The proposed methodology offers a scalable path forward for sustainable data processing in modern distributed computing infrastructures. I Introduction LARGE-SCALE distributed computing systems, including high-performance computing (HPC) clusters and cloud platforms, form the backbone of modern scientific discovery in domains such as genomics, climate modeling, and high-energy physics, where complex, multi-stage computational workflows orchestrate data processing, simulation, and analysis tasks. These systems must process petabytes of data under stringent time constraints, while operating within limited power and cooling budgets. Energy inefficiency has therefore emerged as a first-order design constraint: studies estimate that CPU underutilization alone accounts for nearly 32% of the total energy draw in HPC environments [ 20 ] , with additional waste stemming from thermal overheads, repetitive I/O, and imbalanced workload execution. Figure 1 illustrates the distribution of power consumption across typical computing system components, emphasizing the dominant role of CPU and cooling subsystems in overall energy draw. Despite continuous advancements in energy-efficient scheduling, existing approaches remain largely empirical and fail to integrate thermodynamic feedback into decision-making. Our work introduces a physics-informed, AI-driven approach that unifies data generation and scheduling under a single, physically realistic framework—addressing both the scale and sustainability challenges of next-generation HPC systems. As operational costs and carbon footprints escalate, energy-aware scheduling has become critical for both sustainability and performance. Task scheduling plays a pivotal role in determining the trade-offs between turnaround time (TAT) and energy efficiency. Traditional schedulers such as First Come First Serve (FCFS) and Round Robin emphasize fairness and simplicity but do not account for heterogeneous hardware, thermal dynamics, or workload diversity [ 5 ] . More advanced heuristics such as Particle Swarm Optimization (PSO) [ 6 ] or adaptive autoscaling [ 12 , 17 ] have reduced energy costs through consolidation or prediction, yet they often incur high computational complexity and lack adaptability at scale. In contrast, we leverage physics-informed generative modeling to create synthetic, thermodynamically consistent data that empowers AI schedulers to learn optimal energy–performance trade-offs without exhaustive experimentation. Domain-specific strategies, including MapReduce-aware scheduling [ 23 ] , GPU-aware placement using the energy-delay product (EDP) [ 25 ] , and DVFS-based offline scheduling [ 13 ] , demonstrate effectiveness in narrow contexts but fail to generalize across diverse architectures. As HPC infrastructures continue to scale toward exascale and beyond, sustainability becomes a fundamental constraint—both in terms of energy efficiency and cooling overhead. Any viable scheduling approach must therefore operate effectively across large, heterogeneous environments while maintaining thermal and operational stability. Fig. 1: Power consumption of a typical computing system components Despite these advances, three fundamental gaps persist in energy-aware scheduling: 1. Thermal feedback is ignored. Most existing methods model energy consumption only in terms of CPU frequency or utilization, neglecting the role of heat dissipation, airflow, and cooling inefficiencies. In HPC systems, thermal hotspots directly affect processor reliability and power draw, yet scheduling decisions remain thermally blind. 2. Synthetic data lacks physical realism. Generative models such as Variational Autoencoders (VAEs) [ 11 , 16 ] have been applied to overcome data scarcity, but standard VAEs produce synthetic workload traces that violate physical constraints. Without grounding in thermodynamics, these datasets lead to scheduling policies that are infeasible under real-world conditions. 3. Over-specialization to hardware. Several approaches target specific ecosystems e.g., Hadoop clusters [ 23 ] , GPU-centric schedulers [ 25 ] , or CPU-GPU power capping [ 19 ] . While effective within their domains, such methods lack generality and are difficult to extend across heterogeneous infrastructures. These gaps create a misalignment between theoretical scheduling models and practical HPC deployment, limiting the impact of current energy-aware strategies. In particular, the absence of thermodynamically grounded data hinders the design of adaptive schedulers capable of balancing energy efficiency with performance. To address these challenges, we propose a Physics Informed Variational Autoencoder (PIVAE) coupled with Computational Fluid Dynamics (CFD) modeling. CFD provides fine-grained simulations of heat propagation, cooling efficiency, and dynamic power dissipation, while the PIVAE ensures that the synthetic data generated for scheduler training respects thermodynamic constraints. This integration enables the adaptive exploration of operational scenarios that are both statistically valid and physically realistic. We evaluate the CFD-PIVAE system across five representative scientific workflows—Event Reconstruction (WF-1), Particle Trajectory Identification (WF-2), Collision Point Detection (WF-3), Pattern Recognition (WF-4), and Anomaly Detection (WF-5)—using multiple schedulers, including First-Come, First-Served (FCFS), Locality-Aware Scheduling (LAS), LAS with Prefetching (LASP), Speculative-Aware Scheduling (SAS) [ 24 ] , LYNX, and the recent OM-FNN approach. Results show that CFD-PIVAE guided scheduling achieves up to 10% energy savings with only a 5-6% increase in TAT, outperforming conventional methods. Importantly, while LYNX achieves TAT reductions at the cost of higher energy consumption and OM-FNN achieves less energy consumption at the cost of higher TAT, our approach consistently delivers balanced trade-offs. The contributions of this paper are as follows: • A novel CFD-informed PIVAE architecture that generates thermodynamically realistic synthetic datasets for energy-aware scheduling. • A workflow-specific optimization system that balances CPU utilization, memory access, and thermal constraints to reduce energy consumption without degrading Turnaround time. • Empirical validation on a Proxmox-managed HPC cluster, demonstrating scalable energy savings compared with FCFS, LAS, SAS, LYNX, and OM-FNN. The remainder of this paper is organized as follows: Section 2 reviews related work on energy-aware scheduling. Section 3 presents the proposed CFD-PIVAE architecture. Section 4 details the experimental setup and workflow characterization. Section 5 discusses results across multiple schedulers, and Section 6 concludes with future directions. II Literature Review Energy aware scheduling in distributed computing has advanced from early fairness-oriented methods like Round Robin and FCFS [ 5 ] to optimization-driven approaches such as PSO-based virtual machines placement [ 6 ] , which improved energy use but suffered from scalability issues. Machine learning further refined scheduling: Gupta et al. [ 10 ] employed VAEs to model energy patterns,