Hybrid Cloud Architectures for Research Computing: Applications and Use Cases Journal: Journal of Network and Computer Applications

Xaver Stiensmeier, Alexander Kanitz, Jan Krüger, Santiago Insua, Adrián Rošinec, Viktória Spišaková, Lukáš Hejtmánek, David Yuan, Gavin Farrell, Jonathan Tedds, Juha Törnroos, Harald Wagener, Alexander Sczyrba, Nils Hoffmann, Matej Antol · 2026

Read Hybrid Cloud Architectures for Research Computing: Applications and Use Cases Journal: Journal of Network and Computer Applications by Xaver Stiensmeier, Alexander Kanitz, Jan Krüger, Santiago Insua, Adrián Rošinec, Viktória Spišaková, Lukáš Hejtmánek, David Yuan, Gavin Farrell, Jonathan Tedds, Juha Törnroos, Harald Wagener, Alexander Sczyrba, Nils Hoffmann, Matej Antol (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04349.txt.

Introduction

Xaver Stiensmeier and fourteen co-authors survey how research computing is stitching together hybrid clouds in a 2026 arXiv paper. Science now depends on heavy computation, but the machines live in a fragmented landscape of university clusters, national research networks, and commercial clouds, each with its own rules. Hybrid designs promise flexibility, efficiency, and access to special hardware by spanning several of them at once.

The overview walks through deployment models built on grid and cloud platforms and the workflow tools researchers actually use to move jobs between them. Federated computing, multi-cloud orchestration, and scheduling get detailed treatment, alongside the standing headaches of interoperability, data security, reproducibility, and network speed. Drawing on life-science implementations coordinated through the ELIXIR Compute Platform and the wider European Open Science Cloud, the authors close with a roadmap for wider adoption.

Catalog record

CREATORXaver Stiensmeier, Alexander Kanitz, Jan Krüger, Santiago Insua, Adrián Rošinec, Viktória Spišaková, Lukáš Hejtmánek, David Yuan, Gavin Farrell, Jonathan Tedds, Juha Törnroos, Harald Wagener, Alexander Sczyrba, Nils Hoffmann, Matej Antol
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-04349

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Hybrid Cloud Architectures for Research Computing: Applications and Use Cases Journal: Journal of Network and Computer Applications Xaver Stiensmeier, Alexander Kanitz, Jan Krüger, Santiago Insua, Adrián Rošinec, Viktória Spišaková, Lukáš Hejtmánek, David Yuan, Gavin Farrell, Jonathan Tedds, Juha Törnroos, Harald Wagener, Alexander Sczyrba, Nils Hoffmann, Matej Antol Abstract Scientific research increasingly depends on robust and scalable IT infrastructures to support complex computational workflows. With the proliferation of services provided by research infrastructures, NRENs, and commercial cloud providers, researchers must navigate a fragmented ecosystem of computing environments, balancing performance, cost, scalability, and accessibility. Hybrid cloud architectures offer a compelling solution by integrating multiple computing environments to enhance flexibility, resource efficiency, and access to specialised hardware. This paper provides a comprehensive overview of hybrid cloud deployment models, focusing on grid and cloud platforms (OpenPBS, SLURM, OpenStack, Kubernetes) and workflow management tools (Nextflow, Snakemake, CWL). We explore strategies for federated computing, multi-cloud orchestration, and workload scheduling, addressing key challenges such as interoperability, data security, reproducibility, and network performance. Drawing on implementations from life sciences, as coordinated by the ELIXIR Compute Platform and their integration into a wider EOSC context, we propose a roadmap for accelerating hybrid cloud adoption in research computing, emphasising governance frameworks and technical solutions that can drive sustainable and scalable infrastructure development. † † highlights: We identify the challenges of navigating a fragmented ecosystem of computing environments between research infrastructures, NRENs, and commercial clouds, and position hybrid cloud architectures as a solution to balance performance, cost, scalability, and accessibility. We describe deployment models and workflow tools to enable federated computing, multi-cloud orchestration, and workload scheduling, while tackling key challenges like interoperability, security, and reproducibility. We demonstrate practical implementation through functional demonstrators developed within the ELIXIR Compute Platform work program and propose a roadmap for hybrid cloud adoption that prioritizes governance frameworks and sustainable infrastructure development for research. Research communities across different scientific domains require increasingly robust and scalable IT infrastructure to support their projects. These requirements can span from enormous computational and storage capacities to more specialised applications harnessing computing resources such as GPUs. To address such infrastructure requirements, computing resources are continually being built on a national and international level within ESFRI research infrastructures, NRENs and other similar facilities. Additionally, commercial IT service providers have started to offer a broader spectrum of services that provide solutions to support research activities. To maximise these diverse computational infrastructures and optimise their utilisation, researchers and their supporting organisations must continually deploy their computational workflows in the most suitable environments. However, moving between different computing environments instead of staying with one that may be sub-optimal requires extra time and effort as well as technical expertise from researchers to plan and execute such a migration. These challenges can be partially addressed by leveraging hybrid cloud architectures, the concept of seamlessly combining multiple different cloud environments. Such multi-environmental deployment promises to increase scalability, expand available functionality, decrease costs and provide access to special resources such as GPUs. Across research use cases, the most prominent drivers to utilise hybrid cloud architectures are scalability, access to specialised compute resources and increasingly, access to sensitive data [ 16 ] , [ 18 ] , [ 19 ] . In this paper, we provide novel insights on how researchers can harness multiple computing environments and apply diverse hybrid cloud deployment models for executing scientific computing workflows. Specifically, we focus on grid and cloud systems built on OpenPBS [ 36 ] , SLURM [ 40 ] , OpenStack [ 37 ] and Kubernetes [ 32 ] . We explore several use case scenarios using the workflow managers NextFlow [ 8 ] , Snakemake [ 31 ] and CWL [ 6 ] . These environments and workflow managers are used by researchers across scientific domains [ 45 ] , although our demonstrators focus on use cases from the life science domain specifically. This paper can be viewed as a stepping stone toward reducing the obstacles faced by researchers looking to optimize their use of computing power via research infrastructures within and beyond the ELIXIR Europe and EOSC ecosystems [ 9 ] . More specifically, it outlines different approaches to provide seamless access to a combination of multiple computing and storage environments within single computational pipelines. Terms and Abbreviations ASIC Application Specific Integrated Circuit EOSC European Open Science Cloud EHDS European Health Data Space ELIXIR European Life Sciences Infrastructure ESFRI European Strategy Forum on Research Infrastructures FAIR data Findable, Accessible, Interoperable & Reusable data FPGA Field Programmable Gate Array GAIA-X European Association for Data and Cloud AISBL GDI Genomics Data Infrastructure GDPR General Data Protection Regulation GÉANT Pan-European data network for the research and education community GPU Graphics Processing Unit HPC High-performance Computing IaaS Infrastructure-as-a-Service ISO International Standards Organization FaaS Function-as-a-Service CaaS Container-as-a-Service SaaS Software-as-a-Service NREN National Research and Education Network OCRE Open Clouds for Research Environments OS Operating System OpenPBS Portable Batch System - Scheduling of HPC jobs SLURM Simple Linux Utility for Resource Management - Scheduling of HPC jobs SPU Stream Processing Unit 1 The Evolving Landscape Of Research Computing: From Grids to Clouds and Beyond 1.1 Infrastructures and services for research Scientific communities form a large vibrant ecosystem, centred around universities, research institutes and research infrastructures. While universities and research institutes provide a fertile ground for scientists to focus on research and education, research infrastructures create networks of scientists within a specific field across and beyond countries, providing the basis for cooperation and creating space for bootstrapping domain-specific innovation. Research infrastructures can thus provide an environment fostering collaboration, innovation and service delivery regardless of national and university affiliation. International cooperation between research infrastructures, scientific communities and other facilities has taken place for decades. In Europe, the so-called ESFRI 1 1 1 European Strategy Forum on Research Infrastructures recognises more than 60 research infrastructures with pan-European relevance [ 20 ] . Next to research infrastructures, another environment for supporting research emerged within European NRENs, which share their common expertise in advancing research, education and innovation within a single association called GÉANT [ 22 ] and the EGI foundation which operates and provides compute infrastructure for individual researchers and research infrastructures [ 14 ] . All these and other infrastructures and other institutions clustering researchers across scientific domains continuously develop and maintain robust environments for storing, processing and analysing data, which lie at the heart of modern research endeavours. The cooperation within and between these infrastructures and institutions has lately been reinforced by efforts encompassed by EOSC, which seeks to provide European researchers, innovators, companies and citizens with a federated and open multi-disciplinary environment where they can publish, find and re-use data, tools and services for research, innovation and educational purposes. This data should adhere to the FAIR principles [ 44 ] , i.e. follow the approaches which make them more Findable, Accessible, Interoperable and Reproducible. EOSC thus encompasses not only data management but also data processing, as the value of scientific data lies in their analysis and application to help solve research questions. 1.2 Computing in academia – grids, supercomputers and clouds Current state-of-the-art environments for processing of high volumes of scientific data conventionally utilise batch processing [ 1 ] , which is usually designed as a distributed system consisting

Read the complete text