Supporting the development of Machine Learning for fundamental science in a federated Cloud with the AI_INFN platform

\firstname Lucio \lastname Anderlini, \firstname Matteo \lastname Barbetti \fnsep, \firstname Giulio \lastname Bianchini, \firstname Diego \lastname Ciangottini, \firstname Stefano \lastname Dal Pra, \firstname Diego \lastname Michelotto, \firstname Carmelo \lastname Pellegrino, \firstname Rosa \las · 2025

Read Supporting the development of Machine Learning for fundamental science in a federated Cloud with the AI_INFN platform by \firstname Lucio \lastname Anderlini, \firstname Matteo \lastname Barbetti \fnsep, \firstname Giulio \lastname Bianchini, \firstname Diego \lastname Ciangottini, \firstname Stefano \lastname Dal Pra, \firstname Diego \lastname Michelotto, \firstname Carmelo \lastname Pellegrino, \firstname Rosa \las (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-21266.txt.

Introduction

Lucio Anderlini and co-authors describe in a 2025 paper a cloud platform that supports machine learning for basic science in Italy. Learning methods now drive how scientists build data heavy software across fields. Yet access to graphics hardware for testing and production stays hard to arrange fairly.

Their project pools accelerators through the institute's federated cloud using cloud native tools. A Kubernetes platform eases building graphics powered analysis flows and scaling them widely. Links to outside providers let the platform stretch across unlike, spread out resources. Sharing stays fair across the institute's many research lines by design. The report updates the platform's commissioning state and its early use in physics workflows.

Catalog record

CREATOR\firstname Lucio \lastname Anderlini, \firstname Matteo \lastname Barbetti \fnsep, \firstname Giulio \lastname Bianchini, \firstname Diego \lastname Ciangottini, \firstname Stefano \lastname Dal Pra, \firstname Diego \lastname Michelotto, \firstname Carmelo \lastname Pellegrino, \firstname Rosa \las
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-21266

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Supporting the development of Machine Learning for fundamental science in a federated Cloud with the AI_INFN platform \firstname Lucio \lastname Anderlini, \firstname Matteo \lastname Barbetti \fnsep, \firstname Giulio \lastname Bianchini, \firstname Diego \lastname Ciangottini, \firstname Stefano \lastname Dal Pra, \firstname Diego \lastname Michelotto, \firstname Carmelo \lastname Pellegrino, \firstname Rosa \lastname Petrini \fnsep, \firstname Alessandro \lastname Pascolini, \firstname Daniele \lastname Spiga Abstract Machine Learning (ML) is driving a revolution in the way scientists design, develop, and deploy data-intensive software. However, the adoption of ML presents new challenges for the computing infrastructure, particularly in terms of provisioning and orchestrating access to hardware accelerators for development, testing, and production. The INFN-funded project AI ​ _ ​ INFN \mathrm{AI\_INFN} (“Artificial Intelligence at INFN”) aims at fostering the adoption of ML techniques within INFN use cases by providing support on multiple aspects, including the provision of AI-tailored computing resources. It leverages cloud-native solutions in the context of INFN Cloud, to share hardware accelerators as effectively as possible, ensuring the diversity of the Institute’s research activities is not compromised. In this contribution, we provide an update on the commissioning of a Kubernetes \mathrm{Kubernetes} platform designed to ease the development of GPU-powered data analysis workflows and their scalability on heterogeneous, distributed computing resources, possibly federated as Virtual Kubelets with the interLink provider. 1 Introduction Over the past decade, Artificial Intelligence (AI) has seen rapid and widespread adoption, establishing itself as a standard tool for processing large, complex datasets, and extracting insights from multi-modal, multi-domain data Bommasani2021FoundationModels . The proliferation of text-to-image apps and the advent of AI-powered chat-bots have helped propel AI into the mainstream, consolidating its explosion in both usage and development. Today, AI is reshaping the computing landscape, driving technological evolution, influencing hardware market trends, and dominating software development worldwide. Cloud computing has also played a key role in accelerating the adoption of AI techniques by making computing power and data storage more accessible to developers by outsourcing resource management to service providers like AWS 1 1 1 Amazon Web Services, https://aws.amazon.com . or GCP 2 2 2 Google Cloud Platform, https://cloud.google.com . . This approach enables ready-to-use software to be delivered directly to the end users, a model known as Software-as-a-Service (SaaS). A typical example is JupyterHub 3 3 3 Multi-user platform for collaborative coding and data analysis using notebooks, https://jupyter.org/hub . , which provides multiple users with access to notebooks for data visualization and interactive computation using resources provisioned by the Cloud. The growing community of Data Scientists makes large use of this or similar technologies, contributing to expanding the catalog of libraries and tools available for developing and deploying AI applications. The scientific community is closely following the evolution of Machine Learning (ML), aiming at adapting advanced ML-based algorithms for fundamental research. This is particularly true in the High Energy Physics (HEP) field, where researchers are exploring AI-driven computing solutions to accelerate the workflow, from data acquisition and simulation to physics analysis Albertsson:2018maf . The paradigm of interactive computing is also gaining interest within the HEP community as a promising solution to meet the growing resource demand expected from next-generation experiments. These efforts are leading to the design and implementation of Analysis Facilities (AFs), a collection of infrastructures and services that integrates data, software, and computational resources to execute one or more elements of an analysis workflow Ciangottini:2024vtl . The Italian National Institute for Nuclear Physics (INFN) is the coordinating institution for nuclear, particle, astroparticle, medical and theoretical physics in Italy. It promotes, coordinates, and conducts scientific research, along with the technological developments needed for the activities in these fields. In response to the paradigm shift driven by AI and Cloud technologies, INFN is reorganizing its computing infrastructure to support emerging trends, strengthening its resources Grandi:2024fqt , and expanding the range of services offered through INFN Cloud 4 4 4 Cloud resources for INFN research, https://www.cloud.infn.it . Salomoni:2024dft . Within this context, the \mathrm{AI\_INFN} (“Artificial Intelligence at INFN”) initiative was launched, aiming at sharing hardware resources, learning best practices, and developing AI-powered applications relevant to INFN research. In this document we present the \mathrm{AI\_INFN} platform and discuss its relevance to the outlined scopes. 2 The AI_INFN initiative The \mathrm{AI\_INFN} initiative, aims to connect the scientific communities developing infrastructures, algorithms, and applications. It provides tools, computing infrastructures, and social connections to foster collaboration and facilitate the adoption of AI-powered computing technologies within INFN research fields. \mathrm{AI\_INFN} is organized in four work packages: procuring and operating computing infrastructure with hardware accelerators, organizing training events for Machine Learning adoption, building a community of ML experts and developers across INFN units, and developing the competence to profit from hardware accelerators beyond Graphics Processing Units (GPU), such as FPGAs and Quantum Processors, for AI model training and inference. The \mathrm{AI\_INFN} platform is a cloud-native toolset developed in collaboration with the \mathit{DataCloud} initiative operating \mathrm{INFN\ Cloud} to support the activities of the four work packages of \mathrm{AI\_INFN} . In this document we present the \mathrm{AI\_INFN} platform and discuss its relevance to the outlined scopes. The \mathrm{AI\_INFN} platform is a SaaS provided by \mathrm{INFN\ Cloud} . The underlying specialized and dedicated hardware was designed for High Performance Computing (HPC) tasks and is hosted and managed at INFN CNAF in Bologna, few steps away from the pre-exascale CINECA supercomputer Leonardo 5 5 5 CINECA Leonardo, https://leonardo-supercomputer.cineca.eu . The infrastructure comprises four servers, clustered in an OpenStack 6 6 6 OpenStack, https://www.openstack.org . tenancy, acquired and installed between 2020 and 2024 as the demand for Cloud-accessible HPC computing resources increased: • Server 1 (2020), with 64 CPU cores, 750 GB of memory, 12 TB of NVMe disk, eight NVIDIA Tesla T4 GPUs and five NVIDIA RTX 5000 GPUs; • Server 2 (2021), with 128 CPU cores, 1024 GB of memory, 12 TB of NVMe disk, two NVIDIA Ampere A100 GPU, one NVIDIA Ampere A30 GPU, two AMD-Xilinx U50 boards and an AMD-Xilinx U250 board; • Server 3 (2023), with 128 CPU cores, 1024 GB of memory, 24 TB of NVMe disk, three NVIDIA Ampere A100 GPUs and five AMD-Xilinx U250 boards; • Server 4 (2024), with 128 CPU cores, 1024 GB of memory, 12 TB of NVMe disk, one NVIDIA RTX 5000 GPUs and two AMD-Xilinx Versal V70 boards. Before \mathrm{AI\_INFN} started its activity in January 2024, the farm was maintained by another INFN initiative named \mathrm{ML\_INFN} that, created as a proof-of-concept for designing a platform for sharing accelerated resources, was developed with a provisioning model relying on Virtual Machines (VMs) assigned to groups of users developing a data analysis or Machine Learning study Anderlini:2024oup . During the late period of \mathrm{ML\_INFN} , however, an increase in the user base highlighted some limitations to the efficiency of this provisioning model. These limitations were related to administrative and user-support burden, very long idling times, and dangerous eviction of the stateful user’s deployments. In 2023, the security risks grew to an unacceptable level and called for the introduction of an alternative model enabling users to tune the resources provisioned to their cloud-based computing environment, without becoming administrators of a multi-user web service. At the time of writing, 72 researchers working on 16 research activities have requested and gained access to the platform. On

Read the complete text