AI4EOSC: a Federated Cloud Platform for Artificial Intelligence in Scientific Research Journal: Future Gener. Comput. Syst.

Ignacio Heredia, Álvaro López García, Germán Moltó, Amanda Calatrava, Valentin Kozlov, Alessandro Costantini, Viet Tran, Mario David, Daniel San Martín, Marcin Płóciennik, Marta Obregón Ruiz, Saúl Fernandez, Judith Sáinz-Pardo Díaz, Miguel Caballer, Caterina Alarcón Marín, Stefan Dlugolinsky, Martin · 2025

Read AI4EOSC: a Federated Cloud Platform for Artificial Intelligence in Scientific Research Journal: Future Gener. Comput. Syst. by Ignacio Heredia, Álvaro López García, Germán Moltó, Amanda Calatrava, Valentin Kozlov, Alessandro Costantini, Viet Tran, Mario David, Daniel San Martín, Marcin Płóciennik, Marta Obregón Ruiz, Saúl Fernandez, Judith Sáinz-Pardo Díaz, Miguel Caballer, Caterina Alarcón Marín, Stefan Dlugolinsky, Martin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-16455.txt.

Introduction

Ignacio Heredia leads a large European team in presenting a research platform in an arXiv paper released in 2025. Artificial intelligence tools built for industry fit open science poorly, where the FAIR principles demand data and models stay findable, accessible, interoperable, and reusable. AI4EOSC answers that gap inside the European Open Science Cloud.

The platform federates computing and storage from many research infrastructures behind one environment for building, training, and serving models. A development platform, a serverless AI-as-a-service layer, and a federated orchestration model form its modular design. FAIR-by-design rules enforce standard metadata and provenance tracking through the deployment pipeline, following W3C PROV. Community installations across varied cloud providers show the system deploying smoothly, cutting manual work for researchers while raising reproducibility.

Catalog record

CREATORIgnacio Heredia, Álvaro López García, Germán Moltó, Amanda Calatrava, Valentin Kozlov, Alessandro Costantini, Viet Tran, Mario David, Daniel San Martín, Marcin Płóciennik, Marta Obregón Ruiz, Saúl Fernandez, Judith Sáinz-Pardo Díaz, Miguel Caballer, Caterina Alarcón Marín, Stefan Dlugolinsky, Martin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-16455

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AI4EOSC: a Federated Cloud Platform for Artificial Intelligence in Scientific Research Journal: Future Gener. Comput. Syst. Ignacio Heredia, Álvaro López García, Germán Moltó, Amanda Calatrava, Valentin Kozlov, Alessandro Costantini, Viet Tran, Mario David, Daniel San Martín, Marcin Płóciennik, Marta Obregón Ruiz, Saúl Fernandez, Judith Sáinz-Pardo Díaz, Miguel Caballer, Caterina Alarcón Marín, Stefan Dlugolinsky, Martin Šeleng, Lisana Berberi, Khadijeh Alibabaei, Borja Esteban Sanchis, Pedro Castro, Giacinto Donvito, Diego Aguirre, Sergio Langarita, Vicente Rodriguez, Leonhard Duda, Andrés Heredia Canales, Susana Rebolledo Ruiz, João Machado, Giang Nguyen, Fernando Aguilar Gómez, Jaime Díez Abstract In this paper, we describe a federated compute platform dedicated to support Artificial Intelligence in scientific workloads. Putting the effort into reproducible deployments, it delivers consistent, transparent access to a federation of physically distributed e-Infrastructures. Through a comprehensive service catalogue, the platform is able to offer an integrated user experience covering the full Machine Learning lifecycle, including model development (with dedicated interactive development environments), training (with GPU resources, annotation tools, experiment tracking, and federated learning support) and deployment (covering a wide range of deployment options all along the Cloud Continuum). The platform also provides tools for traceability and reproducibility of AI models, integrates with different Artificial Intelligence model providers, datasets and storage resources, allowing users to interact with the broader Machine Learning ecosystem. Finally, it is easily customizable to lower the adoption barrier by external communities. 1 Introduction Artificial Intelligence (AI), Machine Learning (ML), and Deep Learning (DL) are transforming the scientific and industrial research panorama. The impact of these techniques over the last years has revolutionized the field, e.g. by making it possible to tackle new scientific endeavors [ 24 , 69 , 42 ] , by automatizing manual and tedious tasks [ 73 ] or by speeding up some cost and effort expensive tasks [ 112 ] , just to cite some examples. These techniques are a reality, and they form now part of the basic set of tools for a wide set of scientists and researchers [ 56 ] . We argue that researchers willing to exploit these state of the art techniques need not only to be able to get access to appropriate compute and storage resources, but also to more advanced platforms and tools that can broaden their adoption, lowering the entry barriers, easing the data exploration and analysis, model development, training, sharing and deployment, in an open, transparent and collaborative way. With a broader scope, the European Commission is currently engaged in the implementation of the European Open Science Cloud (EOSC) [ 21 ] , that aims to become the ”The web of FAIR data and services“ [ 40 ] , as a transformative process towards the promotion of open science practices among researchers, also delivering a comprehensive environment for the sharing, processing, and analysis of research data. In this context, in this manuscript we present the AI4EOSC platform, a federated system that provides a comprehensive cloud-based toolbox for the development, training, sharing and deployment of ML/DL/AI models also focusing on their traceability and reproducibility. The AI4EOSC federated platform enables data processing from the cloud to edge continuum, being able to mobilize different resources for different needs. Moreover, this platform is being developed in the context of the EOSC, both from the technical perspective including seamless integration and interoperability with the EOSC ecosystem, but also from the perspective of strengthening open science practices as a collaborative, transparent, and accessible research model. The objective of the AI4EOSC platform is not only to provide scientists with the tools and functionalities needed to develop , train or serve models, but also to frame the development of these models with the open science practices. These include, for instance, following the well known FAIR principles (Findable, Accessible, Interoperable, Reusable) [ 124 ] , providing fine-grained model provenance metadata or ensuring metadata interoperability across different formats. To this aim, we have implemented these functionalities in an automated and transparent way for the users, so that these principles can be granted by design, to the possible extent, without their intervention. The remainder of this manuscript is structured as follows: first, Section 2 introduces the background and related work. Section 3 outlines the proposed platform architecture and its current implementation. Section 4 showcases the integrations with other systems and platforms, in order to illustrate the easiness of extensibility of the platform. Section 5 we explain how different scientists with multidisciplinary profiles can leverage the platform to carry out different tasks. Section 6 introduces how the platform can be extended and customized for different user communities. Finally, Section 7 draws out the main conclusions and the future work proposed. 2 Related work and motivation While there are many private platforms to deploy AI workloads for users, few of them have put an effort on addressing the open source and reproducibility requirements that are key to scientific workloads. In addition, many of the solutions are fragmented. For example, a number of AI model repositories exists, including many devoted to scientific communities, like the BioImage Model Zoo [ 91 ] for microscopy images or Kipoi [ 10 ] for genomics. Even very popular and general purpose ones, like Hugging Face [ 125 ] or Replicate [ 104 ] , allow users to deploy their models. However, most model repositories are detached from the training process of the model, thus making users unable to assess the trustworthiness of the said model. On the other side, many solutions exist to support users in the model training. For example, there are a wide range of MLOps solutions [ 13 ] to track experiments, both open source (MLflow [ 126 ] , LabML [ 66 ] ) and proprietary ones (Weights and Biases [ 29 ] , Valohai [ 118 ] , Comet [ 26 ] ). In parallel, several data annotation tools are available, both open source (LabelStudio [ 116 ] , Doccano [ 84 ] , refinery [ 71 ] ) and proprietary (Prodigy [ 99 ] , Roboflow [ 106 ] ). However, even open source ones are not always easy to use locally by users looking for advanced features (e.g. AI-assisted annotation) and offer paid cloud access to them (CVAT [ 31 ] ). In addition, most of the time researchers have to manually access external cloud providers to deploy and configure their training environments. No tools seems cover the full training process in a single coherent platform, from labeling the data, to automatically deploying resources, developing the model and logging the training runs. For the few AI platforms that do cover the ML process end-to-end, they are usually closed source (H2O.ai [ 55 ] ) and restrict model deployment or the data storage to their specific cloud solutions (like Google Vertex AI [ 7 ] , Amazon Sage Maker [ 9 ] or Azure ML Studio [ 80 ] ), thus defeating the open principles on which science is built. Others are partially open-source but do not offer all features in their community free versions (Polyaxon [ 98 ] ). Therefore, an open-source solution is needed to address the ML lifecycle end-to-end, from development to deployment, giving a more comprehensive overview of all the processes involved, thus fostering reproducibility. That platform should be approachable

Read the complete text