A metadata model for profiling multidimensional sources in data ecosystems

Claudia Diamantini, Alessandro Mele, Domenico Potena, Cristina Rossetti, Emanuele Storti · 2025

Read A metadata model for profiling multidimensional sources in data ecosystems by Claudia Diamantini, Alessandro Mele, Domenico Potena, Cristina Rossetti, Emanuele Storti (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-15951.txt.

Introduction

Claudia Diamantini and co-authors design a metadata language for the summary tables that data ecosystems run on. Big data stores hold plenty of aggregated, multidimensional data, but standard vocabularies describe raw files better than rollups. Their 2025 model is an RDF vocabulary with a graph shape. It annotates sources and single attributes alike. Dimensions and measures link to a reference knowledge graph, so terms keep shared meaning.

Profiles summarize how values spread inside each source. The design stays flexible and extensible by intent. A timing study gauges what profile generation costs across sources of different sizes. The goal is practical: analysts should find, judge, and reuse summary data without reverse-engineering it.

Catalog record

CREATORClaudia Diamantini, Alessandro Mele, Domenico Potena, Cristina Rossetti, Emanuele Storti
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-15951

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A metadata model for profiling multidimensional sources in data ecosystems Claudia Diamantini, Alessandro Mele, Domenico Potena, Cristina Rossetti, Emanuele Storti Abstract The Big Data landscape poses challenges in managing diverse data formats, requiring efficient storage and processing for high-quality analysis. Effective metadata management is crucial for organizing, accessing, and reusing data within these data ecosystems. Existing metadata vocabularies and standard, however, do not adequately accommodate aggregated or summary data. This paper introduces a metadata model to support semantic annotation and profiling of multidimensional data. Defined as an RDF vocabulary, the model provides a flexible and extensible graph representation for metadata at source and attribute levels, aligning dimensions and measures to a reference Knowledge Graph and summarizing value distributions in profiles. An evaluation of the execution time for profile generation is also proposed, across data sources with different cardinalities. 1 Introduction Big Data world poses several challenges due to the management of large amount of heterogeneous data with different formats. Data need to be efficiently stored and processed in order to ensure the quality of data analysis. In data ecosystems, both centralized like Data Lakes, and decentralized Data Spaces, metadata management is crucial for several reasons, as it helps ensuring that data are properly organized, easily findable, accessible, interoperable and reusable [ 15 ] . Existing metadata vocabularies and standards are however not tailored to aggregated or summary data, which are characterized by a multidimensional nature and a specific structure [ 9 ] . Aggregated data, which consolidate information from multiple sources into a unified format, are essential for monitoring, management, and planning purposes across various sectors. This type of data serves as a support to decision-making processes in both public and private sectors, offering insights that are crucial for strategic operations and policy formulation. Examples include open data by public bodies, e.g., to monitor economic trends or the effectiveness of governmental policies and initiatives. In this paper, we introduce a metadata model to support semantic annotation and profiling of summary data. The model is defined as an RDF vocabulary, to uniformly represent different sources through a flexible and extensible graph representation that can be easily queried, shared, and integrated with other metadata sources. The model allows to specify metadata at source and attribute level, including the alignment of dimensions and measure to concepts of a reference Knowledge Graph. Furthermore, defined metadata include statistical information for attributes and a summarization of value distributions in profiles. These features enable data discovery and exploration functionalities such as dataset discovery based on specific data characteristics or data quality assessment, that are not supported by other models. The work is complemented by an evaluation of execution time for profile generation with data sources of different cardinalities. The rest of this paper is organised as follows: in Section 2 we discuss relevant related work. The metadata model is introduced in Section 3 , while an evaluation is proposed in Section 4 . Finally, Section 5 concludes the paper and outlines possible future developments. 2 Related work Metadata play a crucial role in organizing and describing vast amounts of data within data ecosystems, enabling users to locate, understand, exchange and share datasets effectively. To this aim, effective data governance requires a proper metadata model adhering to the FAIR (Findable, Accessible, Interoperable, and Reusable) principles [ 15 ] . In the context of Data Lake literature, metadata are primarily categorized in two types: functional and structural [ 12 ] . Within the former category, metadata can be further classified as (i) technical (i.e., data format, structure or schema), (ii) operational (i.e., data location, file size, number of record) and (iii) business (i.e., field names and explanations) [ 11 ] . Diamantini et al. [ 4 ] show that these categories are not entirely distinct and can overlap. In the latter category, metadata are associated with the concept of object [ 12 ] , a generalisation of a data source that can be structured (e.g., SQL tables), semi-structured (e.g., XML, JSON), or unstructured (e.g., images, audio or video). Sawadogo et al. [ 13 ] categorised metadata in (i) intra-object, related to general properties of an object (i.e., file name, size, and location, semantic annotation), (ii) inter-object, for representing relations between objects (e.g., grouping through metadata or similarity links using affinity and joinability measures) and (iii) global metadata (e.g., semantic resources, indexes and logs tracking user activities in the data lake). We observe that such typologies include most of the elements identified by Oram et al. [ 11 ] . Specifically, business metadata are comparable to semantic metadata, operational metadata can be considered as logs, technical metadata are equivalent to pre-visualisation metadata, and structural metadata can be seen as an extension of functional metadata. Metadata are also core components of other data sharing ecosystems like Data Space architectures. In fact, Data Spaces add decentralized governance to Data Lakes, facilitating the sharing and exchange of data across different organizations without the need of a single, centralized repository. This makes FAIR principles even more important and challenging. Data space architectures typically introduce components for registration, publication, maintenance, and query of metadata (e.g., IDS-RAM metadata broker [ 14 ] , EOSC’s Metadata Framework [ 3 ] , GAIA-X Federated Catalogue [ 7 ] ). Given the decentralized, market-based nature of Data Spaces, more emphasis is given to the description of identities, providers, and services than in more centralized Data Lake scenarios like ours. On the other hand, interoperability is enabled by adopting standard metadata formats and vocabularies, following Semantic Web principles, which characterize our proposal as well. Several vocabularies and ontologies have been proposed in the literature to describe (statistical) data sources [ 9 ] . Among them, ‘‘Vocabulary of Interlinked Datasets’’ (VoID) 1 1 1 https://www.w3.org/TR/void/ is an RDF Schema vocabulary for expressing high-level metadata about RDF datasets, such as the vocabularies used in the dataset and the size of the dataset. Similarly, Dublin Core Metadata Initiative (DCMI) Terms 2 2 2 https://www.dublincore.org/specifications/dublin-core/dcmi-terms/# aims at interoperable metadata descriptions for resources in the Web, also including basic data provenance metadata. RDF Data Cube 3 3 3 https://www.w3.org/TR/vocab-data-cube/ is an RDF Schema vocabulary based on the SDMX standard designed for representing statistics in a multidimensional attribute space, while DCAT 4 4 4 https://www.w3.org/TR/vocab-dcat-3/ is an RDF vocabulary designed to facilitate interoperability between data catalogues published on the Web. For each source within the catalogue, some basics metadata are provided, i.e., resource URL, title, file type and dimension. For what concerns tools for statistics generation, LODstat [ 2 ] provides schema and data statistics for RDF data sources, i.e., number of triples, triples containing blank nodes, or literal values with the respective data types. PROLOD++ [ 1 ] is a tool for profiling and mining RDF data sources. Profiles provide statistics such as frequency counts and distributions related to subjects, predicates and objects. Similarly, RDFStats [ 10 ] is a generator for statistics of RDF data sources, which provides histograms of classes, properties and value types. We emphasise that the mentioned vocabularies and tools do not provide support for the type of metadata we are interested in, since they are not tailored to the description of the peculiar characteristics of multidimensional data sources, namely measures

Read the complete text