The Dataset Friction Framework: measuring user-facing friction as a complement to FAIR

Emma Pidduck, Umberto Modigliani · 2026

Read The Dataset Friction Framework: measuring user-facing friction as a complement to FAIR by Emma Pidduck, Umberto Modigliani (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-23660.txt.

Introduction

Pidduck and Modigliani propose measuring how much friction users face when working with open datasets, in a 2026 paper on research data services. The FAIR principles say data should be findable, accessible, interoperable, and reusable, and high FAIR scores are often treated as proof of usability. Yet a dataset can pass every stewardship check and still cost a new user hours before a first usable file arrives.

The Dataset Friction Framework scores friction across six dimensions. It separates engineered friction, deliberate provider choices that keep a service viable, from accidental friction, defects that need fixing. Validation uses more than eighteen thousand support tickets from a European weather forecasting centre serving two hundred eighty thousand users. Case studies show the two measures disagreeing both ways: a highly FAIR compliant dataset can carry heavy friction, and a low FAIR score can reflect anti scraping policy.

Catalog record

CREATOREmma Pidduck, Umberto Modigliani
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE83 KB
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2606.23660

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Dataset Friction Framework: measuring user-facing friction as a complement to FAIR Emma Pidduck, Umberto Modigliani Abstract Open research data services have matured to the point where the cost of sustaining them at scale has become a primary design constraint, driving providers to make deliberate choices that may reduce user convenience to keep the service viable. The FAIR (Findable, Accessible, Interoperable, Reuseable) principles describe whether a dataset is well stewarded, and FAIR compliance is often treated as a proxy for usability. FAIR does not capture the cost to a user of finding, accessing, interpreting, and applying a dataset. We introduce the Dataset Friction Framework (DFF) as a complement to FAIR, directly addressing usability. DFF measures user-facing friction across six dimensions, distinguishing engineered friction (deliberate data provider design choices that sustain a service) from accidental friction (defects that require remediation). The framework is validated against 18,556 support tickets from the European Centre for Medium-Range Weather Forecasts (January 2024 to May 2026), which serves 280,000 registered users. Restricting the analysis to tickets raised by external reporters reduces the corpus by 12.3%, but every dimension’s internal-staff share falls below this baseline — confirming that the reported friction signals are genuinely user-facing. We then assess three real datasets across three providers and show that FAIR compliance and DFF friction can disagree in both directions: a 92% FAIR-compliant dataset can still carry substantial friction, and a 42% FAIR score can be an artefact of anti-scraping policy rather than poor stewardship. The two measures are non-redundant and jointly informative: FAIR compliance does not predict DFF friction in either direction. This constitutes the first large-scale empirical application of the framework; cross-institutional validation is identified as the immediate next step. Keywords: open data, FAIR principles, data friction, data infrastructure, research data services, service design 1 Introduction Openness, as codified by the FAIR principles 35 , has become a widely accepted baseline for scientific data stewardship across all domains. That is, data should be Findable, Accessible, Interoperable and Reuseable. In the weather and climate community, the transition from restrictive licensing to open access has been among the most significant infrastructural shifts of the past decade, driven by policy instruments such as the World Meteorological Organization’s Resolution 1 38 and by the longer-standing argument that open access to environmental data is a precondition for addressing problems at global scale 30 . Providers have invested heavily in metadata standards, open licences, persistent identifiers, and machine-readable interfaces, and many prominent meteorological datasets now score strongly against FAIR assessment tooling 11 . Two gaps in FAIR’s coverage have nevertheless become evident as open data has matured from principle to operational practice. The first is experiential: a dataset can be findable in a catalogue, accessible through a documented interface, interoperable with community tools, and legally reusable under a clear licence, and still require hours of a new user’s time before a first usable file is retrieved. The second is structural: sustaining open data services at scale requires design choices — release latency, resolution caps, registration, tiered delivery, and differentiated support levels — that reduce user convenience to enable provider sustainability, equity between user classes, or the continued funding of open provision itself. FAIR addresses neither gap directly nor was it designed to do so; what is left unaddressed reflects the stated scope of the framework rather than any defect in FAIR. The operational consequence, however, is a class of questions that service providers encounter daily without a shared vocabulary in which to answer them. The practical stakes are significant: ECMWF’s own transition from a licensing model that generated €123 million over eleven years to full Creative Commons Attribution 4.0 (CC BY 4.0) provision 31 illustrates the scale of the sustainability challenge that open data providers face. This paper introduces the Dataset Friction Framework (DFF) as a complement to FAIR. The shared goal of both is the productive reuse of open data — to turn a published dataset into as many genuine users as possible; FAIR addresses whether a dataset can, in principle, be found and used, while DFF addresses what it costs a user to do so in practice. The central commitment of the framework is that the deliberate design choices through which providers sustain open services — engineered friction — constitute an analytic category, visible and defensible, rather than being treated as defects to be engineered away. The term data friction has a prior history in science and technology studies, originating with Edwards 15 and developed by Bates 3 among others; our contribution is to operationalise that lineage for operational data service providers, with named dimensions, scoring cues, and a design orientation. The framework is then validated empirically against 18,556 user support tickets from a 280,000-user weather and climate data infrastructure, demonstrating that a 92% FAIR-compliant system nonetheless generates measurable user-facing friction across all six dimensions. The paper makes four contributions. First, it introduces “engineered friction” as a distinct analytic category and presents a menu of recurring sustainability trade-offs that providers use to configure open services. Second, it develops DFF as a complement to FAIR across six dimensions, with scoring cues that a reviewer with working knowledge of a dataset can apply. Third, it provides large-scale empirical validation: an analysis of 18,556 support tickets, two user surveys, and two public software repositories that together establish friction patterns across user populations, channels, and institutional boundaries. Fourth, it demonstrates that FAIR compliance and DFF friction are non-redundant measures, and that their relationship is non-monotonic: a dataset can score highly on one and poorly on the other, and a low FAIR score does not reliably indicate user-facing friction. Three real datasets — ECMWF’s Integrated Forecasting System (IFS) and Artificial Intelligence Forecasting System (AIFS) Open Data, ERA5 via the Copernicus Climate Data Store, and the German national meteorological service’s geoportal — illustrate three distinct FAIR–DFF relationships, and one of these reveals a previously undocumented failure mode of passive FAIR assessment tooling. 2 Background 2.1 FAIR and adjacent frameworks The FAIR principles 35 have become the organising framework for research data stewardship. Findability, Accessibility, Interoperability, and Reusability map cleanly onto the technical and semantic layers of data management, and automated assessment tools, notably F-UJI 11 , enable evaluation of FAIR compliance at scale. In recent years, FAIR has become increasingly embedded in funder and publisher policies to ensure that publicly funded outputs are maximally accessed and used. Interpretation and implementation guidance have continued to evolve 20 , and empirical FAIR assessments applied to the same datasets sometimes diverge 22 , both of which serve as reminders that FAIR is a living framework rather than a closed specification. Complementary frameworks extend their scope: the CARE (Collective benefit, Authority to control, Responsibility, Ethics) principles 8 articulate collective benefit, authority to control, responsibility, and ethics for Indigenous data governance, and the TRUST (Transparency, Responsibility, User focus, Sustainability, Technology) principles 24 outline the requirements of trustworthy digital repositories. FAIR is, by design, a stewardship framework and, as such, describes the dataset’s properties and metadata. It does not describe how a specific user, with specific tools, skills, and context, experiences the process of finding, accessing, interpreting, and applying the data, nor the design choices providers make when balancing user convenience with service sustainability.

Read the complete text