Optimizing Product Provenance Verification using Data Valuation Methods

Raquib Bin Yousuf, Hoang Anh Just, Shengzhe Xu, Brian Mayer, Victor Deklerck, Jakub Truszkowski, John C. Simeone, Jade Saunders, Chang-Tien Lu, Ruoxi Jia, Naren Ramakrishnan · 2025

Read Optimizing Product Provenance Verification using Data Valuation Methods by Raquib Bin Yousuf, Hoang Anh Just, Shengzhe Xu, Brian Mayer, Victor Deklerck, Jakub Truszkowski, John C. Simeone, Jade Saunders, Chang-Tien Lu, Ruoxi Jia, Naren Ramakrishnan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-15177.txt.

Introduction

Raquib Bin Yousuf and co-authors help a live system that checks where a product came from, by picking which samples are worth the most for training. Such checks guard supply chains against goods whose origin is faked, like stolen timber passed off as legal.

The system reads chemical fingerprints in a sample and maps them to place. Data are scarce, so the team score each sample by how much it would add, using a fair share value from game theory. High score samples are gathered first. The method is in use in a real system that backs regulators and firms, the authors say.

Catalog record

CREATORRaquib Bin Yousuf, Hoang Anh Just, Shengzhe Xu, Brian Mayer, Victor Deklerck, Jakub Truszkowski, John C. Simeone, Jade Saunders, Chang-Tien Lu, Ruoxi Jia, Naren Ramakrishnan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-15177

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Optimizing Product Provenance Verification using Data Valuation Methods Raquib Bin Yousuf, Hoang Anh Just, Shengzhe Xu, Brian Mayer, Victor Deklerck, Jakub Truszkowski, John C. Simeone, Jade Saunders, Chang-Tien Lu, Ruoxi Jia, Naren Ramakrishnan Abstract Determining and verifying product provenance remains a critical challenge in global supply chains, particularly as geopolitical conflicts and shifting borders create new incentives for misrepresentation of commodities, such as hiding the origin of illegally harvested timber or stolen agricultural products. Stable Isotope Ratio Analysis (SIRA), combined with Gaussian process regression-based isoscapes, has emerged as a powerful tool for geographic origin verification. While these models are now actively deployed in operational settings supporting regulators, certification bodies, and companies, they remain constrained by data scarcity and suboptimal dataset selection. In this work, we introduce a novel deployed data valuation framework designed to enhance the selection and utilization of training data for machine learning models applied in SIRA. By quantifying the marginal utility of individual samples using Shapley values, our method guides strategic, cost-effective, and robust sampling campaigns within active monitoring programs. By prioritizing high-informative samples, our approach improves model robustness and predictive accuracy across diverse datasets and geographies. Our framework has been implemented and validated in a live provenance verification system currently used by enforcement agencies, demonstrating tangible, real-world impact. Through extensive experiments and deployment in a live provenance verification system, we show that this system significantly enhances provenance verification, mitigates fraudulent trade practices, and strengthens regulatory enforcement of global supply chains. 1 Virginia Tech, VA, USA. 2 Meise Botanic Garden, Meise, Belgium 3 Chalmers University of Technology, Gothenburg, Sweden 4 World Forest ID, Washington, DC, USA 5 Simeone Consulting, LLC, Littleton, NH, USA [email protected], [email protected] 1 Introduction Global natural resource supply chains are opaque, especially since natural resources are often transformed from raw materials (e.g., timber) into finished consumer-facing products (e.g., furniture). These complex supply chains often involve multiple countries, with intermediate outputs being traded internationally and being used as inputs into further manufacturing processes. In addition to business-commerce decisions driving supply chain sourcing, the economics of natural resource trade are often closely linked with geopolitics. Verifying the true origin of products remains difficult and high-stakes, as geopolitical incentives and “don’t ask, don’t tell” sourcing cultures encourages misrepresentation of commodities, particularly for illegally harvested timber or stolen agricultural products. The Scale of the Problem: Illegal Timber as a Case Study. Illegal logging, in particular, is the most profitable natural resource crime, valued at US$52 billion to US$157 billion per year ( May 2017 ) . Illegally obtained timber accounts for 10–30% of the total global trade in timber products, and in regions such as Southeast Asia, Central Africa, and South America, it is estimated that 50–90% of timber is harvested illegally ( May 2017 ) . These figures underscore the urgent need for deployed, verifiable, and scientifically defensible provenance systems. Forensic and Analytical Tools for Provenance Verification. Product identification and provenance verification of traded natural resources have emerged as promising research areas, with various combinations of methods used depending on the resource sector and the granularity required for species identification and origin determination; for example, species and geographic harvest provenance for wood and forest products often requires multiple forensic tools and testing methods ( woo 2021 ; Schmitz et al. 2020 ; Dormontt et al. 2015 ) . For geographic origin verification in particular, Stable Isotope Ratio Analysis (SIRA), combined with Gaussian process regression-based isoscapes, has proven highly effective ( Truszkowski et al. 2025 ; Mortier et al. 2024 ) . SIRA leverages the natural variation in stable isotope ratios—measured via mass spectrometry—to determine the enrichment of non-radioactive elemental isotopes in a sample ( Barrie and Prosser 1996 ) , with enrichment patterns driven by environmental, atmospheric, soil, metabolic, and species-specific factors ( Siegwolf et al. 2022 ; Wang et al. 2021 ; Vystavna, Matiatos, and Wassenaar 2021 ) . It has been successfully used to trace the origin of timber, seafood, agricultural products, and fiber such as cotton ( Truszkowski et al. 2025 ; Mortier et al. 2024 ; Watkinson et al. 2022 ; Cusa et al. 2022 ; Wang et al. 2020 ; Meier-Augenstein et al. 2014 ) . However, operational deployment of these models faces challenges of data scarcity, suboptimal reference selection, and high sampling costs, motivating the need for systematic data valuation and prioritization. This in turn highlights the importance of optimizing and ‘valuing’ reference sample collection efforts ( Gasson et al. 2021 ) . Operationalizing Provenance Verification: The WFID Platform. Efforts such as World Forest ID (WFID) (worldforestid.org) have operationalized geographic origin models to address this problem, particularly in the timber trade. WFID identifies high-risk species and geographies ( Norman 2023 ) , collects chain-of-custody reference samples, and uses laboratory analysis ( Fera Science 2025 ) to generate the chemical data needed for stable isotope modeling. These models are not only research prototypes—they are currently deployed and used in live compliance systems. The World Forest ID Evaluation Platform ( World Forest ID 2024b ) allows regulators, certification bodies, and companies to evaluate sourcing claims in real time. Here, we introduce our deployed data valuation framework that enhances the selection and utilization of training data for machine learning models applied to SIRA. Field sample collections, central to any scientific traceability method, are logistically difficult and expensive due to remote locations, specialized equipment, and labor-intensive workflows. Our deployed system operationalizes Shapley-based data valuation to quantify the marginal utility of individual samples, enabling strategic, cost-effective, and robust sampling campaigns that directly improve model accuracy in active enforcement workflows. Contributions: 1. Application of machine learning data valuation to an operational provenance verification context. By prioritizing highly informative samples, our approach improves model robustness and predictive accuracy across diverse datasets and geographies. 2. Deployment in live enforcement systems. We have deployed our optimized sampling approach in a provenance verification system used by European enforcement agencies to curb the trade of sanctioned Russian timber by proving that alternate claimed origins are non-viable. See coverage of our work in the New York Times ( Nazaryan 2024 ) ). Due to confidentiality reasons, we use a global dataset of Oak ( Quercus spp. ) reference samples to illustrate our methodology. 3. Extensive empirical validation and field integration. We validate our framework with global Oak (Quercus spp.) reference datasets , demonstrating its potential to enhance data valuation, optimize model configuration, and strengthen the regulatory enforcement of global supply chains. 2 Related Work SIRA has been widely employed as a geographical discriminator for various plant and animal-based products in global supply chains, such as garlic ( Pianezze et al. 2019 ) , Chinese tea ( Liu et al. 2020 ) , olive oil ( Bontempo et al. 2019 ) , cheese ( Camin et al. 2004 ) , and timber ( Mortier et al. 2024 ; Truszkowski et al. 2025 ) . By bringing data valuation methods to bear upon SIRA pipelines we aim to improve the verification of product provenance. Prior work in data valuation is typically seen in the context of explainable machine learning and enhancing model performance ( Wu, Zhu, and Li 2024 ; Covert et al. 2024 ) . Existing methods primarily rely on leave-one-out retraining and influence

Read the complete text