LUCAS-MEGA: A Large-Scale Multimodal Dataset for Representation Learning in Soil–Environment Systems

2026

Read LUCAS-MEGA: A Large-Scale Multimodal Dataset for Representation Learning in Soil–Environment Systems (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-04323.txt.

Introduction

Leng and three colleagues assemble a vast soil dataset for machine learning. Soil underpins farming, carbon cycling, and environmental health, yet soil data sits fragmented across formats and protocols, keeping models stuck on small predictive tasks. LUCAS-MEGA fuses European soil observations around the LUCAS survey into one resource. It holds over seventy thousand samples and more than a thousand features spanning physical, chemical, biological, and visual traits, drawn from sixty-eight source datasets.

A multi-agent pipeline called SoilFuser, checked by humans, standardizes formats and fixes unit and codebook mismatches. It brings everything into a feature space ready for machine learning. The authors pretrain SoilFormer, a multimodal tabular transformer, on the fused data with a feature-masking objective. Training stays stable, predictions are strong, and outputs carry uncertainty estimates. Learned representations also recover relationships consistent with known soil processes, and the dataset ships with open access and query APIs.

Catalog record

YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.04323

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LUCAS-MEGA: A Large-Scale Multimodal Dataset for Representation Learning in Soil–Environment Systems Abstract Understanding soil is fundamental to agriculture, carbon cycling, and environmental sustainability, yet progress is limited by fragmented and heterogeneous datasets that constrain modeling to small-scale predictive settings rather than high-dimensional representation learning. We introduce LUCAS-MEGA, a large-scale multimodal dataset constructed through systematic data fusion of European soil–environment observations, with the LUCAS survey as its backbone. The fused dataset comprises over 70,000 samples and more than 1,000 features spanning physical, chemical, environmental, biological, and visual attributes, aggregated from 68 source datasets. To enable integration at scale, we develop SoilFuser, a multi-agent, human-in-the-loop data fusion pipeline that standardizes heterogeneous data formats and measurement protocols, resolves inconsistencies and invalid entries (e.g., unit inconsistencies, codebook mismatches, and erroneous values), incorporates natural language annotations, and harmonizes multimodal attributes and metadata into a unified, machine learning-ready feature space. The resulting dataset captures key characteristics of real-world soil observations, including multimodality, uneven feature coverage, and heterogeneous uncertainty. To demonstrate the usability of LUCAS-MEGA for data-driven modeling, we pretrain a multimodal tabular transformer (SoilFormer) using a self-supervised objective based on feature masking, achieving stable training, strong predictive performance, and representations that support uncertainty-aware prediction. We further show that the learned representations recover relationships consistent with established soil processes. LUCAS-MEGA is released with open access and is accompanied by composable, agent-friendly APIs that support structured querying and data-driven workflows. \Author [1]KuangdaiLeng \Author [1,2]SimonJeffery \Author [3]PanosPanagos \Author [1,4]TarjeNissen-Meyer 1]Earth Rover Program, 71-75 Shelton Street, London WC2H 9JQ, United Kingdom 2]Centre for Crop and Environmental Science, Harper Adams University, Newport, Shropshire TF10 8NB, United Kingdom 3]European Commission Joint Research Centre, Via E. Fermi, 2749, 21027 Ispra VA, Italy 4]Department of Mathematics and Statistics & Center for Environmental Intelligence, University of Exeter, Exeter EX4 4QF, United Kingdom \correspondence Tarje Nissen-Meyer ([email protected]) \pubdiscuss \published † † firstpage: 1 1 Introduction Soils are increasingly recognized as a critical but threatened foundation of terrestrial ecosystems, agricultural production, climate regulation, and biodiversity. In Europe, for example, 62% of soils are estimated to be unhealthy based on the 19 soil degradation indicators of the EU Soil Health Dashboard ( 33 ) . This urgency is further reflected in the EU Soil Monitoring Law, which establishes a harmonized framework for monitoring soil health across multiple soil threats and descriptors, reflecting the need to assess soil properties and degradation processes in an integrated rather than isolated manner ( 34 ) . Such interdependence reflects the inherent complexity of soils: their states and behaviors emerge from tightly coupled physical, chemical, and biological processes interacting across spatial and temporal scales ( 21 ; 46 ; 42 ) . Capturing this complexity therefore requires jointly modeling a large number of interdependent variables, often with uneven coverage across regions, depths, and observation systems, resulting in a high-dimensional and heterogeneous feature space . Recent advances in scientific machine learning have led to more general-purpose and multimodal foundation models ( 44 ; 4 ) . These models learn shared representations across large numbers of variables and modalities ( 25 ; 20 ) , enabling the discovery of complex cross-variable relationships and supporting a variety of downstream tasks. This paradigm is well aligned with the need to model soil as an integrated system, but its application in soil science remains constrained by the lack of unified, high-dimensional, and machine learning-ready data. Existing sample-based soil data are fragmented across sources, heterogeneous in format and measurement protocols, and not organized to support joint modeling across variables and modalities. As a result, most existing data-driven approaches in soil science rely primarily on small-scale, task-specific models trained on limited subsets of variables, providing only a partial view of soil–environment systems; see reviews by 29 ; 30 . Soil data with broad geographic coverage are available through a range of spatial soil resources, from expert-derived soil databases such as the European Soil Database (ESDB) ( 24 ) and the Harmonized World Soil Database (HWSD) ( 10 ) , to digital soil mapping (DSM) products such as SoilGrids ( 38 ) . These products provide spatially continuous estimates at resolutions ranging from hundreds of meters to kilometers. While highly valuable for sub-national to continental-scale assessment and policy applications, they are typically derived from field observations and environmental covariates through empirical knowledge, statistical interpolation, or machine learning models, and thus constitute spatially generalized representations rather than direct measurements. This introduces inductive biases into the resulting products and limits their ability to capture fine-scale variability driven by local environmental and management factors. In addition, these products are limited in their feature space, providing only a small set of key soil properties and lacking the variable breadth needed for integrated representation learning. Direct soil observations are available from large-scale field surveys, including topsoil monitoring programs such as LUCAS (Europe) ( 32 ) , RMQS (France) ( 2 ) , and NSI (UK) ( 26 ) , as well as soil profile-based datasets such as WoSIS (Global) ( 3 ) , SPADE/M (Europe) ( 16 ) , EU-HYDI (Europe) ( 45 ) , AfSIS (Africa) ( 15 ) , and NCSS (US) ( 40 ) . These datasets provide sample-based, directly measured observations and are therefore well suited for data-driven modeling. However, they originate from heterogeneous sources with differing measurement protocols, data formats, and variable coverage, and are not organized into a unified representation that supports joint modeling across datasets. In addition, the feature space of individual datasets remains limited: each sample typically contains tens of measured variables, reflecting the cost and design constraints of field and laboratory measurements. Recent work has increasingly explored multimodal and multi-source datasets or benchmarks in environmental and agricultural science, often incorporating soil information as part of a broader modeling context. Examples include IRRISIGHT for irrigation mapping and agricultural water management ( 28 ) ; CY-Bench, CYCleSS, and a global conventional-tillage/no-tillage dataset for crop-yield modeling ( 37 ; 7 ; 41 ) ; AgriBench/MM-LUCAS and AgMMU for benchmarking multimodal or vision–language models in agriculture ( 47 ; 12 ) ; and SoilNet for multimodal hierarchical classification of soil horizons ( 6 ) . These efforts demonstrate the growing importance of multimodal and multi-source data in agriculture and environmental modeling. However, where soil information is included, it is typically represented by a small set of core attributes, such as soil type, texture, bulk density, or selected chemical properties, and serves mainly as task-specific context rather than as a basis for soil-centered representation learning across high-dimensional soil–environment features. Collectively, existing soil datasets are either spatially comprehensive but low-dimensional and model-derived, or observation-based but fragmented and heterogeneous. There remains a lack of datasets that support high-dimensional representation learning of soil systems, where a large number of interdependent variables with uneven coverage are modeled jointly to capture the intrinsic complexity of soils. Related efforts in other data-intensive scientific domains provide useful precedents, such as FLUXNET ( 36 ) for environmental monitoring networks and MIMIC ( 22 ) for healthcare. To address these gaps in soil science, we introduce LUCAS-MEGA , a large-scale multimodal dataset for soil systems constructed through systematic data fusion of European soil–environment observations. Our dataset uses the LUCAS soil survey as its primary backbone, augmented with additional sources including SPADE/M

Read the complete text