SoilGrids250m: Global gridded soil information based on machine learning.

Hengl T, Mendes de Jesus J, Heuvelink GB, Ruiperez Gonzalez M, Kilibarda M, Blagotić A, Shangguan W, Wright MN, Geng X, Bauer-Marschallinger B, Guevara MA, Vargas R, MacMillan RA, Batjes NH, Leenaars JG, Ribeiro E, Wheeler I, Mantel S, Kempen B. · 2017

Read SoilGrids250m: Global gridded soil information based on machine learning. by Hengl T, Mendes de Jesus J, Heuvelink GB, Ruiperez Gonzalez M, Kilibarda M, Blagotić A, Shangguan W, Wright MN, Geng X, Bauer-Marschallinger B, Guevara MA, Vargas R, MacMillan RA, Batjes NH, Leenaars JG, Ribeiro E, Wheeler I, Mantel S, Kempen B. (2017) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc5313206.txt.

Introduction

Tomislav Hengl led a large team in building a world soil map in PLoS ONE in 2017. Soil data used to come only in coarse maps with weak accuracy. Farmers, climate models, and land planners all need finer detail. The SoilGrids system aims to fill that gap with computer models trained on real soil samples from around the world.

The new maps split the world into squares of two hundred and fifty meters. They predict carbon, density, acidity, sand and clay shares, and more, at seven depths down to two meters. The models learned from about one hundred and fifty thousand soil profiles and a stack of satellite and climate layers. Cross checks showed the models explained a good share of the spread in each trait. The maps are far sharper and more accurate than the older one kilometer version.

Catalog record

CREATORHengl T, Mendes de Jesus J, Heuvelink GB, Ruiperez Gonzalez M, Kilibarda M, Blagotić A, Shangguan W, Wright MN, Geng X, Bauer-Marschallinger B, Guevara MA, Vargas R, MacMillan RA, Batjes NH, Leenaars JG, Ribeiro E, Wheeler I, Mantel S, Kempen B.
YEAR2017
COLLECTIONPAPERS
FORMATTXT
FILE SIZE91 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC5313206

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SoilGrids250m: Global gridded soil information based on machine learning By Tomislav Hengl, Jorge Mendes de Jesus, Gerard B. M. Heuvelink, Maria Ruiperez Gonzalez, Milan Kilibarda, Aleksandar Blagotić, Wei Shangguan, Marvin N. Wright, Xiaoyuan Geng, Bernhard Bauer-Marschallinger, Mario Antonio Guevara, Rodrigo Vargas Published in: PLoS ONE DOI: 10.1371/journal.pone.0169748 ABSTRACT This paper describes the technical development and accuracy assessment of the most recent and improved version of the SoilGrids system at 250m resolution (June 2016 update). SoilGrids provides global predictions for standard numeric soil properties (organic carbon, bulk density, Cation Exchange Capacity (CEC), pH, soil texture fractions and coarse fragments) at seven standard depths (0, 5, 15, 30, 60, 100 and 200 cm), in addition to predictions of depth to bedrock and distribution of soil classes based on the World Reference Base (WRB) and USDA classification systems (ca. 280 raster layers in total). Predictions were based on ca. 150,000 soil profiles used for training and a stack of 158 remote sensing-based soil covariates (primarily derived from MODIS land products, SRTM DEM derivatives, climatic images and global landform and lithology maps), which were used to fit an ensemble of machine learning methods—random forest and gradient boosting and/or multinomial logistic regression—as implemented in the R packages ranger, xgboost, nnet and caret. The results of 10–fold cross-validation show that the ensemble models explain between 56% (coarse fragments) and 83% (pH) of variation with an overall average of 61%. Improvements in the relative accuracy considering the amount of variation explained, in comparison to the previous version of SoilGrids at 1 km spatial resolution, range from 60 to 230%. Improvements can be attributed to: (1) the use of machine learning instead of linear regression, (2) to considerable investments in preparing finer resolution covariate layers and (3) to insertion of additional soil profiles. Further development of SoilGrids could include refinement of methods to incorporate input uncertainties and derivation of posterior probability distributions (per pixel), and further automation of spatial modeling so that soil maps can be generated for potentially hundreds of soil variables. Another area of future research is the development of methods for multiscale merging of SoilGrids predictions with local and/or national gridded soil products (e.g. up to 50 m spatial resolution) so that increasingly more accurate, complete and consistent global soil information can be produced. SoilGrids are available under the Open Data Base License. INTRODUCTION There is a growing demand for detailed soil information, especially for global estimation of soil organic carbon [1–3] and for modeling agricultural productivity [4, 5]. Spatial information about soil water parameters is likely to become increasingly critical in areas affected by climate change [6]. Soils and soil information are also particularly relevant for the Sustainable Development goal target 15.3 of achieving Land Degradation Neutrality (LDN), as specified by the United Nations Convention to Combat Desertification (UNCCD; http://www.unccd.int), and are one of the main areas of interest of the FAO’s Global Soil Partnership initiative [7]. Folberth et al. [8] have recently discovered that accurate soil information might be the key to predicting either buffering or amplifying impacts of climate change on food production. To reduce the gap between soil data demand and availability, ISRIC (International Soil Reference Information Centre)—World Soil Information released a Global Soil Information system called “SoilGrids”. The first version of SoilGrids (predictions at 1 km spatial resolution released in 2014), was, at the time, a ‘proof of concept’ demonstrating that global compilations of soil profiles can be used in an automated framework to produce complete and consistent spatial predictions of soil properties and classes [9]. Since the launch of the system in 2014, several colleagues have recognized and reported some of the limitations of the first version of the system. Mulder et al. [10] observed, using more detailed soil profile data and maps, that SoilGrids likely overestimated all low values for organic carbon content in France. Likewise, Griffiths et al. [11] reported underestimation of the pH in comparison to UK national data. The overestimation of low values happened mainly as an effect of limited fitting success (so that both high and low values are smoothed out). In addition, many of the artifacts visible in the Harmonized World Soil Database (HWSD) [12], which was used as one of the covariates to produce the first version of SoilGrids, e.g. country borders, were propagated to SoilGrids1km. Some users have also expressed concerns that the first version of SoilGrids did not provide predictions for arid and desert areas and hence can be considered an incomplete product [13]. To address these criticisms and concerns, we have re-designed and re-implemented SoilGrids with a particular emphasis on addressing methodological limitations of SoilGrids1km. Hence, our main objective was to build a more robust system with improved output data quality; especially considering spatial detail and attribute accuracy of spatial predictions. We implemented the following six key improvements: - We replaced linear models with tree-based, non-linear machine learning models to account for non-linear relationships—especially for modeling soil property–depth relationships—but also to be able to better represent local soil–covariate relationships. Predictions are now primarily data-driven. Much less time is spent on choosing models, which also reduces the complexity of producing updates. - We replaced single prediction models with an ensemble framework i.e. we use at least two methods for each soil variable to reduce overshooting effects. - We extended the initial list of covariates to include a wider diversity of MODIS land products and to better represent factors of soil formation. The spatial resolution of covariates was increased from 1 km to 250 m with the expectation that finer resolution will help increase the prediction accuracy. - We re-implemented the global soil mask using state-of-the-art land cover products [14]. The current soil mask now includes all previously excluded dryland and sand dune areas so that most of the land mask (> 95%) is represented. - The global compilation of soil profiles and samples used for model training was also extended. We added extra points for the Russian Federation, Brazil, Mexico and the Arctic circle; and re-visited data harmonization issues. - We created and inserted expert-based pseudo-points for a selection of parameters to minimize extrapolation effects in undersampled geographic areas lacking field observations, such as deserts, semi-deserts, glaciers and permafrost areas. We present here the technical development and accuracy assessment of the updated SoilGrids system at 250 m resolution. In the following sections we describe the workflows used to generate spatial predictions and report results of model fitting and accuracy assessment based on 10–fold cross-validation. We conclude the article by suggesting some possible applications of this new data set and identifying possible future improvements. SoilGrids250m map layers are available for download via www.SoilGrids.org under the Open Database License (ODbL). GeoTiffs can also be obtained from ftp://ftp.soilgrids.org/data/. METHODS AND MATERIALS Target variables SoilGrids provides predictions for the following list of standard soil properties and classes [9]: - Soil organic carbon content in ‰ (g kg−1), - Soil pH in H2O and KCl solution, - Sand, silt and clay (weight %), - Bulk density (kg m−3) of the fine earth fraction (< 2 mm), - Cation-exchange capacity (cmol + /kg) of the fine earth fraction, - Coarse fragments (volumetric %), - Depth to bedrock (cm) and occurrence of R horizon, - World Reference

Read the complete text