Soil & Water Res., 2023, 18(1):43-54 | DOI: 10.17221/97/2022-SWR
Prediction of the soil organic carbon in the LUCAS soil database based on spectral clusteringOriginal Paper
- 1 School of Automation, Hangzhou Dianzi University, Hangzhou, P.R. China
The estimation of the level of the soil organic carbon (SOC) content plays an important role in assessing the soil health state. Visible and Near Infrared Diffuse Reflectance Spectroscopy (Vis-NIR DRS) is a fast and cheap tool for measuring the SOC. However, when this technology is applied on a larger area, the soil prediction accuracy decreases due to the heterogeneity of the samples. In this paper, we first investigate the global model performance in the LUCAS EU-wide topsoil database. Then, different clustering strategies were tested, including the k-means clustering based on the principal component analysis (PCA) and hierarchical clustering, combined with the partial least squares regression (PLSR) models, and a clustering based on a local PLSR approach. The best validation results were obtained for the local PLSR approach with R2 = 0.75, root mean squared error of prediction (RMSEP) = 13.38 g/kg and ratio of performance to interquartile range (RPIQ) = 2.846, but the algorithm running time was 30.05 s. Similar results were obtained for the k-means clustering method with R2 = 0.75, RMSEP = 14.61 g/kg and RPIQ = 2.844, at only 4.52 s. This study demonstrates that the PLSR approach based on k-means clustering is able to achieve similar prediction accuracy as the local PLSR approach, while significantly improving the algorithm speed. This provides the theoretical basis for adapting the spectral soil model to the needs of real-time SOC quantification.
Keywords: cluster analysis; regression analysis; retrieve; soil properties; Vis-NIR spectroscopy
Received: July 1, 2022; Accepted: December 16, 2022; Prepublished online: January 23, 2023; Published: February 8, 2023 Show citation
References
- Araújo S., Wetterlind J., Demattê J., Stenberg B. (2014): Improving the prediction performance of a large tropical vis-NIR spectroscopic soil library from Brazil by clustering into smaller subsets or use of data mining calibration techniques. European Journal of Soil Science, 65: 718-729.
Go to original source...
- Baumgardner M.F., Silva L., Biehl L.L., Stoner E.R. (1986): Reflectance properties of soils. Advances in Agronomy, 38: 1-44.
Go to original source...
- Bellon-Maurel V., McBratney A. (2011): Near-infrared (NIR) and mid-infrared (MIR) spectroscopic techniques for assessing the amount of carbon stock in soils critical review and research perspectives. Soil Biology and Biochemistry, 43: 1398-1410.
Go to original source...
- Ben-Dor E., Irons J.R., Epema G. (1999): Soil reflectance. In: Rencz A.N. (ed.): Remote Sensing for the Earth Science. New York, Wiley: 111-188.
- Brown D.J., Bricklemyer R.S., Miller P.R. (2005): Validation requirements for diffuse reflectance soil characterization models with a case study of VNIR soil C prediction in Montana. Geoderma, 129: 251-267.
Go to original source...
- Conant R.T., Ogle S.M., Paul E.A., Paustian K. (2010): Measuring and monitoring soil organic carbon stocks in agricultural lands for climate mitigation. Frontiers in Ecology and the Environment, 9: 169-173.
Go to original source...
- Dalal R.C., Henry R.J. (1986): Simultaneous determination of moisture, organic carbon, and total nitrogen by near infrared reflectance spectrophotometry. Soil Science Society of America Journal, 50: 120-123.
Go to original source...
- Davies T. (2005): An introduction to near infrared spectroscopy. NIR News, 16: 9-11.
Go to original source...
- Islam K., Singh B., McBratney A. (2003): Simultaneous estimation of several soil properties by ultra-violet, visible, and near-infrared reflectance spectroscopy. Soil Research, 41: 1101-1114.
Go to original source...
- Jones A., Fernandez-Ugalde O., Scarpa S (2020): LUCAS 2015 Topsoil Survey. Presentation of Dataset and Results, EUR 30332 EN, Luxembourg, Publications Office of the European Union.
- Kennard R.W., Stone L.A. (1969): Computer aided design of experiments. Technometrics, 11: 137-148.
Go to original source...
- Kibblewhite M.G., Miko L., Montanarella L. (2012): Legal frameworks for soil protection: Current development and technical information requirements. Current Opinion in Environmental Sustainability, 4: 573-577.
Go to original source...
- Lal R. (2004): Soil carbon sequestration impacts on global climate change and food security. Science, 304: 1623-1627.
Go to original source...
Go to PubMed...
- Nocita M., Stevens A., Toth G., Panagos P., van Wesemael B., Montanarella L. (2014): Prediction of soil organic carbon content by diffuse reflectance spectroscopy using a local partial least square regression approach. Soil Biology and Biochemistry, 68: 337-347.
Go to original source...
- Orgiazzi A., Ballabio C., Panagos P., Jones A., Fernández-Ugalde O. (2017): LUCAS soil, the largest expandable soil dataset for Europe: A review. European Journal of Soil Science, 69: 140-153.
Go to original source...
- Ramirez-Lopez L., Behrens T., Schmidt K., Stevens A., Demattê J.A.M., Scholten T. (2013): The spectrum-based learner: A new local approach for modeling soil vis-NIR spectra of complex datasets. Geoderma, 195 (Supplement C): 268-279.
Go to original source...
- Sanchez P.A., Ahamed S., Carré F., Hartemink A.E., Hempel J., Huising J., Lagacherie P., McBratney A.B., McKenzie N.J., de Lourdes Mendonça-Santos M. (2009): Digital soil map of the world. Science, 325: 680-681.
Go to original source...
Go to PubMed...
- Savitzky A., Golay M.J.E. (1964): Smoothing and differentiation of data by simplified least squares procedures. Analysis Chemistry, 36: 1627-1639.
Go to original source...
- Shepherd K.D., Walsh M.G. (2002): Development of reflectance spectral libraries for characterization of soil properties. Soil Science Society of America Journal, 66: 988-998.
Go to original source...
- Stevens A., Nocita M., Tóth G., Montanarella L., van Wesemael B. (2013): Prediction of soil organic carbon at the European scale by visible and near infrared reflectance spectroscopy. PLoS ONE, 8: e66409.
Go to original source...
Go to PubMed...
- Stenberg B., Viscarra Rossel R.A., Mouazen A.M., Wetterlind J. (2010): Visible and near infrared spectroscopy in soil science. Advances in Agronomy, 107: 163-215.
Go to original source...
- Tóth G., Jones A., Montanarella L. (2013): LUCAS Topsoil Survey: Methodology, Data and Results. JRC Technical Reports. EUR26102-Scientific and Technical Research Series. Luxembourg, Publications Office of the European Union.
- Viscarra Rossel R., Behrens T. (2010): Using data mining to model and interpret soil diffuse reflectance spectra. Geoderma, 158: 46-54.
Go to original source...
- Viscarra Rossel R.A., Walvoort D.J.J., McBratney A.B., Janik L.J., Skjemstad J.O. (2006): Visible, near infrared, mid infrared or combined diffuse reflectance spectroscopy for simultaneous assessment of various soil properties. Geoderma, 131: 59-75.
Go to original source...
- Viscarra Rossel R., Behrens T., Ben-Dor E., Brown D., Demattê J., Shepherd K., Shi Z., Stenberg B., Stevens A., Adamchuk V. (2016): A global spectral library to characterize the world's soil. Earth Science Reviews, 155: 198-230.
Go to original source...
- Ward K.J., Chabrillat S., Neumann C., Foerster S. (2019): A remote sensing adapted approach for soil organic carbon prediction based on the spectrally clustered LUCAS soil database. Geoderma, 353: 297-307.
Go to original source...
- Ward K.J., Chabrillat S., Brell M., Castaldi F., Spengler D., Foerster S. (2020): Mapping soil organic carbon for airborne and simulated EnMAP imagery using the LUCAS soil database and a local PLSR. Remote Sensing, 12: 3451.
Go to original source...
- Wishart D (1969): Note: An algorithm for hierarchical classifications. Biometrics, 25: 165-170.
Go to original source...
- Wold S., Sjöström M., Eriksson L. (2001): PLS-regression: A basic tool of chemometrics. Chemometrics and Intelligent Laboratory, 58: 109-130.
Go to original source...
This is an open access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International (CC BY NC 4.0), which permits non-comercial use, distribution, and reproduction in any medium, provided the original publication is properly cited. No use, distribution or reproduction is permitted which does not comply with these terms.