Development of Hungarian spectral library: Prediction of soil properties and applications

Abstract

Updating soil information systems (SIS) requires advanced technologies to support the time and cost-effective and environment-friendly soil data. The use of mid- infrared (MIR) Spectroscopy as alternative to wet chemistry has been tested. The MIR spectral library is a useful technique for predicting soil attributes with high accuracy, efficiency, and low cost. The Hungarian MIR spectral library contained data on 2200 soil samples from 10 counties representing the first Soil Information and Mentoring System (SIMS) survey. Archived soil samples were prepared and scanned based on Diffuse Reflectance Infrared spectroscopy (DRIFT) technique and spectra data were saved in the fourier transform infrared (FTIR) spectrometer OPUS software. Preprocessed filtering methods, outlier detection methods and calibration sample selection methods were applied for spectral library. MIR calibration models were built for soil attributes using Partial Least Square Regression (PLSR) method. Coefficient determination (R2), The Root Mean Squared Error (RMSE) and Ratio of Performance to Deviation (RPD) were used to assess the goodness of calibration and validation models. MIR spectral library had the ability to significantly estimate soil properties such as SOC, CaCO3, sand, clay and silt through various scale models (national, county and soil type). The findings showed that our spectral library soil estimations are precise enough to provide information on national, county and soil type levels enabling a wide range of soil applications that demand huge amounts of data such as soil survey, precision agriculture and digital soil mapping.

Keywords

• Fourier-transform infrared spectroscopy
• mid-infrared spectroscopy
• partial least square regression
• soil information system

References

1. Baumann, P., Helfenstein, A., Gubler, A., Keller, A., Meuli, R.G., Wächter, D., Lee, J., Viscarra Rossel, R., Six, J., 2021. Developing the Swiss mid-infrared soil spectral library for local estimation and monitoring. Soil 7(2): 525–546.
2. Bullock, P., Montanarella, L., 1987. Soil information : Uses and needs in Europe. European Soil Bureau Research Report No.9, pp. 397–417.
3. Burns, D.A., Ciurczak, E.W., 2007. Handbook of Near-Infrared Analysis. CRC Press, Boca Raton, 814p.
4. D’Acqui, L.P., Pucci, A., Janik, L.J., 2010. Soil properties prediction of western Mediterranean islands with similar climatic environments by means of mid-infrared diffuse reflectance spectroscopy. European Journal of Soil Science 61(6): 865–876.
5. Demattê, J.A.M., Dotto, A.C., Bedin, L.G., Sayão, V.M., Souza, A.B., 2019. Soil analytical quality control by traditional and spectroscopy techniques: Constructing the future of a hybrid laboratory for low environmental impact. Geoderma 337: 111–121.
6. Demattê, J.A.M., Dotto, A.C., Paiva, A.F.S., Sato, M.V., Dalmolin, R.S.D., de Araújo, M.S.B., da Silva, E.B., Nanni, M.R., ten Caten, A., Noronha, N.C., Lacerda, M.P.C., de Araújo Filho, J.C., Rizzo, R., Bellinaso, H., Francelino, M.R., Schaefer, C.E.G.R., Vicente, L.E., dos Santos, U.J., de Sá Barretto Sampaio, E.V., Menezes, R.S.C., de Souza, J.J.L.L., Abrahão, W.A.P., Coelho, P.M., Grego, C.R., Lani, J.L., Fernandes, A.R., Gonçalves, D.A.M., Silva, S.H.G., de Menezes, M.D., Curi, N.C., Couto, E.G., dos Anjos, L.H.C., Ceddia, M.B., Pinheiro, E.F.M., Grunwald, S.G., Vasques, G.M., Júnior, J.M., da Silva, A.J., de Vasconcelos Barreto, M.J., Nóbrega, G.N., da Silva, M.Z., de Souza, S.F., Valladares, G.S., Viana, J.H.M., da Silva Terra, F., Horák-Terra, I., Fiorio, P.R., da Silva, R.C., Júnior, E.F.F., Lima, R.H.C., Alba, J.M.F., de Souza Junior, V.S., Brefin, M.L.M.S., Ruivo, M.L.P., Ferreira, T.O., Brait, M.A., Caetano, N.R., Bringhenti, I., Mendes, W.S., Safanelli, J.L., Guimarães, C.C.B., Poppiel, R.R., Souza, A.B., Quesada, C.A., do Couto, H.T.Z., 2019. The Brazilian Soil Spectral Library (BSSL): A general view, application and challenges. Geoderma 354: 113793.
7. Deng, F., Minasny, B., Knadel, M., McBratney, A., Heckrath, G., Greve, M.H., 2013. Using Vis-NIR spectroscopy for monitoring temporal changes in soil organic carbon. Soil Science 178(8): 389–399.
8. Dickens, A.A.. 2014. Standard operating procedures. Method for analysing samples for spectral characteristics in mid IR range using alpha. Code: METH07V02. World Agroforestry Centre, Nairobi, Kenya.

9. Grunwald, S., Thompson, J.A., Boettinger, J.L., 2011. Digital soil mapping and modeling at continental scales: Finding solutions for global issues. Soil Science Society of America Journal 75(4): 1201–1213.
10. Guerrero, C., Wetterlind, J., Stenberg, B., Mouazen, A.M., Gabarrón-Galeote, M.A., Ruiz-Sinoga, J.D., Zornoza, R., Viscarra Rossel, R.A., 2016. Do we really need large spectral libraries for local scale SOC assessment with NIR spectroscopy? Soil and Tillage Research 155: 501–509.
11. Janik, L.J., Merry, R.H., Forrester, S.T., Lanyon, D.M., Rawson, A., 2007. Rapid prediction of soil water retention using mid infrared spectroscopy. Soil Science Society of America Journal 71(2): 507–514.
12. Janik, L.J., Merry, R.H., Skjemstad, J.O., 1998. Can mid infrared diffuse reflectance analysis replace soil extractions? Australian Journal of Experimental Agriculture 38(7): 681–696.
13. Janik, L.J., Skjemstand, J.O., Raven, M.D., 1995. Characterization and analysis of soils using mid-infrared partial least squares. I. correlations with xrf-determined major element composition. Australian Journal of Soil Research 33(4): 621–636.
14. Johnson, J.M., Vandamme, E., Senthilkumar, K., Sila, A., Shepherd, K.D., Saito, K., 2019. Near-infrared, mid-infrared or combined diffuse reflectance spectroscopy for assessing soil fertility in rice fields in sub-Saharan Africa. Geoderma 354: 113840.
15. Kaiser, M., Walter, K., Ellerbrock, R.H., Sommer, M., 2011. Effects of land use and mineral characteristics on the organic carbon content, and the amount and composition of Na-pyrophosphate-soluble organic matter, in subsurface soils. European Journal of Soil Science 62(2): 226–236.
16. Kasprzhitskii, A., Lazorenko, G., Khater, A., Yavna, V., 2018. Mid-infrared spectroscopic assessment of plasticity characteristics of clay soils. Minerals 8(5): 184.
17. Kennard, R.W., Stone, L.A., 1969. Computer Aided Design of Experiments. Technometrics 11(1): 137-148.
18. Knox, N.M., Grunwald, S., McDowell, M.L., Bruland, G.L., Myers, D.B., Harris, W.G., 2015. Modelling soil carbon fractions with visible near-infrared (VNIR) and mid-infrared (MIR) spectroscopy. Geoderma 239–240: 229–239.
19. Lorber, A., Wangen, L.E., Kowalski, B.R., 1987. A theoretical foundation for the PLS algorithm. Journal of Chemometrics 1(1): 19–31.
20. Max, K., Weston, S., Keefer, C., Engelhardt, A., Cooper, T., Mayer, Z., Kenkel, B., Team, R. C., Benesty, M., Lescarbeau, R., Ziem, A., Scrucca, L., Tang, Y., Candan, C., 2016. Caret: classification and regression training. R package version 6.0-71. Available at [Access date : 26.01.2023]: https://CRAN.R-project.org/package=caret
21. Liland, K.H., Mevik, B.H., Wehrens, R., Hiemstra, P., 2016. Partial least squares and principal component regression. CRAN, 66p. Available at [Access date : 26.01.2023]: https://cran.r-project.org/web/packages/pls/pls.pdf
22. Minasny, B., McBratney, A.B., 2006. A conditioned Latin hypercube method for sampling in the presence of ancillary information. Computers and Geosciences 32(9): 1378–1388.
23. Minasny, B., McBratney, A.B., 2008. Regression rules as a tool for predicting soil properties from infrared reflectance spectroscopy. Chemometrics and Intelligent Laboratory Systems 94(1): 72–79.
24. Næs, T., 1987. The design of calibration in near infra-red reflectance analysis by clustering. Journal of Chemometrics 1(2): 121–134.
25. Nash, D.B., 1986. Mid-infrared reflectance spectra (23–22 μm) of sulfur, gold, KBr, MgO, and halon. Applied Optics 25(14): 2427-2433.
26. Ng, W., Minasny, B., Jeon, S.H., McBratney, A., 2022. Mid-infrared spectroscopy for accurate measurement of an extensive set of soil properties for assessing soil functions. Soil Security 6: 100043.
27. Nguyen, T.T., Janik, L.J., Raupach, M., 1991. Diffuse reflectance infrared fourier transform (Drift) spectroscopy in soil studies. Australian Journal of Soil Research 29(1): 49–67.
28. Nocita, M., Stevens, A., van Wesemael, B., Aitkenhead, M., Bachmann, M., Barthès, B., Dor, E. Ben, Brown, D. J., Clairotte, M., Csorba, A., Dardenne, P., Demattê, J. A. M., Genot, V., Guerrero, C., Knadel, M., Montanarella, L., Noon, C., Ramirez-Lopez, L., Robertson, J., Sakai, H., Soriano-Disla, J.M., D. Shepherd, K.D., Stenberg, B., Towett, E.K., Vargas, R., Wetterlind, J., 2015. Soil Spectroscopy: An Alternative to Wet Chemistry for Soil Monitoring. In: Advances in Agronomy. Sparks, D.L. (Ed.). Vol. 132, pp. 139–159.
29. Pásztor, L., Laborczi, A., Takács, K., Szatmári, G., Dobos, E., Illés, G., Bakacsi, Z., Szabó, J., 2015. Compilation of novel and renewed, goal oriented digital soil maps using geostatistical and data mining tools. Hungarian Geographical Bulletin 64(1): 49–64.
30. Pirie, A., Singh, B., Islam, K., 2005. Ultra-violet, visible, near-infrared, and mid-infrared diffuse reflectance spectroscopic techniques to predict several soil properties. Australian Journal of Soil Research 43(6): 713–721.
31. R Core Team, 2022. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. Available at [Access date : 26.01.2023]: https://www.R-project.org/
32. Ramirez-Lopez, L., Behrens, T., Schmidt, K., Stevens, A., Demattê, J.A.M., Scholten, T., 2013. The spectrum-based learner: A new local approach for modeling soil vis–NIR spectra of complex datasets. Geoderma 195–196: 268–279.
33. Raphael, L., 2011. Application of FTIR spectroscopy to agricultural soils analysis. In: Fourier Transforms - New Analytical Approaches and FTIR Strategies. Nikolic, G. (Ed.). InTech. pp. 385-404.
34. Reeves, J.B., Smith, D.B., 2009. The potential of mid- and near-infrared diffuse reflectance spectroscopy for determining major- and trace-element concentrations in soils from a geochemical survey of North America. Applied Geochemistry 24(8): 1472–1481.
35. Rossel, R.A.V., Behrens, T., 2010. Using data mining to model and interpret soil diffuse reflectance spectra. Geoderma 158(1–2): 46–54.
36. Rossel, R.A.V., Webster, R., 2012. Predicting soil properties from the Australian soil visible-near infrared spectroscopic database. European Journal of Soil Science 63(6): 848–860.
37. Rossel, R.A.V., Jeon, Y.S., Odeh, I.O.A., McBratney, A.B., 2008. Using a legacy soil sample to develop a mid-IR spectral library. Australian Journal of Soil Research 46(1): 1–16.
38. Sanderman, J., Savage, K., Dangal, S.R.S., 2020. Mid-infrared spectroscopy for prediction of soil health indicators in the United States. Soil Science Society of America Journal 84(1): 251–261.
39. Savitzky, A., Golay, M.J.E., 1964. Smoothing and differentiation of data by simplified least squares procedures. Analytical Chemistry 36(8): 1627–1639.
40. Seybold, C.A., Ferguson, R., Wysocki, D., Bailey, S., Anderson, J., Nester, B., Schoeneberger, P., Wills, S., Libohova, Z., Hoover, D., Thomas, P., 2019. Application of mid‐infrared spectroscopy in soil survey. Soil Science Society of America Journal 83(6): 1746–1759.
41. Shepherd, K.D., Walsh, M.G., 2002. Development of reflectance spectral libraries for characterization of soil properties. Soil Science Society of America Journal 66(3): 988–998.
42. Shepherd, K.D., Walsh, M.G., 2005. Diffuse Reflectance Spectroscopy for Rapid Soil Analysis. In: Encyclopedia of Soil Science. Lal, R. (Ed.). Marcel Dekker, Inc.: Boca Raton, FL, USA
43. Shepherd, K.D., Walsh, M.G., 2007. Infrared spectroscopy—enabling an evidence-based diagnostic surveillance approach to agricultural and environmental management in developing countries. Journal of Near Infrared Spectroscopy 15(1): 1–19.
44. Siebielec, G., McCarty, G.W., Stuczynski, T.I., Reeves, J.B., 2004. Near- and mid-infrared diffuse reflectance spectroscopy for measuring soil metal content. Journal of Environmental Quality 33(6): 2056–2069.
45. Sila, A., Pokhariyal, G., Shepherd, K., 2017. Evaluating regression-kriging for mid-infrared spectroscopy prediction of soil properties in western Kenya. Geoderma Regional 10: 39–47.
46. Skjemstad, J.O., Dalal, R.C., 1987. Spectroscopic and chemical differences in organic matter of two vertisols subjected to long periods of cultivation. Australian Journal of Soil Research 25(3): 323–335.
47. Soriano-Disla, J.M., Janik, L.J., Viscarra Rossel, R.A., MacDonald, L.M., McLaughlin, M.J., 2014. The performance of visible, near-, and mid-infrared reflectance spectroscopy for prediction of soil physical, chemical, and biological properties. Applied Spectroscopy Reviews 49(2): 139–186.
48. Stenberg, B., Viscarra Rossel, R.A., Mouazen, A.M., Wetterlind, J., 2010. Visible and near infrared spectroscopy in soil science. In: Advances in Agronomy. Sparks, D.L. (Ed.). Vol. 107, pp. 163–215.
49. Stevens, A., Nocita, M., Tóth, G., Montanarella, L., van Wesemael, B., 2013. Prediction of soil organic carbon at the European scale by visible and near infrared reflectance spectroscopy. PLoS ONE 8(6): e66409.
50. Terhoeven-Urselmans, T., Vagen, T.G., Spaargaren, O., Shepherd, K.D., 2010. Prediction of soil fertility properties from a globally distributed soil mid-infrared spectral library. Soil Science Society of America Journal 74(5): 1792–1799.
51. Terra, F.S., Demattê, J.A.M., Viscarra Rossel, R.A., 2015. Spectral libraries for quantitative analyses of tropical Brazilian soils: Comparing vis-NIR and mid-IR reflectance data. Geoderma 255–256: 81–93.
52. TIM, 1995. Soil Conservation and Monitoring System. Ministry of Agriculture. Budapest, Hungary. Unpublished Report. [in Hungarian]
53. Tinti, A., Tugnoli, V., Bonora, S., Francioso, O., 2015. Recent applications of vibrational mid-Infrared (IR) spectroscopy for studying soil components: a review. Journal of Central European Agriculture 16(1): 1–22.
54. Varmuza, K., Filzmoser, P., 2016. Introduction to multivariate statistical analysis in chemometrics. CRC Press. Boca Raton, 336p.
55. Viscarra Rossel, R.A., Behrens, T., Ben-Dor, E., Brown, D.J., Demattê, J.A.M., Shepherd, K.D., Shi, Z., Stenberg, B., Stevens, A., Adamchuk, V., Aïchi, H., Barthès, B.G., Bartholomeus, H.M., Bayer, A.D., Bernoux, M., Böttcher, K., Brodský, L., Du, C.W., Chappell, A., Fouad, Y., Genot, V., Gomez, C., Grunwald, S., Gubler, A., Guerrero, C., Hedley, C.B., Knadel, M., Morrás, H.J.M., Nocita, M., Ramirez-Lopez, L., Roudier, P., Rufasto Campos, E.M., Sanborn, P., Sellitto, V.M., Sudduth, K.A., Rawlins, B.G., Walter, C., Winowiecki, L.A., Hong, S.Y., Ji, W. , 2016. A global spectral library to characterize the world’s soil. Earth-Science Reviews 155: 198–230.
56. Viscarra Rossel, R.A., Walvoort, D.J.J., McBratney, A.B., Janik, L.J., Skjemstad, J.O., 2006. Visible, near infrared, mid infrared or combined diffuse reflectance spectroscopy for simultaneous assessment of various soil properties. Geoderma 131(1–2): 59–75.
57. Wadoux, A., Malone, B., Minasny, B., Fajardo, M., Mcbratney, A.B., 2020. Soil spectral inference with R: Analysing digital soil spectra using the R programming environment. Springer Cham. 247p.
58. Waruru, B.K., Shepherd, K.D., Ndegwa, G.M., Kamoni, P.T., Sila, A.M., 2014. Rapid estimation of soil engineering properties using diffuse reflectance near infrared spectroscopy. Biosystems Engineering 121: 177–185.
59. Waruru, B.K., Shepherd, K.D., Ndegwa, G.M., Sila, A., Kamoni, P.T., 2015. Application of mid-infrared spectroscopy for rapid characterization of key soil properties for engineering land use. Soils and Foundations 55(5): 1181–1195.
60. Wijewardane, N. K., Ge, Y., Wills, S., Loecke, T., 2016. Prediction of soil carbon in the conterminous United States: visible and near infrared reflectance spectroscopy analysis of the rapid carbon assessment project. Soil Science Society of America Journal 80(4): 973–982.
61. Wijewardane, N.K., Ge, Y., Wills, S., Libohova, Z., 2018. Predicting physical and chemical properties of US soils with a mid-infrared reflectance spectral library. Soil Science Society of America Journal 82(3): 722–731.
62. Wold, S., Sjöström, M., Eriksson, L., 2001. PLS-regression: a basic tool of chemometrics. Chemometrics and Intelligent Laboratory Systems 58(2): 109–130.