土壤2024,Vol.56Issue(6):1156-1164,9.DOI:10.13758/j.cnki.tr.2024.06.002
土壤大数据体系构建及应用
Soil Big Data Architecture:Construction and Practical Applications
摘要
Abstract
Plenty of structured,unstructured and semi-structured soil-related data have been accumulated in China,but they are from multiple sources with varied structures and stored dispersedly and disorderly.In the age of big data and artificial intelligence,in order to satisfy with the requirements of soil data mining and application,it is urgent to construct soil big data architecture.In this study,based on concepts and cutting-edge technologies of big data,data lake and data warehouse,the approaches to construct soil big data architecture were proposed,including technologies on soil-related data acquisition and preprocessing,unstructured data processing,algorithms and models.Then,soil data storage scheme was built through data lake and warehouse,and soil data sharing and serving schemes were realized with the support of data catalog management.Meanwhile,soil big data have been used in soil data service,intelligent control of contaminated sites and mining soil ecological patterns.Finally,the potentials of soil big data were discussed in the usage of construction of the database of third national soil census and prospects for the application in data-driven soil researches.关键词
土壤大数据/大数据体系/湖仓一体化/全国土壤三普/土壤污染Key words
Soil big data/Big data architecture/Lakehouse integration/The third national soil condition census/Soil pollution分类
农业科技引用本文复制引用
刘杰,郏梦思,王昌昆,郭志英,孙维维,马海艺,袁自然,潘贤章..土壤大数据体系构建及应用[J].土壤,2024,56(6):1156-1164,9.基金项目
国家重点研发计划项目(2020YFC1807401)、国家科技基础资源调查专项项目(2021FY100703)和中国科学院网信专项项目(CAS-WX2022SF-0201)资助. (2020YFC1807401)