摘要
Abstract
With the explosive growth of data volume in the era of the digital economy,data platforms are facing increasing challenges in data storage,processing,and calculation.This paper proposes multiple Data Lakes under a unified Data Middle Platform,which is applied in industrial big data.The architecture,based on the integration of lake and warehouse technology,aims to build an efficient,flexible,and scalable data management platform to support cross-level,cross-organizational,and cross-regional data-sharing applications.With the centralized deployment of the three-level data lake and the middle platform deployed uniformly,the five core functions are constructed,forming the data acquisition capabilities of multi-source heterogeneous data,multi-mode data storage,data processing,data governance,data service,and data security protection.Through multi-data-lakes,collaborative interaction,and unified data control ability,to realize the overall management and open sharing of data of super-large group companies,application scenarios in various business fields are supported,and the value of data elements is released.关键词
数据湖/湖仓一体/数据中台/工业大数据/数据治理/数据服务Key words
Data Lake/Lakehouse/data middle platform/industrial big data/data governance/data service分类
信息技术与安全科学