|国家科技期刊平台
首页|期刊导航|气象研究与应用|基于"云+端"长序列结构化数据处理应用设计与实现

基于"云+端"长序列结构化数据处理应用设计与实现OA

Design and implementation of long sequential structured data processing application based on"cloud-edge"

中文摘要英文摘要

为提升长序列地面观测数据统计和处理支撑能力,加快关键业务平台"云+端"云化转型,基于"天擎"资源数据环境和云化融入标准,通过直连库方式搭建加工流水线定时任务处理流程,采用SpringBoot+Mybatis框架研制众创接口提供数据实时查询服务,数据处理流程监视和告警纳入"天镜"管理,实现对原Hadoop框架构建的业务平台的全面云化融入改造.云化应用表明,云化后节省硬件和存储资源,数据实时查询效率提高30%以上,开发模式简捷高效具有良好的拓展性,为相关海量结构化数据统计场景提供技术思路与借鉴.

In order to enhance the statistical and processing support capability of long sequential ground observation data,and to accelerate the cloud-based transformation of key business platforms in the"cloud-edge"mode,a timed task processing flow of processing pipeline is built by directly connecting to the library based on the resource data environment and the cloud integration standard of the provincial meteorological big data cloud platform("CMADaaS"),and the"SpringBoot+Mybatis framework"is adopted to develop a collaborative interface to provide real-time data query service,and the full-process business monitoring and alarm functions for data processing are incorporated into the"TianJing"management,achieving comprehensively integrating the original platform into the cloud environment.The results of cloud application indicate significant savings in hardware and storage resources,with real-time query efficiency improved by over 30%.The development model is simple,efficient,and highly extensible,providing technical guidance and reference for related massive structured data statistical scenarios.

黄志;林健玲;李涛;黎伟川

广西壮族自治区气象信息中心,南宁 530022

大气科学

气象大数据云平台("天擎")云+端GBaseMybatisSpringBoot

CMADaaScloud-edgeGBaseMybatisSpringBoot

《气象研究与应用》 2024 (002)

29-36 / 8

广西气象科研计划项目(桂气科2021L02)

10.19849/j.cnki.CN45-1356/P.2024.2.05

评论