计算机与现代化Issue(12):118-122,5.DOI:10.3969/j.issn.1006-2475.2023.12.020
面向混合负载的分布式气象数据管理系统设计
Design of Hybrid Workload-oriented Distributed Meteorological Data Management System
摘要
Abstract
Meteorological data has the characteristics of large data scale and diverse data types.It has high requirements for ac-cess performance,so a high-performance distributed data management system is highly required.However,the meteorology is not a pure OLTP or a pure OLAP application,but a combination of the two,i.e.,HTAP with both a large number of data updat-ing and highly concurrent data queries.Although distributed data management systems are rapidly evolving nowadays,their cur-rent support for HTAP is not very good.Therefore,in this paper,we design and implement a new hybrid workload-oriented dis-tributed meteorological data management system for meteorological data,especially for the large-scale and most frequently used meteorological model data.The heterogeneity of different types of storage models,i.e.,grid-based and priority-based storage models,in this system can satisfy all the requirements of different types of complex queries efficiently for higher overall perfor-mance.This system can promote the concurrent query performance by 3.13 times under similar writing performance.关键词
分布式系统/数据管理/HTAP/气象/模式数据Key words
distributed system/data management/HTAP/meteorology/model data分类
计算机与自动化引用本文复制引用
陈超,顾青峰..面向混合负载的分布式气象数据管理系统设计[J].计算机与现代化,2023,(12):118-122,5.基金项目
国家自然科学基金资助项目(61972275) (61972275)