计算机技术与发展2026,Vol.36Issue(6):165-172,8.DOI:10.20165/j.cnki.ISSN1673-629X.2025.0352
气象超算系统资源数据管理与可视化技术研究
Research on Technologies of Resource Data Management and Data Visualization for Meteorological Supercomputing Systems
摘要
Abstract
The China Meteorological Administration(CMA)has established large-scale supercomputing and intelligent computing systems distributed in Beijing,Inner Mongolia,and Shaanxi.These systems provide high-performance computing services for meteorological numerical forecasting operations.To enhance the management of diverse and heterogeneous computing power systems,improve system resource utilization,and complete the solutions of resource monitoring and metric for systems,end-users and applications,it is necessary to effectively manage the vast amounts of data related to these system resources.We explain the definitions and management methodologies of meteorological supercomputing resources.A unified metric model for resources of supercomputing and intelligent computing systems is proposed,and usage algorithm and charging algorithm are designed by the model.Based on the research,the solutions to monitoring,collection,storage,metric,charging and visualization of system resources data are proposed.The scheme leverages a distributed data management architecture inspired by the ELK(Elasticsearch,Logstash,Kibana)stack.System and job data are collected from Slurm,with data processing and storage facilitated by the Elasticsearch and Logstash.Data visualization is achieved through the Kibana.Finally,some actual cases are introduced in order to explain the effect in system management of data visualization.关键词
超算算力/智能算力/资源管理/可视化/Slurm/ELK/ElasticsearchKey words
supercomputing power/intelligent computing power/resource management/data visualization/Slurm/ELK/Elasticsearch分类
信息技术与安全科学引用本文复制引用
常飚,赵春燕,李娟,沈瑜..气象超算系统资源数据管理与可视化技术研究[J].计算机技术与发展,2026,36(6):165-172,8.基金项目
中国气象局创新发展专项异构可扩展超算算力基础框架研究基金项目(CXFZ2024J078) (CXFZ2024J078)