计算机工程与应用2017，Vol.53Issue(19)：98-101,4.DOI:10.3778/j.issn.1002-8331.1609-0152
基于Spark+YARN的空气污染预报云平台设计
Design of air pollution forecast cloud based on Spark+YARN
丁凡 1马敏劲 2丁峰 3曹二山1
作者信息
- 1. 兰州理工大学 计算机与通信学院,兰州 730050
- 2. 兰州大学 大气科学学院,兰州 730000
- 3. 兰州理工大学 设计艺术学院,兰州 730050
- 折叠
摘要
Abstract
In China, air pollution is an important environment problem, in which numerical prediction is difficult to apply due to large amount of calculation and data in the numerical forecast system. There are some shortcomings in traditional way, such as limited resources, difficulty of parallel operations and time consuming in waiting of batch tasks. Especially, some research teams cannot afford the high cost in investment to perform air pollution numerical forecast. Therefore, it is valuable to research a kind of High Performance Computing(HPC)cloud environment and to provide atmospheric scientists with scalable, instant, cheap and dynamic assignable computing and storing resources. This paper establishes a big data solution based on Spark+YARN aiming at numerical prediction.关键词
Spark+YARN平台/云计算/空气污染预报Key words
Spark+YARN/cloud-computing/air pollution forecast分类
信息技术与安全科学引用本文复制引用
丁凡,马敏劲,丁峰,曹二山..基于Spark+YARN的空气污染预报云平台设计[J].计算机工程与应用,2017,53(19):98-101,4.
