计算机工程与应用2024,Vol.60Issue(17):263-271,9.DOI:10.3778/j.issn.1002-8331.2306-0114
海洋环流模式的并行I/O优化研究
Parallel I/O Optimization Based on Ocean Circulation Model
摘要
Abstract
Extreme weather is getting worse and worse,which has seriously affected human production and life.How to effectively respond to extreme environmental changes in the future is more related to international competition.Therefore,it is very important to develop high-precision and high-resolution earth system models to promote climate change research.With the continuous improvement of mode accuracy and resolution,I/O performance has become a bottleneck restricting the efficiency and scalability of mode computing.The typical ocean circulation model LICOM3 is selected as the research object.Based on the Tianhe HPC system,the I/O process of the model is tested and analyzed in detail.It is found that under the 3K process,the I/O can account for more than half of the overall running time,which is the key factor limiting the calculation performance of the model.Therefore,the MPI-IO parallel optimization scheme for the main output pro-cesses is designed and implemented,which significantly improves the mode operation efficiency and basically solves the mode I/O bottleneck.The test results show that the MPI-IO parallel optimization scheme reduces the output time from 48.58%to 2.44%and increases the output bandwidth to 6.21 GB/s,about 14 times that of the original program.In addi-tion,the factors affecting the performance of parallel I/O are further analyzed to provide reference and guidance for related work.关键词
并行I/O优化/海洋环流模式/MPI-IOKey words
parallel I/O optimization/ocean circulation model/MPI-IO分类
信息技术与安全科学引用本文复制引用
李云龙,祝子杰,孟祥飞,朱小谦,林鹏飞,刘海龙,李庚..海洋环流模式的并行I/O优化研究[J].计算机工程与应用,2024,60(17):263-271,9.基金项目
国家重点研发计划项目(2021YFC3101503). (2021YFC3101503)