计算机工程与科学2017,Vol.39Issue(4):619-626,8.DOI:10.3969/j.issn.1007-130X.2017.04.002
面向高性能计算环境的作业优化调度模型的设计与实现
Design and implementation of an optimal job scheduling model in the high performance computing environment
摘要
Abstract
The high performance computing environment is a computing platform,which aggregates multiple distributed high performance computers from indifferent organizations,providing users with unified access and usage patterns.The system middleware matches the appropriate high-performance computing resources according to users'job request.With the opening of the environment programming interface (API) and the substantial increase in the number of job submission requests,some job submission requests fail because of too many network connections under high concurrent job submission requests.Also,the job scheduling strategy is lack of flexibility.We propose an optimized job scheduling model in the high performance computing environment,which introduces environment job queues,refines the system-level status for each job,and increases the configuration of job scheduling strategy.We also implement a prototype system based on middleware SCE.Test results show that no job request fails under the workload of 200 job requests each minute in a single system service.In a total of 1000 jobs,nearly 500 job submissions are completed within 0.3 seconds,and more than 800 job submissions are completed in less than 0.5 seconds.关键词
中国国家网格/高性能计算环境/网格计算/云服务/作业调度Key words
CNGrid/high performance computing environment/grid computing/cloud service/job scheduling分类
信息技术与安全科学引用本文复制引用
王小宁,肖海力,曹荣强..面向高性能计算环境的作业优化调度模型的设计与实现[J].计算机工程与科学,2017,39(4):619-626,8.基金项目
国家重点研发计划项目(2016YFB0201404) (2016YFB0201404)
十二五863重大项目(2014AA01A302) (2014AA01A302)