计算机工程与科学2026,Vol.48Issue(8):1344-1354,11.DOI:10.3969/j.issn.1007-130X.2026.08.002
FlexCheck:融合异构存储的高效多级检查点框架
FlexCheck:An efficient multi-level checkpointing framework integrating heterogeneous storage
摘要
Abstract
Multi-level checkpointing technology can effectively mitigate the issue of excessive applica-tion process blocking time caused by checkpoints and has been widely applied in the field of high performance computing(HPC).This technology initially writes check points to the local memory of compute nodes and subsequently flushes the data from local memory to more reliable storage,such as parallel file systems,in the background to enhance checkpoint reliability.However,as HPC systems continue to scale up,the size of applications increases,leading to a corresponding rise in checkpoint data volume.The capacity of local memory on compute nodes has thus become a bottleneck limiting the com-plete storage of checkpoint data.Additionally,in recent years,HPC systems have gradually introduced new types of storage,such as shared burst buffers,which the inherent framework of current multi-level checkpointing technologies cannot effectively leverage.To address these issues,a multi-level check-pointing framework named FlexCheck is proposed.This framework integrates heterogeneous storage re-sources in HPC systems,allowing checkpoint data to be distributed and stored across multiple types of heterogeneous storage rather than being confined solely to the local memory of compute nodes,effec-tively resolving the capacity bottleneck.Moreover,FlexCheck optimizes the application of shared burst buffers in checkpoint scenarios.Experimental evaluations demonstrate that when the checkpoint size reaches 2 048 GiB,FlexCheck only increases the execution time of application processes by 4.97%.关键词
高性能计算/检查点技术/共享突发缓冲区/多级检查点/容错Key words
high performance computing/checkpointing/shared burst buffer/multi-level checkpoint-ing/fault-tolerance分类
信息技术与安全科学引用本文复制引用
张译心,杨梨花,董勇,郑明玲..FlexCheck:融合异构存储的高效多级检查点框架[J].计算机工程与科学,2026,48(8):1344-1354,11.基金项目
国家自然科学基金(62302514) (62302514)
全国重点实验室基金(2023-KJWPDL-11) (2023-KJWPDL-11)
湖南省自然科学基金(2024JJ6471) (2024JJ6471)