数据与计算发展前沿2024,Vol.6Issue(2):145-155,11.DOI:10.11871/jfdc.issn.2096-742X.2024.02.013
高能同步辐射光源科学数据传输系统设计和实现
The Design and Implementation of Scientific Data Transfer System for High Energy Photon Source
摘要
Abstract
[Objective]High Energy Photon Source(HEPS)is the first High Energy Photon Source in Chi-na.It is expected to be completed in 2025.After completion of HEPS,it is expected to produce 200TB of experimental data every day from the 15 public beamlines and stations in the first construction phase.To meet the needs of reading and writing experimental data at different stag-es,massive experimental data will be stored hierarchically and backed up for a long time.Therefore,it is necessary to transfer these data stably and efficiently between the different stor-age.[Methods]The HEPS scientific data transfer system is designed with a multi-source DAQ interface,task scheduling,message queue,cluster transfer,log monitoring,configuration man-agement,message notification,etc.[Conclusions]The system realizes efficient and reliable transfer of massive data between different storage media.[Results]The system is now deployed in several line stations of the Beijing Synchrotron Radiation Facility,which is used for the preliminary verification of HEPS da-ta transfer.It runs stably and has good effects,providing terrific data transfer services for researchers and users.关键词
高能同步辐射光源/高效传输/可靠传输/传输系统Key words
high energy photon source/reliable transfer/efficient transfer/transfer system引用本文复制引用
庄博,胡皓,齐法制,曾珊..高能同步辐射光源科学数据传输系统设计和实现[J].数据与计算发展前沿,2024,6(2):145-155,11.基金项目
国家自然科学基金"面向北京同步辐射装置科学元数据管理的关键技术研究"(12005247) (12005247)
国家自然科学基金"高能物理云网融合数据中心网络关键技术研究"(12175258) (12175258)
中国科学院网信专项"基于人工智能的高能物理大数据技术研究与示范"(CAS-WX2022SF-0104) (CAS-WX2022SF-0104)
高能物理科学数据传输系统关键技术研究(2023000057) (2023000057)