现代电子技术2024，Vol.47Issue(8)：9-17,9.DOI:10.16652/j.issn.1004-373x.2024.08.002
基于Hadoop技术的加速器大数据安全存储与高效分析系统设计
Design secure storage and efficient analysis system for accelerator big data based on Hadoop technology
摘要
Abstract
In order to address the challenges of massive data secure storage and efficient analysis in the data management of the current accelerator control system,the Hadoop big data framework is introduced on the existing foundation.In combination of various big data components,a distributed data warehouse system is constructed.The process of building a data warehouse is elaborated,including software and hardware architecture,as well as a solution for extracting,converting,and loading data from existing databases into the data warehouse.An HBase based storage solution is designed based on practical application scenarios for the storage and analysis requirements of system archived data.After the system deployment,throughput testing was conducted and performance comparisons were made with the traditional databases currently in use.The testing results show that the the Hadoop based data warehouse system has shown significant advantages in massive data storage,high-performance queries,and data analysis and processing.This improvement provides stronger data management and processing capabilities for accelerator control systems,and is expected to provide more possibilities for the future development of accelerator control.关键词
数据仓库/Hadoop技术/加速器/大数据/安全存储/HBase/ETLKey words
data warehouse/Hadoop technology/accelerator/big data/secure storage/HBase/ETL(extract,transform,load)分类
电子信息工程引用本文复制引用
赵子晨,杨锋,郭玉辉,陈又新,李钊扬,刘海涛..基于Hadoop技术的加速器大数据安全存储与高效分析系统设计[J].现代电子技术,2024,47(8):9-17,9.基金项目
中国科学院战略性先导科技专项(B类)(XDB34010000) （B类）
