网络安全与数据治理2023，Vol.42Issue(12)：60-66,7.DOI:10.19358/j.issn.2097-1788.2023.12.010
基于动态均衡技术的海量异构数据高并发可靠接入方法
High concurrency and reliable access method for massive heterogeneous data based on dynamic balancing technology
摘要
Abstract
With the arrival of the era of big data,the highly concurrent and reliable access of massive heterogeneous data has be-come an urgent problem.This paper proposes a high concurrent and reliable access method for massive heterogeneous data based on dynamic balance technology.The method adopts decentralized task allocation mechanism to access massive data sources.For various heterogeneous data sources,a variety of collection methods based on HTTPS,SFTP,Kafka,and corresponding node allo-cation and recovery mechanisms are designed.The dynamic load balancing strategy is used to adjust the collection resources in re-al time to adapt to the changing data load and achieve high concurrency processing.This research provides an effective solution for the efficient and reliable access of massive heterogeneous data.关键词
海量异构数据/高并发/动态负载均衡策略Key words
massive heterogeneous data/high concurrency/dynamic load balancing strategy分类
信息技术与安全科学引用本文复制引用
赵勋,周成胜,靳文京,刘晓曼,王桂温..基于动态均衡技术的海量异构数据高并发可靠接入方法[J].网络安全与数据治理,2023,42(12):60-66,7.基金项目
2022年工业和信息化部制造业专项项目(20230049) （20230049）
