计算机工程与应用2019，Vol.55Issue(10)：67-72,224,7.DOI:10.3778/j.issn.1002-8331.1801-0303
云环境下分布式文件系统负载均衡研究
Distributed File System Load Balancing in Cloud Environment
摘要
Abstract
Hadoop Distributed File System(HDFS)is a low-cost, highly fault-tolerant distributed file system that suitable for running on commodity hardware, and offers high-throughput data access for applications on large datasets. However, there are some performance optimization problems in HDFS, such as under-load balancing. Although Hadoop system comes with a load balancer to achieve balanced adjustment, but users need to give a static threshold in advance. In order to solve the fixed threshold and subjectivity, through the analysis, evaluation and optimization of disk space utilization, CPU utilization, memory utilization, the disk I/O occupancy rate, the network bandwidth occupancy rate and other param-eters, this paper forms a calculating expression for a threshold, and through the theoretical analysis and simulation experi-ments, this paper verifies the threshold calculation and load balancing. The experimental results show that this method achieves a better balance effect and improves the utilization of computing resources compared with the Hadoop static input threshold algorithm.关键词
云环境/Hadoop分布式文件系统(HDFS)/负载均衡/动态阈值Key words
cloud environment/Hadoop Distributed File System(HDFS)/load balancing/dynamic threshold分类
信息技术与安全科学引用本文复制引用
吴瑶瑶,杨庚..云环境下分布式文件系统负载均衡研究[J].计算机工程与应用,2019,55(10):67-72,224,7.基金项目
陕西省教育厅项目(No.11JK0513). （No.11JK0513）
