计算机工程与科学2018，Vol.40Issue(2)：191-199,9.DOI:10.3969/j.issn.1007-130X.2018.02.001
基于私有云和物理机的混合型大数据平台设计及实现
A hybrid big data platform based on private cloud VMs and bare metals
摘要
Abstract
The wide application of big data analysis technology cannot be separated from the support of big data platforms.Building big data platforms is an important demand of many enterprises and institutions.Building a big data platform requires sophisticated,system-wide technologies,and system performance and scalability should be considered especially.With the increasing volume of data,user needs continue to increase,and hence the scale of the planned data platform may not be able to meet the changing needs.Therefore,we design a hybrid big data platform that uses both bare metals and private cloud Virtual Machines (VM).This takes into account performance and scalability.Because bare metals generally outperform private cloud VMs,the big data platforms built on bare metals generally perform better than the big data platforms built on private cloud VMs.It is very convenient and quick to start the cloud servers in the private cloud,so the computing and storage nodes of the big data platform can be flexibly expanded to the private cloud so as to ensure that the big data platform can still have sufficient processing capacity during the peak period.We implemented this hybrid design in a production environment.Tests in the production environment also demonstrate the effectiveness of this design.关键词
大数据/私有云/大数据分析/大数据处理/数据平台/Hadoop/OpenstackKey words
big data/private cloud/big data analysis/big data processing/data platform/Hadoop/Openstack分类
信息技术与安全科学引用本文复制引用
王永坤,罗萱,金耀辉..基于私有云和物理机的混合型大数据平台设计及实现[J].计算机工程与科学,2018,40(2):191-199,9.基金项目
国家自然科学基金(61371084) （61371084）
