计算机工程与应用Issue(21):64-69,6.DOI:10.3778/j.issn.1002-8331.1310-0228
基于成本的MapReduce工作流优化器
Cost-based MapReduce workflow optimizers
摘要
Abstract
Optimizations at different levels of the MapReduce stack have their advantages and disadvantages. For MapReduce workload optimization problem, related concepts are proposed;cost-based optimization approaches and related technology of MapReduce jobs are introduced and assessed through comparation with RoT;three MapReduce workflow optimizers are presented for cost-based optimization of MapReduce workflows based on dataflow and resource dependencies. Cost-based workflow optimization is evaluated. End-to-end evaluation of the workflow optimizer is described;the advantages and disad-vantages of these three workflow optimizers are analyzed through experimental evaluation of their overhead.关键词
MapReduce工作负载/优化/数据流依赖/资源依赖/工作流优化器Key words
MapReduce workloads/optimization/dataflow dependencies/resource dependencies/workflow optimizer分类
信息技术与安全科学引用本文复制引用
冯秋燕..基于成本的MapReduce工作流优化器[J].计算机工程与应用,2015,(21):64-69,6.