面向数据密集型工作流的能耗感知调度策略

肖鹏; 胡志刚; 屈喜龙

doi:10.11959/j.issn.1000-436x.2015017

您当前的位置：

首页 >

文章列表页 >

面向数据密集型工作流的能耗感知调度策略

学术论文 | 更新时间：2024-06-05

- 面向数据密集型工作流的能耗感知调度策略
- Energy-aware scheduling policy for data-intensive workflow
- 通信学报 2015年36卷第1期页码：149-158
- 作者机构：
  
  1. 湖南工程学院计算机与通信系，湖南湘潭 411104
  2. 中南大学软件学院，湖南长沙 410083
- 作者简介：
  
  [ "肖鹏（1979-），男，湖南湘潭人，博士，湖南工程学院讲师，主要研究方向为高性能网格计算和可信计算。" ]
  [ "胡志刚（1963-），男，山西孝义人，中南大学教授、博士生导师，主要研究方向为分布式系统和嵌入式系统。" ]
  [ "屈喜龙（1978-），男，湖南新邵人，博士，湖南工程学院副教授，主要研究方向为服务计算和网络集成系统。" ]
- 基金信息：
  
  国家自然科学基金资助项目(61402163);国家自然科学基金资助项目(61272148);湖南省教育厅科学研究基金资助项目(13B015);湖南省科技计划项目基金资助项目(2012GK3075);湖南省自然科学基金资助项目(13JJ9022)
- DOI：10.11959/j.issn.1000-436x.2015017
  中图分类号： TP393
- 网络首发：2015-01，
  
  纸质出版：2015-01-25
- 稿件说明：
移动端阅览
肖鹏, 胡志刚, 屈喜龙. 面向数据密集型工作流的能耗感知调度策略[J]. 通信学报, 2015,36(1):149-158.

Peng XIAO, Zhi-gang HU, Xi-long QU. Energy-aware scheduling policy for data-intensive workflow[J]. Journal on Communications, 2015, 36(1): 149-158.
肖鹏, 胡志刚, 屈喜龙. 面向数据密集型工作流的能耗感知调度策略[J]. 通信学报, 2015,36(1):149-158. DOI： 10.11959/j.issn.1000-436x.2015017.

Peng XIAO, Zhi-gang HU, Xi-long QU. Energy-aware scheduling policy for data-intensive workflow[J]. Journal on Communications, 2015, 36(1): 149-158. DOI： 10.11959/j.issn.1000-436x.2015017.

摘要

随着数据中心规模的扩大，高能耗问题已经成为高性能计算领域的一个重要问题。针对数据密集型工作流的高能耗问题，提出通过引入“虚拟数据访问节点”的方法来量化评估工作流任务的数据访问能耗开销，并在此基础上设计了一种“最小能耗路径”的启发式策略。在经典的HEFT算法和CPOP算法基础上，通过引入该启发式策略设计并实现了2种具有能耗感知能力的调度算法（HEFT-MECP和CPOP-MECP）。实验结果显示，基于最小能耗路径的启发式调度算法能有效降低数据访问操作的能耗开销，在面对大型的数据密集工作流任务时，该启发式调度策略体现了较好的适应性。

Abstract

With the increasing scale of data centers

high energy consumption has become a critical issue in high-performance computing area.To address the issue of energy consumption optimization for data-intensive workflow applications

a set of virtual data-accessing nodes are introduced into the original workflow for quantitatively evaluating the data-accessing energy consumption

by which a novel heuristic policy called minimal energy consumption path is designed.Based on the proposed heuristic policy

two energy-aware scheduling algorithms are implemented

which are deprived from the classical HEFT and CPOP scheduling algorithms.Extensive experiments are conducted to investigate the performance of the proposed algorithms

and the results show that they can significantly reduce the data-accessing energy consumption.Also

the proposed algorithms show better adaptive when the system is in presence of large-scale workflows.

关键词

Keywords

references

胡定磊，陈书明．低功耗编译技术综述 [J ] ．电子学报， 2005 , 33 ( 4 ): 676 - 682 .

HU D L , CHEN S M . Low power/energy compilation technology [J ] . Acta Electronica Sinica , 2005 , 33 ( 4 ): 676 - 682 .

KANT K , MURUGAN M , DU D C . Willow:a control system for energy and thermal adaptive computing [A ] . Proceedings of IEEE International Parallel and Distributed Processing Symposium [C ] . Washington,USA , 2011 . 36 - 47 .

林闯，田源，姚敏．绿色网络和绿色评价：节能机制、模型和评价 [J ] ．计算机学报， 2011 , 34 ( 4 ): 593 - 612 .

LIN C , TIAN Y , YAO M . Green network and green evaluation:mechanism,modeling and evaluation [J ] . Chinese Journal of Computers , 2011 , 34 ( 4 ): 593 - 612 .

HIKITA J , HIRANO A , NAKASHIMA H . Saving 200kW and $200 K/year by power-aware job/machine scheduling [A ] . Proceedings of International Parallel and Distributed Processing Symposium [C ] . Washington,USA , 2008 . 1 - 8 .

KONDO M , IKEDA Y , NAKAMURA H . High performance cluster system design by adaptive power control [A ] . Proceedings of International Parallel and Distributed Processing Symposium [C ] . Washington,USA , 2007 . 1 - 8 .

WANG L , LASZEWSKI G , DAYAL J , et al . Towards energy aware scheduling for precedence constrained parallel tasks in a cluster with DVFS [A ] . Proceedings of IEEE/ACM International Conference on Cluster,Cloud and Grid Computing [C ] . Washington,USA , 2010 . 368 - 377 .

RIZVANDI N B , TAHERI J , ZOMAYA A Y , et al . Linear combinations of DVFS-enabled processor frequencies to modify the energy-aware scheduling algorithms [A ] . Proceedings of IEEE/ACM International Conference on Cluster,Cloud and Grid Computing [C ] . Washington,USA , 2010 . 388 - 397 .

GARG R , SON S W , KANDEMIR M , et al . Markov model based disk power management for data intensive workloads [A ] . Proceedings of IEEE/ACM International Symposium on Cluster Computing and the Grid [C ] . Washington,USA , 2009 . 76 - 83 .

HU F P , EVANS J J . Power and environment aware control of beowulf clusters [J ] . Cluster Computing , 2009 , 12 ( 3 ): 299 - 308 .

SONG S , SU C Y , GE R , et al . Iso-energy-efficiency:an approach to power-constrained parallel computation [A ] . Proceedings of International Parallel and Distributed Processing Symposium [C ] . Washington,USA , 2011 . 128 - 139 .

CHO S , MELHEM R G . On the interplay of parallelization,program performance,and energy consumption [J ] . IEEE Transactions on Parallel and Distributed Systems , 2010 , 21 ( 3 ): 342 - 353 .

BENOIT A , GOUD P R , ROBERT Y . Performance and energy optimization of concurrent pipelined applications [A ] . Proceedings of International Parallel and Distributed Processing Symposium [C ] . Washington,USA , 2010 . 1 - 12 .

SHANG P , WANG J . A novel power management for cmp systems in data-intensive environment [A ] . Proceedings of International Parallel and Distributed Processing Symposium [C ] . Washington,USA , 2011 . 92 - 103 .

HERATH C , PLALE B . Streamflow-programming model for data streaming in scientific workflows [A ] . Proceedings of IEEE/ACM International Conference on Cluster,Cloud and Grid Computing [C ] . Washington,USA , 2010 . 302 - 311 .

KHARGHARIA B , HARIRI S , SZIDAROVSZKY F , et al . Autonomic power and performance management for large-scale data centers [A ] . Proceedings of International Parallel and Distributed Processing Symposium [C ] . Washington,USA , 2007 . 1 - 8 .

王桂彬，杨学军，徐新海等．异构系统功耗感知的并行循环调度方法 [J ] ．软件学报， 2011 , 22 ( 9 ): 2222 - 2234 .

WANG G B , YANG X J , XU X B , et al . Power-aware parallel loop scheduling method for heterogeneous system [J ] . Journal of Software , 2011 , 22 ( 9 ): 2222 - 2234 .

NIYATO D , CHAISIRI S , SUNG L B . Optimal power management for server farm to support green computing [A ] . Proceedings of IEEE/ACM International Symposium on Cluster Computing and the Grid [C ] . Washington,USA , 2009 . 84 - 91 .

LEE Y C , ZOMAYA A Y . Energy conscious scheduling for distributed computing systems under different operating conditions [J ] . IEEE Transactions on Parallel and Distributed Systems , 2011 , 22 ( 8 ): 1374 - 1381 .

TOPCUOGLU H , HARIRI S , WU M Y . Performance-effective and low-complexity task scheduling for heterogeneous computing [J ] . IEEE Transactions on Parallel and Distributed Systems , 2002 , 13 ( 2 ): 260 - 274 .

CALHEIROS R N , RANJAN R , BELOGLAZOV A , et al . BELOGLAZOV A,et al.CloudSim:a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms [J ] . Software:Practice and Experience , 2011 , 41 ( 1 ): 23 - 50 .

BLAHA P , SCHWARZ K , MADSEN G , et al . WIEN2K:An Augmented Plane Wave Plus Local Orbitals Program for Calculating Crystal Properties [M ] . Vienna:Institute of Physical and Theoretical Chemistry , 2001 .

浏览量

1973

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

边缘环境下面向移动性用户的微服务选择方法

信息年龄和能耗联合优化的无线体域网卸载和调度策略

云环境下协同作业的密码服务优化调度算法

M-RSF：面向Unikernel的一种多级反馈队列任务调度机制

基于强化学习的在线离线混部云环境下的调度框架