Energy-aware scheduling policy for data-intensive workflow

Peng XIAO; Zhi-gang HU; Xi-long QU

doi:10.11959/j.issn.1000-436x.2015017

您当前的位置：

首页 >

文章列表页 >

Energy-aware scheduling policy for data-intensive workflow

Academic paper | 更新时间：2024-06-05

- Energy-aware scheduling policy for data-intensive workflow
- Journal on Communications Vol. 36, Issue 1, Pages: 149-158(2015)
- 作者机构：
  
  1. 湖南工程学院计算机与通信系，湖南湘潭 411104
  2. 中南大学软件学院，湖南长沙 410083
- 作者简介：
- 基金信息：
  
  The National Natural Science Foundation of China(61402163);The National Natural Science Foundation of China(61272148);The Scientific Research Fund of Hunan Provincial Education Department(13B015);Provincial Science ＆ Technology Plan Project of Hunan(2012GK3075);Hunan Provincial Natural Science Foundation of China(13JJ9022)
- DOI：10.11959/j.issn.1000-436x.2015017
  CLC： TP393
- Online First：2015-01，
  
  Published：25 January 2015
- 稿件说明：
移动端阅览
Peng XIAO, Zhi-gang HU, Xi-long QU. Energy-aware scheduling policy for data-intensive workflow[J]. Journal on Communications, 2015, 36(1): 149-158.
DOI：

Peng XIAO, Zhi-gang HU, Xi-long QU. Energy-aware scheduling policy for data-intensive workflow[J]. Journal on Communications, 2015, 36(1): 149-158. DOI： 10.11959/j.issn.1000-436x.2015017.

摘要

随着数据中心规模的扩大，高能耗问题已经成为高性能计算领域的一个重要问题。针对数据密集型工作流的高能耗问题，提出通过引入“虚拟数据访问节点”的方法来量化评估工作流任务的数据访问能耗开销，并在此基础上设计了一种“最小能耗路径”的启发式策略。在经典的HEFT算法和CPOP算法基础上，通过引入该启发式策略设计并实现了2种具有能耗感知能力的调度算法（HEFT-MECP和CPOP-MECP）。实验结果显示，基于最小能耗路径的启发式调度算法能有效降低数据访问操作的能耗开销，在面对大型的数据密集工作流任务时，该启发式调度策略体现了较好的适应性。

Abstract

With the increasing scale of data centers

high energy consumption has become a critical issue in high-performance computing area.To address the issue of energy consumption optimization for data-intensive workflow applications

a set of virtual data-accessing nodes are introduced into the original workflow for quantitatively evaluating the data-accessing energy consumption

by which a novel heuristic policy called minimal energy consumption path is designed.Based on the proposed heuristic policy

two energy-aware scheduling algorithms are implemented

which are deprived from the classical HEFT and CPOP scheduling algorithms.Extensive experiments are conducted to investigate the performance of the proposed algorithms

and the results show that they can significantly reduce the data-accessing energy consumption.Also

the proposed algorithms show better adaptive when the system is in presence of large-scale workflows.

关键词

Keywords

references

胡定磊，陈书明．低功耗编译技术综述 [J ] ．电子学报， 2005 , 33 ( 4 ): 676 - 682 .

HU D L , CHEN S M . Low power/energy compilation technology [J ] . Acta Electronica Sinica , 2005 , 33 ( 4 ): 676 - 682 .

KANT K , MURUGAN M , DU D C . Willow:a control system for energy and thermal adaptive computing [A ] . Proceedings of IEEE International Parallel and Distributed Processing Symposium [C ] . Washington,USA , 2011 . 36 - 47 .

林闯，田源，姚敏．绿色网络和绿色评价：节能机制、模型和评价 [J ] ．计算机学报， 2011 , 34 ( 4 ): 593 - 612 .

LIN C , TIAN Y , YAO M . Green network and green evaluation:mechanism,modeling and evaluation [J ] . Chinese Journal of Computers , 2011 , 34 ( 4 ): 593 - 612 .

HIKITA J , HIRANO A , NAKASHIMA H . Saving 200kW and $200 K/year by power-aware job/machine scheduling [A ] . Proceedings of International Parallel and Distributed Processing Symposium [C ] . Washington,USA , 2008 . 1 - 8 .

KONDO M , IKEDA Y , NAKAMURA H . High performance cluster system design by adaptive power control [A ] . Proceedings of International Parallel and Distributed Processing Symposium [C ] . Washington,USA , 2007 . 1 - 8 .

WANG L , LASZEWSKI G , DAYAL J , et al . Towards energy aware scheduling for precedence constrained parallel tasks in a cluster with DVFS [A ] . Proceedings of IEEE/ACM International Conference on Cluster,Cloud and Grid Computing [C ] . Washington,USA , 2010 . 368 - 377 .

RIZVANDI N B , TAHERI J , ZOMAYA A Y , et al . Linear combinations of DVFS-enabled processor frequencies to modify the energy-aware scheduling algorithms [A ] . Proceedings of IEEE/ACM International Conference on Cluster,Cloud and Grid Computing [C ] . Washington,USA , 2010 . 388 - 397 .

GARG R , SON S W , KANDEMIR M , et al . Markov model based disk power management for data intensive workloads [A ] . Proceedings of IEEE/ACM International Symposium on Cluster Computing and the Grid [C ] . Washington,USA , 2009 . 76 - 83 .

HU F P , EVANS J J . Power and environment aware control of beowulf clusters [J ] . Cluster Computing , 2009 , 12 ( 3 ): 299 - 308 .

SONG S , SU C Y , GE R , et al . Iso-energy-efficiency:an approach to power-constrained parallel computation [A ] . Proceedings of International Parallel and Distributed Processing Symposium [C ] . Washington,USA , 2011 . 128 - 139 .

CHO S , MELHEM R G . On the interplay of parallelization,program performance,and energy consumption [J ] . IEEE Transactions on Parallel and Distributed Systems , 2010 , 21 ( 3 ): 342 - 353 .

BENOIT A , GOUD P R , ROBERT Y . Performance and energy optimization of concurrent pipelined applications [A ] . Proceedings of International Parallel and Distributed Processing Symposium [C ] . Washington,USA , 2010 . 1 - 12 .

SHANG P , WANG J . A novel power management for cmp systems in data-intensive environment [A ] . Proceedings of International Parallel and Distributed Processing Symposium [C ] . Washington,USA , 2011 . 92 - 103 .

HERATH C , PLALE B . Streamflow-programming model for data streaming in scientific workflows [A ] . Proceedings of IEEE/ACM International Conference on Cluster,Cloud and Grid Computing [C ] . Washington,USA , 2010 . 302 - 311 .

KHARGHARIA B , HARIRI S , SZIDAROVSZKY F , et al . Autonomic power and performance management for large-scale data centers [A ] . Proceedings of International Parallel and Distributed Processing Symposium [C ] . Washington,USA , 2007 . 1 - 8 .

王桂彬，杨学军，徐新海等．异构系统功耗感知的并行循环调度方法 [J ] ．软件学报， 2011 , 22 ( 9 ): 2222 - 2234 .

WANG G B , YANG X J , XU X B , et al . Power-aware parallel loop scheduling method for heterogeneous system [J ] . Journal of Software , 2011 , 22 ( 9 ): 2222 - 2234 .

NIYATO D , CHAISIRI S , SUNG L B . Optimal power management for server farm to support green computing [A ] . Proceedings of IEEE/ACM International Symposium on Cluster Computing and the Grid [C ] . Washington,USA , 2009 . 84 - 91 .

LEE Y C , ZOMAYA A Y . Energy conscious scheduling for distributed computing systems under different operating conditions [J ] . IEEE Transactions on Parallel and Distributed Systems , 2011 , 22 ( 8 ): 1374 - 1381 .

TOPCUOGLU H , HARIRI S , WU M Y . Performance-effective and low-complexity task scheduling for heterogeneous computing [J ] . IEEE Transactions on Parallel and Distributed Systems , 2002 , 13 ( 2 ): 260 - 274 .

CALHEIROS R N , RANJAN R , BELOGLAZOV A , et al . BELOGLAZOV A,et al.CloudSim:a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms [J ] . Software:Practice and Experience , 2011 , 41 ( 1 ): 23 - 50 .

BLAHA P , SCHWARZ K , MADSEN G , et al . WIEN2K:An Augmented Plane Wave Plus Local Orbitals Program for Calculating Crystal Properties [M ] . Vienna:Institute of Physical and Theoretical Chemistry , 2001 .

Views

2040

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Microservice selection approach for mobile users in edge computing environment

Joint optimization strategy of age of information and energy consumption for offloading and scheduling in WBAN

Cryptographic service optimization scheduling algorithm for collaborative jobs in cloud environment

M-RSF: a multilevel feedback queue task scheduling mechanism for Unikernel

Scheduling framework based on reinforcement learning in online-offline colocated cloud environment

Related Author

ZHAO Shuxu

JIANG Kaijun

WANG Xiaolong

ZHANG Zheng

XIE Xin

BAI Tong

LIN Jinzhao

LI Zhangyong

Related Institution

School for Electronic and Information Engineering, Lanzhou Jiaotong University

School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications

Chongqing Key Laboratory of Optoelectronic Information Sensing and Microsystems, Chongqing University of Posts and Telecommunications

School of Automation, Chongqing University of Posts and Telecommunications

School of Optoelectronic Engineering, Chongqing University of Posts and Telecommunications

AI问答

⁰