Grid Resource Management and Scheduling for Data Streaming Applications

Authors

  • Wen Zhang
  • Junwei Cao
  • Yisheng Zhong
  • Lianchen Liu
  • Cheng Wu

Keywords:

Grid computing, data streaming, resource management, genetic algorithm

Abstract

Data streaming applications bring new challenges to resource management and scheduling for grid computing. Since real-time data streaming is required as data processing is going on, integrated grid resource management becomes essential among processing, storage and networking resources. Traditional scheduling approaches may not be sufficient for such applications, since usually only one aspect of grid resource scheduling is focused. In this work, an integrated resource scheduling approach is proposed and coordinated resource allocation of CPU cycles, storage capability and network bandwidth is implemented. Resource allocation is performed periodically with updated information on resources and applications and heuristic search for optimal solutions is used to assign various resources for running applications simultaneously. Performance metrics considered in this work include data throughput and utilization of processors, storage, and bandwidth, which are actually tightly coupled with each other when applied for grid data streaming applications. Experimental results show dramatic improvement of performance and scalability using our implementation.

Downloads

Download data is not yet available.

Author Biographies

Wen Zhang

Chongqing Military Delegate Bureau
General Armament Department of PLA, Chongqing 400060, P.R. China
This work was carried out when the author was with:
Department of Automation
Tsinghua University, Beijing 100084, P.R. China

Junwei Cao

Research Institute of Information Technology
Tsinghua National Laboratory for Information Science and Technology
Tsinghua University, Beijing 100084, P.R. China

Yisheng Zhong

Department of Automation
Tsinghua University, Beijing 100084, P.R. China

Lianchen Liu

National CIMS Engineering Research Center
Tsinghua University, Beijing 100084, P.R. China

Cheng Wu

National CIMS Engineering Research Center
Tsinghua University, Beijing 100084, P.R. China

Downloads

Published

2012-01-26

How to Cite

Zhang, W., Cao, J., Zhong, Y., Liu, L., & Wu, C. (2012). Grid Resource Management and Scheduling for Data Streaming Applications. COMPUTING AND INFORMATICS, 29(6+), 1193–1220. Retrieved from https://www.cai.sk/ojs/index.php/cai/article/view/139