Two-Layer Load Balancing for Onedata System

Authors

  • Łukasz Opioła AGH University, ACC Cyfronet AGH, Kraków
  • Łukasz Dutka AGH University, ACC Cyfronet AGH, Kraków
  • Michał Wrzeszcz AGH University, Department of Computer Science, Kraków
  • Renata Słota AGH University, Department of Computer Science, Kraków
  • Jacek Kitowski AGH University, Department of Computer Science, Kraków

Keywords:

Load balancing, geographically distributed systems, DNS, web clusters

Abstract

The recent years have significantly changed the perception of web services and data storages, as clouds became a big part of IT market. New challenges appear in the field of scalable web systems, which become bigger and more complex. One of them is designing load balancing algorithms that could allow for optimal utilization of servers' resources in large, distributed systems. This paper presents an algorithm called Two-Level Load Balancing, which has been implemented and evaluated in onedata - a global data access system. A study of onedata architecture, request types and use cases has been performed to determine the requirements of load balancing set by similar, highly scalable distributed systems. The algorithm was designed to match these requirements, and it was achieved by using a synergy of DNS and internal dispatcher load balancing. Test results show that the algorithm does not introduce considerable overheads and maintains the performance of the system on high level, even in cases when its servers are not equally loaded.

Downloads

Download data is not yet available.

Downloads

Published

2018-05-03

How to Cite

Opioła, Łukasz, Dutka, Łukasz, Wrzeszcz, M., Słota, R., & Kitowski, J. (2018). Two-Layer Load Balancing for Onedata System. Computing and Informatics, 37(1), 1–22. Retrieved from https://www.cai.sk/ojs/index.php/cai/article/view/2018_1_1