APPLIED MACHINE LEARNING IN LOAD BALANCING

Junaidi Junaidi, Prasetyo Wibowo, Dini Yuniasri, Putri Damayanti, Ary Mazharuddin Shiddiqi, Baskoro Adi Pratomo

Abstract


A common way to maintain the quality of service on systems that are growing rapidly is by increasing server specifications or by adding servers. The utility of servers can be balanced with the presence of a load balancer to manage server loads. In this paper, we propose a machine learning algorithm that utilizes server resources CPU and memory to forecast the future of resources server loads. We identify the timespan of forecasting should be long enough to avoid dispatcher's lack of information server distribution at runtime. Additionally, server profile pulling, forecasting server resources, and dispatching should be asynchronous with the request listener of the load balancer to minimize response delay. For production use, we recommend that the load balancer should have friendly user interface to make it easier to be configured, such as adding resources of servers as parameter criteria. We also recommended from beginning to start to save the log data server resources because the more data to process, the more accurate prediction of server load will be.


Full Text:

PDF

References


A. Armbrust, "Above the clouds: A Berkeley view of cloud computing," Univ. California, Berkeley, Tech. Rep. UCB, pp. 07–013, 2009.

R. Buyya, C. S. Yeo, and S. Venugopal, "Market-oriented cloud computing: Vision, hype, and reality for delivering IT services as computing utilities," in Proc. IEEE International Conference on High Performance Computing and Communications, 2008, pp. 5–13.

A. Darwish, A. E. Hassanien, M. Elhoseny, A. K. Sangaiah, and K. Muhammad, "The impact of the hybrid platform of internet of things and cloud computing on healthcare systems: opportunities, challenges, and open problems," J. Ambient Intell. Humaniz. Comput., vol. 10, no. 10, pp. 4151–4166, 2019.

W. Zhu, C. Luo, J. Wang, and S. Li, "Multimedia cloud computing," IEEE Signal Process. Mag., vol. 28, no. 3, pp. 59–69, 2011.

K. Ramana and M. Ponnavaikko, "AWSQ: An approximated web server queuing algorithm for heterogeneous web server cluster," Int. J. Electr. Comput. Eng., vol. 9, no. 3, pp. 2083–2093, 2019.

K. Ramana, "NDLB: Nearest Dispatcher Load Balancing approach for Web Server Cluster," Helix, vol. 8, no. 1, pp. 3023–3030, 2017.

P. Patel et al., "Ananta: Cloud scale load balancing," in Proc. ACM SIGCOMM Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, 2013, pp. 207–218.

D. E. Eisenbud et al., "Maglev: A Fast and Reliable Software Network Load Balancer Daniel," in Proc. USENIX Symposium on Networked Systems Design and Implementation, 2016, pp. 523–535.

S. Sharifian, S. A. Motamedi, and M. K. Akbari, "A predictive and probabilistic load-balancing algorithm for cluster-based web servers," Appl. Soft Comput. J., vol. 11, no. 1, pp. 970–981, 2011.

S. Sharifian, S. A. Motamedi, and M. K. Akbari, "A content-based load balancing algorithm with admission control for cluster web servers," Futur. Gener. Comput. Syst., vol. 24, no. 8, pp. 775–787, 2008.

A. Najam et al., U.S. Patent Application No 12/189,438, 2010.

M. M. Golchi, S. Saraeian, and M. Heydari, "A hybrid of firefly and improved particle swarm optimization algorithms for load balancing in cloud environments: Performance evaluation," Comput. Networks, vol. 162, p. 106860, 2019.

N. K. Rathore, U. Rawat, and S. C. Kulhari, "Efficient Hybrid Load Balancing Algorithm," Natl. Acad. Sci. Lett., 2019.

M. Shafiq, X. Yu, A. A. Laghari, L. Yao, N. K. Karn, and F. Abdessamia, "Network Traffic Classification techniques and comparative analysis using Machine Learning algorithms," in Proc. IEEE Int. Conf. Comput. Commun., pp. 2451–2455, 2017.

Y. Chen, M. Kloft, Y. Yang, C. Li, and L. Li, "Mixed kernel based extreme learning machine for electric load forecasting," Neurocomputing, vol. 312, pp. 90–106, 2018.

B. Panchal and S. Parida, "An Efficient Dynamic Load Balancing Algorithm Using Machine Learning Technique in Cloud Environment," International Journal of Scientific Research in Science, Engineering and Technology, vol. 4, no. 4, pp. 1184–1186, 2018.

Y. N. Khalid, M. Aleem, U. Ahmed, M. A. Islam, and M. A. Iqbal, "Troodon: A machine-learning based load-balancing application scheduler for CPU–GPU system," J. Parallel Distrib. Comput., vol. 132, pp. 79–94, 2019.

S. Sankara Narayanan and M. Ramakrishnan, "A Comprehensive Study on Load Balancing Algorithms in Cloud Computing Environments," Res. J. Appl. Sci. Eng. Technol., vol. 13, no. 10, pp. 794–799, 2016.

R. S. Sajjan, "Load Balancing and its Algorithms in Cloud Computing : A Survey," International Journal of Computer Sciences and Engineering, January, 2017.

R. Boutaba et al., "A comprehensive survey on machine learning for networking: evolution, applications and research opportunities," J. Internet Serv. Appl., vol. 9, no. 1, 2018.

V. Chavan and P. R. Kaveri, "Clustered virtual machines for higher availability of resources with improved scalability in cloud computing," in Proc. International Conference on Networks and Soft Computing, 2014, pp. 221–225.

M. Elrotub and A. Gherbi, "Virtual Machine Classification-based Approach to Enhanced Workload Balancing for Cloud Computing Applications," Procedia Comput. Sci., vol. 130, pp. 683–688, 2018.




DOI: http://dx.doi.org/10.12962/j24068535.v18i2.a940

Refbacks

  • There are currently no refbacks.