Performance Efficiency Evaluation based on ISO/IEC 25010:2011 applied to a Case Study on Load Balance and Resilient

  • Diego S. Pereira UFRN / IFRN
  • Lucas F. V. Bezerra UFRN
  • Jacyana S. Nunes UFRN
  • Itamir M. Barroca Filho UFRN
  • Frederico A. S. Lopes UFRN


The client-server architecture makes it necessary to implement techniques to overcome the single point of failure problem (only one server node). One of the most commonly used techniques is load balancing. Load balancing consists in distributing requests between nodes that provide a service (clusters). In this paper, we performed an evaluation based on the concept of efficiency included in ISO25010:2011. The balancers evaluated were HAProxy (High Availability Proxy) and ARR (Application Request Routing) with and without caching. The project requirements are limited using the IIS (Internet Information Services) web server. Load Balances based on caching presented the best performance in most scenarios, while HAProxy obtained better values related to CPU utilization.


Chitra, L. P. and Satapathy, R. (2017). Performance comparison and evaluation of node. js and traditional web server (iis). In 2017 International Conference on Algorithms, Methodology, Models and Applications in Emerging Technologies (ICAMMAET), pages 1–4. IEEE.

Data, M., Kartikasari, D. P., and Bhawiyuga, A. (2019). The design of high availability dynamic web server cluster. In 2019 International Conference on Sustainable Information Engineering and Technology (SIET), pages 181–186. IEEE.

Dewi Estri, J., Umar, R., and Riadi, I. (2019). Implementation of cloudflare hosting for speeds and protection on the website. Universitas Ahmad Dahlan.

Domanal, S. G. and Reddy, G. R. M. (2014). Optimal load balancing in cloud computing by efficient utilization of virtual machines. In 2014 sixth international conference on communication systems and networks (COMSNETS), pages 1–4. IEEE.

Hosseini, S. M., Jahangir, A. H., and Daraby, S. (2021). Session-persistent load balancing for clustered web servers without acting as a reverse-proxy. In 2021 17th International Conference on Network and Service Management (CNSM), pages 360–364. IEEE.

Hu, Y., Nanda, A., and Yang, Q. (1999). Measurement, analysis and performance improvement of the apache web server. In 1999 IEEE International Performance, Computing and Communications Conference (Cat. No. 99CH36305), pages 261–267. IEEE.

Ibrahim, I. M., Ameen, S. Y., Yasin, H. M., Omar, N., Kak, S. F., Rashid, Z. N., Salih, A. A., Salim, N. O., and Ahmed, D. M. (2021). Web server performance improvement using dynamic load balancing techniques: A review. system, 19:21.

Jader, O. H., Zeebaree, S., and Zebari, R. R. (2019). A state of art survey for web server performance measurement and load balancing mechanisms. International Journal of Scientific & Technology Research, 8(12):535–543.

Johansson, A. (2022). Http load balancing performance evaluation of haproxy, nginx, traefik and envoy with the round-robin algorithm.

Kostadinov, B., Jovanov, M., and Stankov, E. (2017). Cost-effective website failover through a cdn network and asynchronous replication. In IEEE EUROCON 2017-17th International Conference on Smart Technologies, pages 151–156. IEEE.

Liu, G., Xu, J., Wang, C., and Zhang, J. (2018). A performance comparison of http servers in a 10g/40g network. In Proceedings of the 3rd International Conference on Big Data and Computing, pages 115–118.

Mbarek, F. and Mosorov, V. (2018). Load balancing algorithms in heterogeneous web cluster. In 2018 International Interdisciplinary PhD Workshop (IIPhDW), pages 205–208. IEEE.

Noveck, B. S. (2011). The single point of failure. Innovating Government: Normative, policy and technological dimensions of modern government, pages 77–99.

Rawls, C. and Salehi, M. A. (2022). Load balancer tuning: Comparative analysis of haproxy load balancing methods. arXiv preprint arXiv:2212.14198.

Reese, W. (2008). Nginx: the high-performance web server and reverse proxy. Linux Journal, 2008(173):2.

Sadqi, Y. and Maleh, Y. (2022). A systematic review and taxonomy of web applications threats. Information Security Journal: A Global Perspective, 31(1):1–27.

Setiawan, E., Setiyadi, A., and Wahdiniwaty, R. (2019). Quality analysis of mobile web server. In IOP Conference Series: Materials Science and Engineering, volume 662, page 022043. IOP Publishing.

Tarreau, W. et al. (2012). Haproxy-the reliable, high-performance tcp/http load balancer.

Zebari, R. R., Zeebaree, S. R., and Jacksi, K. (2018). Impact analysis of http and syn flood ddos attacks on apache 2 and iis 10.0 web servers. In 2018 International Conference on Advanced Science and Engineering (ICOASE), pages 156–161. IEEE.

Zeebaree, S., Zebari, R. R., and Jacksi, K. (2020). Performance analysis of iis10. 0 and apache2 cluster-based web servers under syn ddos attack. TEST Engineering & Management, 83(March-April 2020):5854–5863.
PEREIRA, Diego S.; BEZERRA, Lucas F. V.; NUNES, Jacyana S.; BARROCA FILHO, Itamir M.; LOPES, Frederico A. S.. Performance Efficiency Evaluation based on ISO/IEC 25010:2011 applied to a Case Study on Load Balance and Resilient. In: WORKSHOP DE TESTES E TOLERÂNCIA A FALHAS (WTF), 24. , 2023, Brasília/DF. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2023 . p. 108-120. ISSN 2595-2684. DOI: