Selection, scoring and ranking of serverless providers using Multicriteria Decision Method
Abstract
As technology advances, it becomes increasingly challenging to identify the best approach or method for developing and distributing software that meets the ultimate goals of its creators and users, without becoming economically unfeasible and technically complex. Recognizing the relevance of opting for a third-party infrastructure solution (cloud computing) and the use of the serverless paradigm for such an approach, this study aims to propose a mechanism for selecting serverless platforms using the multicriteria method for AHP decision-making. The criteria used in modeling the solution were extracted from serverless service providers as well as from the analysis of a benchmarking report of serverless providers. Experiments regarding the accuracy and performance of the solution were carried out, along with the comparison of an implementation of the multicriteria method used available in a software library. As a result, it was identified that both implementations of the AHP algorithm obtained 100% accuracy in the results in a controlled environment. However, the algorithm implemented by the researchers presented better performance in computation time in scenarios with more than 500 serverless providers.
References
J. Wen, Z. Chen, X. Jin, and X. Liu, “Rise of the planet of serverless computing: A systematic review,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 5, pp. 1–61, 2023.
A. Vieira, G. Pantuza, J. Freire, L. Duarte, R. Pacífico, M. Vieira, L. Vieira, and J. Nacif, “Computação serverless: Conceitos, aplicações e desafios,” in Minicursos do XXXVIII Simpósio Brasileiro de Redes de Computadores e Sistemas Distribuídos, 1st ed., D. Gomes, I. Moraes, and M. Campista, Eds. SBC, Dec. 2020, pp. 190–236. [Online]. Available: [link]
A. Ishizaka and P. Nemery, Multi-criteria decision analysis: methods and software. Chichester, West Sussex, United Kingdom: Wiley, 2013.
T. L. Saaty, “How to make a decision: The analytic hierarchy process,” European Journal of Operational Research, vol. 48, pp. 9–26, September 1990.
G. A. Norris and H. E. Marshall, “Multiattribute decision analysis method for evaluating buildings and building systems,” National Institute of Standards and Technology, Gaithersburg, MD, USA, Tech. Rep. NIST IR 5663, january 1995.
Y. Akao, Quality Function Deployment: Integrating Customer Requirements into Product Design. New York: Productivity Press, Oct. 2024
R. W. Puyt, F. B. Lie, and C. P. M. Wilderom, “The origins of SWOT analysis,” Long Range Planning, vol. 56, no. 3, Jun. 2023. [Online]. Available: [link]
M. J. Liberatore and R. L. Nydick, “Group decision making in higher education using the analytic hierarchy process,” Research in Higher Education, vol. 38, pp. 593–614, 1997.
V. P. Salomon, J. A. MONTEVECHI, and E. O. Pamplona, “Justificativas para aplicação do método de análise hierárquica,” Encontro Nacional de Engenharia de Produção , vol. 19, 1999.
T. O. Boucher, O. Gogus, and E. M. Wicks, “A comparison between two multiattribute decision methodologies used in capital investment decision analysis,” The Engineering Economist, vol. 42, no. 3, pp. 179–202, 1997.
J.-J. Wang, Y.-Y. Jing, C.-F. Zhang, G.-H. Shi, and X.-T. Zhang, “A fuzzy multi-criteria decision-making model for trigeneration system,” Energy Policy, vol. 36, no. 10, pp. 3823–3832, 2008.
H. Morita, T. Shimizu, and F. LAURINDO, “Modelos para estruturar e avaliar alternativas de decisao em tecnologia da informação,” ENEGEP– Encontro nacional de engenharia de produção , vol. 19, 1999.
E. G. Gomes, F. R. Leta, R. B. V. Pessolani et al., “Conceitos básicos do apoio multicritério a decisão e sua aplicação no projeto aerodesign,” Engevista, 2003.
F. R. Guglielmetti, F. A. S. Marins, and V. A. P. Salomon, “Comparação teórica entre métodos de auxílio a tomada de decisão por múltiplos critérios,” Encontro Nacional de Engenharia de Produção, vol. 23, 2003.
L. B. De Moraes and A. Fiorese, “A scoring method based on criteria matching for cloud computing provider ranking and selection,” in Enterprise Information Systems, S. Hammoudi, M. Śmiałek, O. Camp, and J. Filipe, Eds. Cham: Springer International Publishing, 2018, vol. 321, pp. 339–365, series Title: Lecture Notes in Business Information Processing. [Online]. Available: [link] 16
K. Hopfer and A. Fiorese, “Seleção de provedores de nuvem através do auxílio de aprendizado de maquina automatizado,” in Anais da XXI Escola Regional de Alto Desempenho da Região Sul. Porto Alegre, RS, Brasil: SBC, 2021, pp. 29–32. [Online]. Available: [link]
F. R. Lima Junior and L. C. R. Carpinetti, “Uma comparação entre os métodos TOPSIS e Fuzzy-TOPSIS no apoio à tomada de decisão multicritério para seleção de fornecedores,” Gestão & Produção, vol. 22, no. 1, pp. 17–34, Mar. 2015. [Online]. Available: [link]
M. Rifai, “Serverless showdown: Aws lambda vs azure functions vs google cloud functions,” [link], 2023, accessed: 2024-12-08.
T. L. Saaty, “Decision making – the analytic hierarchy and network processes (ahp/anp),” Journal of Systems Science and Systems Engineering, vol. 13, pp. 1–35, March 2004.
