Survey of Software Maintenance Metrics: A Systematic Literature Review


The software maintenance area is one of the oldest in software engineering, which is a fundamental role in all development, ensuring the final product quality and stability in the market. However, the control of software maintenance metrics becomes a difficult task, as there are no consistent applicability normalization for these metrics, and it is up to the software maintenance teams to decide which metrics to apply. In order to identify the main metrics used in the software maintenance area, we carried out a systematic review of the literature on the relevant studies published in the period between 1990-2020 into the main search engines in the area of software engineering. According to the keywords and inclusion and exclusion criteria, 44 out of 2145 articles were selected on the IEEE, ACM Digital Library, ScienceDirect, SCOPUS and Wiley Interscience. Thus, the software maintenance metrics were identified in the product, process and resource perspectives more widely directed towards the product, as well as the application validation of these metrics are made through technical experimentation of the measurement, that is, validations in a controlled environment that often do not match the reality of the software maintenance environment. Therefore, it is highlighted that the analysis of software maintenance metrics is a promising area for new researches targeting distinct perspectives, including in a real software maintenance environment.
Palavras-chave: software maintenance, metrics, survey, systematic literature review


Alain April. 2008. Software Maintenance Management : Evaluation and Continuous Improvement.

Diego Buchinger, Gustavo Cavalcanti, and Marcelo Hounsell. 2014. Mecanismos de busca acadêmica: uma análise quantitativa. Revista Brasileira de Computação Aplicada 6, 1 (abr. 2014), 108–120.

Coral Calero, Manuel Bertoa, and Maria Moraga. 2013. A systematic literature review for software sustainability measures, In 2013 2nd International Workshop on Green and Sustainable Software (GREENS). 2013 2nd International Workshop on Green and Sustainable Software, GREENS 2013 - Proceedings, 46–53.

Anuradha Chug and R. Malhotra. 2016. Benchmarking framework for maintainability prediction of open source software using object oriented metrics. International Journal of Innovative Computing, Information and Control - ICIC International 2016 12 (01 2016), 615–634.

W.E. Deming. 2000. Out of the Crisis. Massachusetts Institute of Technology, Center for Advanced Engineering Study.

T. Dyba, T. Dingsoyr, and G. K. Hanssen. 2007. Applying Systematic Reviews to Diverse Study Types: An Experience Report. In First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007). 225–234.

Lem O. Ejiogu. 1993. Five Principles for the Formal Validation of Models of Software Metrics. SIGPLAN Not. 28, 8 (Aug. 1993), 67–76.

Norman E. Fenton and Shari Lawrence Pfleeger. 2004. Software Metrics: A Rigorous and Practical Approach (2nd ed. Revisited Printing). International Thomson Computer Press., London.

Félix García, Manuel F. Bertoa, Coral Calero, Antonio Vallecillo, Francisco Ruíz, Mario Piattini, and Marcela Genero. 2006. Towards a consistent terminology for software measurement. Information and Software Technology 48, 8 (2006), 631 – 644.

Xin Huang, He Zhang, Xin Zhou, Muhammad Ali Babar, and Song Yang. 2018. Synthesizing Qualitative Research in Software Engineering: A Critical Review. In Proceedings of the 40th International Conference on Software Engineering (Gothenburg, Sweden) (ICSE ’18). Association for Computing Machinery, New York, NY, USA, 1207–1218.

ISO/IEC. 2017. 15939:2017, Software Engineering-Software Measurement Process. Technical Report 15939. ISO/IEC.

Barbara Kitchenham. 2010. What's up with Software Metrics? - A Preliminary Mapping Study. J. Syst. Softw. 83, 1 (Jan. 2010), 37–51.

Barbara; Kitchenham and Stuart Charters. 2007. Guidelines for performing Systematic Literature Reviews in Software Engineering. 2 (01 2007).

A. Klock. 2018. Mapeamentos e Revisões Sistemáticos da Literatura: um Guia Teórico e Prático.

Ayman Meidan, Julián A. García-García, Isabel Ramos, and María José Escalona. 2018. Measuring Software Process: A Systematic Mapping Study. ACM Comput. Surv. 51, 3, Article 58 (June 2018), 32 pages.

M. M. Paduelli. 2007. Manutenção de Software: problemas típicos e diretrizes para uma disciplina específica. Master's thesis. USP, SP.

Kai Petersen, Robert Feldt, Shahid Mujtaba, and Michael Mattsson. 2008. Systematic Mapping Studies in Software Engineering. Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering 17 (06 2008).

Kai Petersen and Claes Wohlin. 2009. Context in industrial software engineering research. 2009 3rd International Symposium on Empirical Software Engineering and Measurement, ESEM 2009 (10 2009).

Roger S. Pressman. 2011. Engenharia de software: uma abordagem profissional. AMGH, Porto Alegre.

I. Sommerville. 2011. Engenharia de software. Pearson.

Ervin Varga. 2018. Unraveling Software Maintenance and Evolution: Thinking Outside the Box (1st ed.). Springer Publishing Company, Incorporated.

Hong Wu, Lin Shi, Celia Chen, Qing Wang, and Barry Boehm. 2016. Maintenance Effort Estimation for Open Source Software: A Systematic Literature Review. In 2016 IEEE International Conference on Software Maintenance and Evolution (ICSME). 32–43.
MACHADO, Jackson; KEMCZINSKI, Avanilde; SCHROEDER, Rebeca. Survey of Software Maintenance Metrics: A Systematic Literature Review. In: SIMPÓSIO BRASILEIRO DE SISTEMAS DE INFORMAÇÃO (SBSI), 19. , 2023, Maceió/AL. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2023 .