Álan Júnior da Cruz Andrade
ABSTRACT
Background: DevOps is viewed as an alternative approach to achieving high-quality software products. Dependability is recognized as a crucial aspect of software product quality. Existing literature highlights the lack of established standards, models, or methods for evaluating product quality within the DevOps paradigm. This emphasizes the need for further research to investigate the impact of DevOps on software quality attributes, particularly in relation to dependability.Objective: Our objective is to evaluate the scope of research on dependability in DevOps and identify what is known about this context by relating DevOps practices with dependability attributes. Method: We conducted a tertiary study to enhance the understanding of dependability in the context of DevOps. Results: We found 13 secondary studies that address dependability in DevOps. Within these studies, we identified 16 DevOps practices that have an impact on dependability and 12 attributes that are affected by DevOps practices. Additionally, we identified 6 measures related to dependability in the context of DevOps. Among the DevOps practices, the most commonly reported ones that impact dependability are Automation Practices, including deployment, testing, and infrastructure automation, as well as Cloud Computing Implementation. Conclusions: The results show that DevOps practices contribute to improve software dependability, mainly due to the impacts of these practices on dependability attributes. However, even though the literature reports some measures related to dependability, there is still a gap in understanding how organizations can assess dependability in DevOps.
- Ricardo Amaro, Ruben Pereira, and Miguel Mira da Silva. 2022. Capabilities and practices in DevOps: a multivocal literature review. IEEE Transactions on Software Engineering 49, 2 (2022), 883–901.Google Scholar
Cross Ref
- Algirdas Avizienis, J-C Laprie, Brian Randell, and Carl Landwehr. 2004. Basic concepts and taxonomy of dependable and secure computing. IEEE transactions on dependable and secure computing 1, 1 (2004), 11–33.Google ScholarDigital Library
- Sher Badshah, Arif Ali Khan, and Bilal Khan. 2020. Towards process improvement in DevOps: a systematic literature review. Proceedings of the evaluation and assessment in software engineering (2020), 427–433.Google ScholarDigital Library
- Pooja Batra, Aman Jatain, 2021. Hybrid model for evaluation of quality aware DevOps. International Journal of Applied Science and Engineering 18, 5 (2021), 1–11.Google ScholarCross Ref
- Daniel Céspedes, Paula Angeleri, Karin Melendez, and Abraham Dávila. 2019. Software product quality in DevOps contexts: a systematic literature review. In International conference on software process improvement. Springer, 51–64.Google Scholar
- Anish Cheriyan, Raju Ramakrishna Gondkar, and S Suresh Babu. 2019. Quality assurance practices and techniques used by QA professional in continuous delivery. In Information and Communication Technology for Sustainable Development: Proceedings of ICT4SD 2018. Springer, 83–92.Google Scholar
- IEEE Standards Committee 2021. IEEE Standard for DevOps: Building Reliable and Secure Systems Including Application Build, Package, and Deployment: IEEE Standard 2675-2021. (2021).Google Scholar
- Daniela S Cruzes and Tore Dybå. 2011. Research synthesis in software engineering: A tertiary study. Information and Software Technology 53, 5 (2011), 440–455.Google ScholarDigital Library
- Breno B Nicolau de França, Helvio Jeronimo, and Guilherme Horta Travassos. 2016. Characterizing DevOps by hearing multiple voices. In Proceedings of the XXX Brazilian Symposium on Software Engineering. 53–62.Google ScholarDigital Library
- Tore Dyba, Torgeir Dingsoyr, and Geir K Hanssen. 2007. Applying systematic reviews to diverse study types: An experience report. In First international symposium on empirical software engineering and measurement (ESEM 2007). IEEE, 225–234.Google ScholarDigital Library
- Joao Faustino, Daniel Adriano, Ricardo Amaro, Rubén Pereira, and Miguel Mira da Silva. 2022. DevOps benefits: A systematic literature review. Software: Practice and Experience 52, 9 (2022), 1905–1926.Google ScholarCross Ref
- Monika Gasparaite, Kristina Naudziunaite, and Saulius Ragaisis. 2020. Systematic Literature Review of DevOps Models. In International Conference on the Quality of Information and Communications Technology. Springer, 184–198.Google Scholar
- Marta Gomes, Rúben Pereira, Miguel Silva, José Braga de Vasconcelos, and Álvaro Rocha. 2022. KPI’s for Evaluation of DevOps Teams. In Information Systems and Technologies: WorldCIST 2022, Volume 3. Springer, 142–156.Google ScholarCross Ref
- ISO/IEC. 2011. Systems and software engineering – Systems and software Quality Requirements and Evaluation (SQuaRE) – System and software quality models. International Organization for Standardization (2011).Google Scholar
- Ramtin Jabbari, Nauman bin Ali, Kai Petersen, and Binish Tanveer. 2018. Towards a benefits dependency network for DevOps based on a systematic literature review. Journal of Software: Evolution and Process 30, 11 (2018), e1957.Google ScholarDigital Library
- Barbara Kitchenham, O Pearl Brereton, David Budgen, Mark Turner, John Bailey, and Stephen Linkman. 2009. Systematic literature reviews in software engineering–a systematic literature review. Information and software technology 51, 1 (2009), 7–15.Google Scholar
- Barbara Kitchenham, Rialette Pretorius, David Budgen, O. Pearl Brereton, Mark Turner, Mahmood Niazi, and Stephen Linkman. 2010. Systematic literature reviews in software engineering – A tertiary study. Information and Software Technology 52, 8 (2010), 792–805. https://doi.org/10.1016/j.infsof.2010.03.006Google ScholarDigital Library
- Runfeng Mao, He Zhang, Qiming Dai, Huang Huang, Guoping Rong, Haifeng Shen, Lianping Chen, and Kaixiang Lu. 2020. Preliminary findings about devsecops from grey literature. In 2020 IEEE 20th international conference on software quality, reliability and security (QRS). IEEE, 450–457.Google ScholarCross Ref
- Alok Mishra and Ziadoon Otaiwi. 2020. DevOps and software quality: A systematic mapping. Computer Science Review 38 (2020), 100308.Google ScholarDigital Library
- Vaishnavi Mohan and Lotfi Ben Othmane. 2016. Secdevops: Is it a marketing buzzword?-mapping research on security in devops. In 2016 11th international conference on availability, reliability and security (ARES). IEEE, 542–547.Google ScholarCross Ref
- Erica Mourão, João Felipe Pimentel, Leonardo Murta, Marcos Kalinowski, Emilia Mendes, and Claes Wohlin. 2020. On the performance of hybrid search strategies for systematic literature reviews in software engineering. Information and Software Technology 123 (2020), 106294. https://doi.org/10.1016/j.infsof.2020.106294Google ScholarCross Ref
- Håvard Myrbakken and Ricardo Colomo-Palacios. 2017. DevSecOps: a multivocal literature review. In Software Process Improvement and Capability Determination: 17th International Conference, SPICE 2017, Palma de Mallorca, Spain, October 4–5, 2017, Proceedings. Springer, 17–29.Google ScholarCross Ref
- Kai Petersen, Sairam Vakkalanka, and Ludwik Kuzniarz. 2015. Guidelines for conducting systematic mapping studies in software engineering: An update. Information and software technology 64 (2015), 1–18.Google ScholarDigital Library
- Luís Prates, João Faustino, Miguel Silva, and Rúben Pereira. 2019. Devsecops metrics. In Information Systems: Research, Development, Applications, Education: 12th SIGSAND/PLAIS EuroSymposium 2019, Gdansk, Poland, September 19, 2019, Proceedings 12. Springer, 77–90.Google Scholar
- Roshan N Rajapakse, Mansooreh Zahedi, M Ali Babar, and Haifeng Shen. 2022. Challenges and solutions when adopting DevSecOps: A systematic review. Information and software technology 141 (2022), 106700.Google Scholar
- Jens Smeds, Kristian Nybom, and Ivan Porres. 2015. DevOps: A Definition and Perceived Adoption Impediments. In Agile Processes, in Software Engineering, and Extreme Programming: 16th International Conference, XP 2015(Lecture Notes in Business Information Processing, Vol. 212), Casper Lassenius, Torgeir Dingsøyr, and Maria Paasivaara (Eds.). Springer International Publishing, 166–177.Google Scholar
- Daniel Teixeira, Ruben Pereira, Telmo Antonio Henriques, Miguel Silva, and João Faustino. 2020. A systematic literature review on DevOps capabilities and areas. International Journal of Human Capital and Information Technology Professionals (IJHCITP) 11, 3 (2020), 1–22.Google ScholarCross Ref
- Muhammad Waseem, Peng Liang, and Mojtaba Shahin. 2020. A systematic mapping study on microservices architecture in devops. Journal of Systems and Software 170 (2020), 110798.Google ScholarCross Ref
Index Terms
- What We Know About Software Dependability in DevOps - A Tertiary Study
Recommendations
Assessing the Maturity of DevOps Practices in Software Industry: An Empirical Study of HELENA2 Dataset
EASE '22: Proceedings of the 26th International Conference on Evaluation and Assessment in Software EngineeringCurrently, the software development organizations are adopting DevOps practices in order to develop quality product. Due to the lack of definition of DevOps, the principles, practices, and methods adopted in DevOps to determine success have changed ...
CMMI guided process improvement for DevOps projects: an exploratory case study
ICSSP '16: Proceedings of the International Conference on Software and Systems ProcessVery recently, an increasing number of software companies adopted DevOps to adapt themselves to the ever-changing business environment. While it is important to mature adoption of the DevOps for these companies, no dedicated maturity models for DevOps ...
DevOps and software quality: A systematic mapping
AbstractQuality pressure is one of the factors affecting processes for software development in its various stages. DevOps is one of the proposed solutions to such pressure. The primary focus of DevOps is to increase the deployment speed, ...
Comments