System-of-Systems Reliability: An Exploratory Study in a Brazilian Public Organization
ResumoA System-of-systems (SoS) is defined as an arrangement of independent systems that work together to accomplish missions that could not be achieved by a single system in isolation. SoS can be observed in several domains, including mobility, healthcare, and safety. A significant concern of SoS engineers refers to the constituent systems independence since they may change the level of contribution or abandon the SoS, decreasing the overall reliability. In this paper, we performed a study of an SoS running in a Brazilian public organization focusing on identifying reliability issues. To do so, we first characterized the SoS by identifying the missions, constituent systems, relationships, and capabilities. We further conducted a focus group and a survey with the SoS engineering team to identify situations that decrease SoS reliability and how they can be treated. Both the focus group and the survey helped us to propose an initial mKAOS extension for the representation of reliability issues, such as failures and fault tolerance mechanisms in SoS. We believe that our extension can facilitate the communication of SoS reliability issues, considering the existing challenges.
J Boardman and B. Sauser. 2006. System of Systems - the meaning of of. In Proceedings of the 2006 International Conference on System of Systems Engineering (SoSE) (Los Angeles, USA). Los Angeles, USA, 118–123.
Clodis Boscarioli, Renata Mendes Araujo, and Rita Suzana Pitangueira Maciel. 2017. I GranDSI-BR Grand Research Challenges in Information Systems in Brazil 2016-2026. Special Committee on Information Systems (CE-SI). Brazilian Computer Society (SBC) (2017), 12–40.
Héctor Cadavid, Vasilios Andrikopoulos, and Paris Avgeriou. 2020. Architecting systems of systems: A tertiary study. Information and Software Technology 118 (2020), 106202.
Everton Cavalcante, Nélio Cacho, Frederico Lopes, Thais Batista, and Flavio Oquendo. 2016. Thinking Smart Cities as Systems-of-Systems: A Perspective Study. In Proceegings of the 2nd International Workshop on Smart(SmartCities ’16). Trento, Italy, Article 9, 4 pages.
Vittorio Cortellessa, Harshinder Singh, and Bojan Cukic. 2002. Early Reliability Assessment of UML Based Software Models. In Proceedings of the 3rd International Workshop on Software and Performance (WOSP ’02). Rome, Italy, 302–309.
Judith S. Dahmann and Kristen J. Baldwin. 2008. Understanding the Current State of US Defense Systems of Systems and the Implications for Systems Engineering. In Proceedings of the 2nd IEEE Systems Conference. Montreal, Canada, 1–7.
Juliana Fernandes, Francisco Ferreira, Felipe Cordeiro, Valdemar Vicente Graciano Neto, and Rodrigo Pereira dos Santos. 2019. A conceptual model for systems-of-information systems. In 2019 IEEE 20th International Conference on Information Reuse and Integration for Data Science (IRI). IEEE, 364–371.
Paul A Gagniuc. 2017. Markov chains: from theory to implementation and experimentation. John Wiley & Sons.
Alan Hevner and Samir Chatterjee. 2010. Design science research in information systems. In Design research in information systems. Springer, 9–22.
IEEE. 1991. ANSI/IEEE Standard Glossary of Software Engineering Terminology. (1991).
Marcio Imamura, Luiz Alexandre Costa, Bruno Pereira, Francisco Henrique Ferreira, Awdren Fontao, and Rodrigo Pereira dos Santos. 2020. Fatores de Governança em Sistemas-de-Sistemas: Análise de uma Instituição Pública Brasileira. In Anais do V Workshop sobre Aspectos Sociais, Humanos e Econômicos de Software. SBC, 31–40.
Marcio Imamura, Francisco Henrique Ferreira, and Rodrigo Pereira dos Santos. 2020. Uma Ferramenta de Modelagem para Analise e Avaliação de Confiabilidade e Interoperabilidade em Sistemas-de-Sistemas por Meio de Heurísticas. In Anais Estendidos do XVI Simpósio Brasileiro de Sistemas de Informação. SBC, 48–51.
Scott Jackson and Timothy L. J. Ferris. 2013. Resilience principles for engineered systems. Systems Engineering 16, 2 (2013), 152–164.
Jenny Kitzinger. 1994. The methodology of focus groups: the importance of interaction between research participants. Sociology of health & illness 16, 1 (1994), 103–121.
Michael R Lyu. 2007. Software reliability engineering: A roadmap. In Proceedings of the Future of Software Engineering (FOSE’07). Minneapolis, USA, 153–170.
Mark Maier. 1998. Architecting Principles for Systems-of-Systems. Systems Engineering 1, 4 (1998), 267–284. Issue 4.
Stephen J Mellor, Tony Clark, and Takao Futagami. 2003. Model-driven development: guest editors’ introduction.IEEE software 20, 5 (2003), 14–18.
Valdemar Vicente Graciano Neto, Milena Guessi, Lucas Bueno R Oliveira, Flavio Oquendo, and Elisa Yumi Nakagawa. 2014. Investigating the Model-Driven Development for Systems-of-Systems. In Proceedings of the 2014 European Conference on Software Architecture Workshops (ECSAW). 1–8.
Claus Ballegaard Nielsen, Peter Gorm Larsen, John Fitzgerald, Jim Woodcock, and Jan Peleska. 2015. Systems of Systems Engineering. Comput. Surveys 48, 2 (2015), 1–41.
Duncan D Nulty. 2008. The adequacy of response rates to online and paper surveys: what can be done?Assessment & evaluation in higher education 33, 3 (2008), 301–314.
James A O’brien and George M Marakas. 2011. Management information systems. Vol. 9. McGraw-Hill/Irwin.
OMG, R Parida, and S Mahapatra. 2011. Business process model and notation (bpmn) version 2.0. Object Management Group(2011).
A. Salado. 2015. Abandonment: A natural consequence of autonomy and belonging in systems-of-systems. In Proceedings of the 10th System of Systems Engineering Conference (SoSE). San Antonio, USA, 352–357.
Ali Sedaghatbaf and Mohammad Abdollahi Azgomi. 2018. Reliability evaluation of UML/DAM software architectures under parameter uncertainty. IET Software 12, 3 (2018), 236–244. Issue 3.
E. Silva, T. Batista, and F. Oquendo. 2015. A mission-oriented approach for designing system-of-systems. In Proceedings of the 10th System of Systems Engineering Conference (SoSE). San Antonio, USA, 346–351.
Eduardo Silva, Everton Cavalcante, Thais Batista, Flavio Oquendo, Flavia C Delicato, and Paulo F Pires. 2014. On the characterization of missions of systems-of-systems. In Proceedings of the 2014 European Conference on Software Architecture Workshops. 1–8.
Dean H. STAMATIS. 1995. Failure Mode and Effect Analysis FMEA from Theory to Execution (1 ed.). Quality Press ASQ.
Marko Čepin. 2011. Assessment of Power System Reliability(1 ed.). Springer, London.