Towards a Catalog of Heuristics for the Design of Systems-of-Systems


Context: Systems-of-Systems (SoS) are arrangements of independent systems that are increasingly present in everyday life and can be observed in domains such as healthcare, transport, and Industry 4.0, to mention a few. Problem: A significant concern regarding SoS refers to the constituent systems’ (CS) independence. CS are managed by different organizations that control them independently of SoS. Hence, the design of SoS is challenging as it involves careful investigation, allocation, and integration of CS to ensure proper operation. Solution: This paper provides a catalog of good practices and recommendations, herein referred to as “heuristics”, which can be applied to the SoS design. The main purpose of the catalog is to provide directions on what practitioners should consider during the design phase to ensure the proper operation of the SoS. IS theory: This research is based on the General Systems Theory that allows understanding SoS as a complex system constructed with independent systems. Method: We conducted a systematic mapping study (SMS) to identify which heuristics have been applied to SoS design. The results were discussed in a focus group with professionals to organize the heuristics. Summary of Results: After reaching a consensus on the focus group, we organized a catalog of fifteen heuristics into five categories: initiation, CS, interoperability, emergent behavior, and monitoring. Contributions and Impact in the IS area: The heuristics catalog, which is grounded in the literature, would support researchers and professionals in identifying critical issues during the SoS design phase.
Palavras-chave: Systems-of-Systems, SoS, heuristics, design


T. Batista. Challenges for sos architecture description. In SESoS, pages 35–37, Montpellier, France, 2013.

S. E. Beck and K. Manuel. Practical research methods for librarians and information professionals. Neal-Schuman Publishers New York, 2008.

J. Boardman and B. J. Sauser. System of systems - the meaning of of. In SoSE, pages 1–6, Los Angeles, USA, 2006.

T. Bouziat, V. Camps, and S. Combettes. A cooperative sos architecting approach based on adaptive multi-agent systems. In SESoS, pages 8–16, Gothenburg, Sweden, 2018. IEEE.

M. Butterfield, J. Pearlman, and S. Vickroy. A System-of-Systems Engineering GEOSS: Architectural Approach. IEEE Systems Journal, 2(3):321–332, 2008.

S. Caplan. Using focus group methodology for ergonomic design. Ergonomics, 33(5):527–533, 1990.

N. Churcher, S. Frater, C. P. Huynh, and W. Irwin. Supporting oo design heuristics. In ASWEC, pages 101–110, Melbourne, Australia, 2007. IEEE.

S. da Silva Amorim, E. S. de Almeida, J. D. McGregor, and C. von Flach G. Chavez. When ecosystems collide: making systems of systems work. In ECSA, pages 1–4, Vienna, Austria, 2014.

J. Dahmann, G. Rebovich, and J. Lane. Systems engineering for capabilities. CrossTalk, 21:7, 11 2008.

P. Dersin. Systems of Systems, October 2014. IEEE-Reliability Society. Technical Committee on “Systems of Systems”, [link]. (Access in 28/02/2021).

S. Dhawan. Online learning: A panacea in the time of COVID-19 crisis. Journal of Educational Technology Systems, 49(1):5–22, 2020.

R. Dietterle. The future combat systems (FCS) overview. In MILCOM, pages 3269–3273 Vol. 5, Atlantic City, USA, 2005.

L. Garcés and E. Y. Nakagawa. A process to establish, model and validate missions of systems-of-systems in reference architectures. In SAC, pages 1765–1772, Marrakech, Morocco, 2017.

G. Gigerenzer and W. Gaissmaier. Heuristic decision making. Annual Review of Psychology, 62(1):451–482, 2011.

M. B. Gonçalves, F. Oquendo, and E. Y. Nakagawa. A meta-process to construct software architectures for system of systems. In SAC, pages 1411–1416, Salamanca, Spain, 2015.

V. Graciano Neto, W. Manzano, A. Rohling, M. Ferreira, T. Volpato, and E. Nakagawa. Externalizing patterns for simulations in software engineering of systems-of-systems. In SAC, page 1687–1694, Pau, France, 2018.

J. Hacker, J. Vom Brocke, J. Handali, M. Otto, and J. Schneider. Virtually in this together – how web-conferencing systems enabled a new virtual togetherness during the COVID-19 crisis. European Journal of Information Systems, 29(5):563–584, 2020.

M. Jamshidi. System of systems engineering-new challenges for the 21st century. IEEE Aerospace and Electronic Systems Magazine, 23(5):4–19, 2008.

R. Kazman, K. Schmid, C. B. Nielsen, and J. Klein. Understanding patterns for system of systems integration. In SoSE, pages 141–146, Hawaii, USA, 2013. IEEE.

B. Kitchenham and S. Charters. Guidelines for performing systematic literature reviews in software engineering. 2007.

B. Kitchenham, D. Budgen, and P. Brereton. Evidence-based software engineering and systematic reviews, volume 4. CRC Press, 2015.

Q. Liang and S. H. Rubin. Randomisation in designing software tests for systems of systems. International Journal of Information and Decision Sciences, 4(2-3):108–129, 2012.

F. Lopes, S. Loss, A. Mendes, T. Batista, and R. Lea. Sos-centric middleware services for interoperability in smart cities systems. In Middleware, pages 1–6, Trento, Italy, 2016.

M. W. Maier. Architecting principles for systems-of-systems. Systems Engineering, 1(4):267–284, 1998.

T. McDermott. Developing systems thinking skills using healthcare as a case study. In SoSE, pages 240–244, Paris, France, 2018. IEEE.

S. Mittal and L. Rainey. Harnessing emergence: The control and design of emergent behavior in system of systems engineering. In SummerSim, pages 1–10, San Diego, USA, 2015.

C. Nielsen, P. Larsen, J. Fitzgerald, J. Woodcock, and J. Peleska. Systems of systems engineering: Basic concepts, model-based techniques, and research directions. ACM Computing Surveys, 48(2), 2015.

J. Nielsen. Enhancing the explanatory power of usability heuristics. In SIGCHI, pages 152–158, Boston, USA, 1994.

F. Oquendo. Formally describing the software architecture of systems-of-systems with sosadl. In SoSE, pages 1–6, Kongsberg, Norway, 2016.

N. Ricci, A. M. Ross, and D. H. Rhodes. A generalized options-based approach to mitigate perturbations in a maritime security system-of-systems. Procedia Computer Science, 16:718–727, 2013.

A. Riel. Object-Oriented Design Heuristics. Addison-Wesley, 1996.

A. P. Sage and C. D. Cuppan. On the systems engineering and management of systems of systems and federations of systems. Information knowledge systems management, 2(4):325–345, 2001.

J.-P. Schneider, C. Teodorov, E. Senn, and J. Champeau. Towards a dynamic infrastructure for playing with systems of systems. In ECSA, pages 1–4, Vienna, Austria, 2014.

R. P. Singh, M. Javaid, R. Kataria, M. Tyagi, A. Haleem, and R. Suman. Significant applications of virtual reality for COVID-19 pandemic. Diabetes & Metabolic Syndrome: Clinical Research & Reviews, 14(4):661–664, 2020. ISSN 1871-4021.

M. Vierhauser, R. Rabiser, P. Grünbacher, and B. Aumayr. A requirements monitoring model for systems of systems. In RE, pages 96–105, Ottawa, Canada, 2015.

D. Westmattelmann, J. Grotenhermen, M. Sprenger, and G. Schewe. The show must go on - Virtualisation of sport events during the COVID-19 pandemic. European Journal of Information Systems, pages 1–18, 2020.

D. Weyns and J. Andersson. On the challenges of self-adaptation in systems of systems. In SESoS, pages 47–51, Montpellier, France, 2013.

N. Wickramasinghe, S. Chalasani, R. Boppana, and A. Madni. Healthcare system of systems. In SoSE, pages 1–6, San Antonio, USA, 2007.

B. M. Zaganelli, M. A. Nisenbaum, K. d. S. G. Alves, S. B. Marques, and G. Olinto. O grupo focal na ciência da informação. Informação & Sociedade, 25(3), 2015.
IMAMURA, Marcio; FERREIRA, Francisco; FERNANDES, Juliana; GRACIANO NETO, Valdemar Vicente; SANTOS, Rodrigo. Towards a Catalog of Heuristics for the Design of Systems-of-Systems. In: SIMPÓSIO BRASILEIRO DE SISTEMAS DE INFORMAÇÃO (SBSI), 19. , 2023, Maceió/AL. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2023 .


1 2 3 4 > >>