Interoperability Testing Guide for the Internet of Things
Resumo
The Internet of Things (IoT) has expanded the Internet by integrating smart objects, which when interconnected, can collect and share information to provide services. However, the intense data traffic and the diversity of interaction methods of smart objects, which vary based on the protocols and standards, bring several challenges for IoY Interoperability Testing. Such testing evaluates the capability of systems and devices to cooperate effectively. Regarding the challenges in IoT interoperability testing, we highlight the complexity of IoT architecture, the devices heterogeneity, and the guarantee of effective connectivity among the smart objects. In this context, this paper presents a interoperability testing guide for IoT. The guide was developed based on a literature review using systematic mapping and an analysis of real IoT environments. The guide’s evaluation consisted of two steps: (1) a structural assessment using the Technology Acceptance Model (TAM), and (2) a controlled experiment applying the guide to test a real IoT application.
Palavras-chave:
Interoperability, Internet of Things, Interoperability Testing
Referências
Home Assistant. 2024. Awaken your home. [link]
Luigi Atzori, Antonio Iera, and Giacomo Morabito. 2010. The internet of things: A survey. Computer networks 54, 15 (2010), 2787–2805.
Miroslav Bures, Bestoun S. Ahmed, Vaclav Rechtberger, Matej Klima, Michal Trnka, Miroslav Jaros, Xavier Bellekens, Dani Almog, and Pavel Herout. 2021. PatrIoT: IoT Automated Interoperability and Integration Testing Framework. In 2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST). 454–459. DOI: 10.1109/ICST49551.2021.00059
Eduardo Alves Lima Caldas. 2023. Checklist para avaliação da interoperabilidade em dispositivos iot com foco em casas inteligentes. (2023).
Liana M Carvalho, Valéria Lelli, and Rossana MC Andrade. 2022. Performance Testing Guide for IoT Applications.. In ICEIS (1). 667–678.
CoAPthon. 2024. [link]
Mariela Cortés, Raphael Saraiva, Marcia Souza, Patricia Mello, and Pamella Soares. 2019. Adoption of software testing in internet of things: A systematic literature mapping. In Proceedings of the IV Brazilian Symposium on Systematic and Automated Software Testing. 3–11.
Fred D. Davis. 1989. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Quarterly 13, 3 (1989), 319–340.
Alexandra Desmoulin and César Viho. 2009. Formalizing interoperability for test case generation purpose. International journal on software tools for technology transfer 11, 3 (2009), 261–267.
freeRTOS. 2024. Simplifying Authenticated Cloud Connectivity for Any Device. [link]
Sara Nieves Matheu García, José Luis Hernández-Ramos, and Antonio F. Skarmeta. 2018. Test-based risk assessment and security certification proposal for the Internet of Things. 2018 IEEE 4th World Forum on Internet of Things (WF-IoT) (2018), 641–646.
Daniel Giusto, Antonio Iera, Giacomo Morabito, and Luigi Atzori. 2010. The internet of things: 20th Tyrrhenian workshop on digital communications. Springer Science & Business Media.
Jayavardhana Gubbi, Rajkumar Buyya, Slaven Marusic, and Marimuthu Palaniswami. 2013. Internet of Things (IoT): A vision, architectural elements, and future directions. Future generation computer systems 29, 7 (2013), 1645–1660.
Jon Atle Gulla, Stein L Tomassen, and Darijus Strasunskas. 2006. Semantic Interoperability in the Norwegian Petroleum Industry.. In ISTA. 81–93.
Prageeth Gunathilaka, Daisuke Mashima, and Binbin Chen. 2016. Softgrid: A software-based smart grid testbed for evaluating substation cybersecurity solutions. In Proceedings of the 2nd ACM Workshop on Cyber-Physical Systems Security and Privacy. 113–124.
Eclipse IoT. 2024. Open Source for IoT. Eclipse IoT technologies power the world’s leading commercial IoT solutions. [link]
Open IoT. 2024. Open IoT Org. [link]
IoTIFY. 2024. IoTIFY Network Simulator. [link]
ISO 15926. 2011. ISO 15926 - Industrial automation systems and integration - Integration of life-cycle data for process plants including oil and gas production facilities. Geneva: ISO. [link]
ISO 25012. 2008. ISO/IEC 25012:2008 - Software Engineering - Software Product Quality Requirements and Evaluation (SQuaRE) - Data Quality Model. International Organization for Standardization. [link] Acessado: 28-03-2023.
ISO/IEC 25010. 2011. ISO/IEC 25010:2011, Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — System and software quality models.
ISO/IEC 30141. 2018. ISO/IEC 30141:2018 - Systems and software engineering – Content of systems and software life cycle process information products (Documentation). International Standard. [link]
Eunsook Eunah Kim and Sebastien Ziegler. 2017. Towards an open framework of online interoperability and performance tests for the Internet of Things. In 2017 Global Internet of Things Summit (GIoTS). 1–6. DOI: 10.1109/GIOTS.2017.8016248
Barbara Kitchenham, O Pearl Brereton, David Budgen, Mark Turner, John Bailey, and Stephen Linkman. 2009. Systematic literature reviews in software engineering–a systematic literature review. Information and software technology 51, 1 (2009), 7–15.
Maciej Kuzniar, Peter Peresini, Marco Canini, Daniele Venzano, and Dejan Kostic. 2012. A soft way for openflow switch interoperability testing. In Proceedings of the 8th international conference on Emerging networking experiments and technologies. 265–276.
Friedemann Mattern and Christian Floerkemeier. 2010. From the Internet of Computers to the Internet of Things. In From active data management to event-based systems and more. Springer, 242–259.
Javier Miranda, Niko Mäkitalo, Jose Garcia-Alonso, Javier Berrocal, Tommi Mikkonen, Carlos Canal, and Juan M Murillo. 2015. From the Internet of Things to the Internet of People. IEEE Internet Computing 19, 2 (2015), 40–47.
Rebeca Campos Motta, Káthia Marçal De Oliveira, and Guilherme Horta Travassos. 2017. Rethinking interoperability in contemporary software systems. In 2017 IEEE/ACM Joint 5th International Workshop on Software Engineering for Systems-of-Systems and 11th Workshop on Distributed Software Development, Software Ecosystems and Systems-of-Systems (JSOS). IEEE, 9–15.
Rebeca C Motta, Káthia M de Oliveira, and Guilherme H Travassos. 2019. A conceptual perspective on interoperability in context-aware software systems. Information and Software Technology 114 (2019), 231–257.
Srikanth Mujjiga and Srihari Sukumaran. 2007. Modelling and test generation using SAL for interoperability testing in Consumer Electronics. In Proceedings of the second workshop on Automated formal methods. 32–40.
Mohammad Abdur Razzaque, Marija Milojevic-Jevric, Andrei Palade, and Siobhán Clarke. 2015. Middleware for internet of things: a survey. IEEE Internet of things journal 3, 1 (2015), 70–95.
S Revell. 2013. Internet of things (IoT) and machine to machine communications (M2M) challenges and opportunities. Final Paper, London, UK Google Scholar (2013).
Bruno P Santos, Lucas A Silva, CSFS Celes, João B Borges, Bruna S Peres Neto, Marcos Augusto M Vieira, Luiz Filipe M Vieira, Olga N Goussevskaia, and Antonio Loureiro. 2016. Internet das coisas: da teoria à prática. Minicursos SBRC-Simpósio Brasileiro de Redes de Computadores e Sistemas Distribuıdos 31 (2016), 16.
Luis Fernando Sayão and Carlos Henrique Marcondes. 2008. O desafio da interoperabilidade e as novas perspectivas para as bibliotecas digitais. Transinformação 20 (2008), 133–148.
Sabrina Sicari, Alessandra Rizzardi, Luigi Alfredo Grieco, and Alberto Coen-Porisini. 2015. Security, privacy and trust in Internet of Things: The road ahead. Computer networks 76 (2015), 146–164.
Valéria Martins da Silva. 2019. ScenarIoT: support for scenario specification of internet of things-based software systems. (2019).
Delfina de Sá Soares. 2010. Interoperabilidade entre sistemas de informação na Administração Pública. (2010).
Harald Sundmaeker, Patrick Guillemin, Peter Friess, Sylvie Woelfflé, et al. 2010. Vision and challenges for realising the Internet of Things. Cluster of European research projects on the internet of things, European Commision 3, 3 (2010), 34–36.
Tasmota. 2024. Open source firmware for ESP devices. [link]
Souvik Pal Valentina Emilia Balas. 2020. Healthcare Paradigms in the Internet of Things Ecosystem. Academic Press; 1st edition.
Leila Cristina Weiss et al. 2019. Interoperabilidade semântica: uma análise sob a perspectiva da abordagem ontológica de Willard van Orman Quine. (2019).
Wireshark. 2024. The world’s most popular network protocol analyzer. [link]
Claes Wohlin, Per Runeson, Martin Höst, Magnus C Ohlsson, Björn Regnell, and Anders Wesslén. 2012. Experimentation in Software Engineering. Springer Science & Business Media.
Fatiha Zaidi, Emmanuel Bayse, and Ana Cavalli. 2009. Network protocol interoperability testing based on contextual signatures and passive testing. In Proceedings of the 2009 ACM symposium on Applied Computing. 2–7.
Luigi Atzori, Antonio Iera, and Giacomo Morabito. 2010. The internet of things: A survey. Computer networks 54, 15 (2010), 2787–2805.
Miroslav Bures, Bestoun S. Ahmed, Vaclav Rechtberger, Matej Klima, Michal Trnka, Miroslav Jaros, Xavier Bellekens, Dani Almog, and Pavel Herout. 2021. PatrIoT: IoT Automated Interoperability and Integration Testing Framework. In 2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST). 454–459. DOI: 10.1109/ICST49551.2021.00059
Eduardo Alves Lima Caldas. 2023. Checklist para avaliação da interoperabilidade em dispositivos iot com foco em casas inteligentes. (2023).
Liana M Carvalho, Valéria Lelli, and Rossana MC Andrade. 2022. Performance Testing Guide for IoT Applications.. In ICEIS (1). 667–678.
CoAPthon. 2024. [link]
Mariela Cortés, Raphael Saraiva, Marcia Souza, Patricia Mello, and Pamella Soares. 2019. Adoption of software testing in internet of things: A systematic literature mapping. In Proceedings of the IV Brazilian Symposium on Systematic and Automated Software Testing. 3–11.
Fred D. Davis. 1989. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Quarterly 13, 3 (1989), 319–340.
Alexandra Desmoulin and César Viho. 2009. Formalizing interoperability for test case generation purpose. International journal on software tools for technology transfer 11, 3 (2009), 261–267.
freeRTOS. 2024. Simplifying Authenticated Cloud Connectivity for Any Device. [link]
Sara Nieves Matheu García, José Luis Hernández-Ramos, and Antonio F. Skarmeta. 2018. Test-based risk assessment and security certification proposal for the Internet of Things. 2018 IEEE 4th World Forum on Internet of Things (WF-IoT) (2018), 641–646.
Daniel Giusto, Antonio Iera, Giacomo Morabito, and Luigi Atzori. 2010. The internet of things: 20th Tyrrhenian workshop on digital communications. Springer Science & Business Media.
Jayavardhana Gubbi, Rajkumar Buyya, Slaven Marusic, and Marimuthu Palaniswami. 2013. Internet of Things (IoT): A vision, architectural elements, and future directions. Future generation computer systems 29, 7 (2013), 1645–1660.
Jon Atle Gulla, Stein L Tomassen, and Darijus Strasunskas. 2006. Semantic Interoperability in the Norwegian Petroleum Industry.. In ISTA. 81–93.
Prageeth Gunathilaka, Daisuke Mashima, and Binbin Chen. 2016. Softgrid: A software-based smart grid testbed for evaluating substation cybersecurity solutions. In Proceedings of the 2nd ACM Workshop on Cyber-Physical Systems Security and Privacy. 113–124.
Eclipse IoT. 2024. Open Source for IoT. Eclipse IoT technologies power the world’s leading commercial IoT solutions. [link]
Open IoT. 2024. Open IoT Org. [link]
IoTIFY. 2024. IoTIFY Network Simulator. [link]
ISO 15926. 2011. ISO 15926 - Industrial automation systems and integration - Integration of life-cycle data for process plants including oil and gas production facilities. Geneva: ISO. [link]
ISO 25012. 2008. ISO/IEC 25012:2008 - Software Engineering - Software Product Quality Requirements and Evaluation (SQuaRE) - Data Quality Model. International Organization for Standardization. [link] Acessado: 28-03-2023.
ISO/IEC 25010. 2011. ISO/IEC 25010:2011, Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — System and software quality models.
ISO/IEC 30141. 2018. ISO/IEC 30141:2018 - Systems and software engineering – Content of systems and software life cycle process information products (Documentation). International Standard. [link]
Eunsook Eunah Kim and Sebastien Ziegler. 2017. Towards an open framework of online interoperability and performance tests for the Internet of Things. In 2017 Global Internet of Things Summit (GIoTS). 1–6. DOI: 10.1109/GIOTS.2017.8016248
Barbara Kitchenham, O Pearl Brereton, David Budgen, Mark Turner, John Bailey, and Stephen Linkman. 2009. Systematic literature reviews in software engineering–a systematic literature review. Information and software technology 51, 1 (2009), 7–15.
Maciej Kuzniar, Peter Peresini, Marco Canini, Daniele Venzano, and Dejan Kostic. 2012. A soft way for openflow switch interoperability testing. In Proceedings of the 8th international conference on Emerging networking experiments and technologies. 265–276.
Friedemann Mattern and Christian Floerkemeier. 2010. From the Internet of Computers to the Internet of Things. In From active data management to event-based systems and more. Springer, 242–259.
Javier Miranda, Niko Mäkitalo, Jose Garcia-Alonso, Javier Berrocal, Tommi Mikkonen, Carlos Canal, and Juan M Murillo. 2015. From the Internet of Things to the Internet of People. IEEE Internet Computing 19, 2 (2015), 40–47.
Rebeca Campos Motta, Káthia Marçal De Oliveira, and Guilherme Horta Travassos. 2017. Rethinking interoperability in contemporary software systems. In 2017 IEEE/ACM Joint 5th International Workshop on Software Engineering for Systems-of-Systems and 11th Workshop on Distributed Software Development, Software Ecosystems and Systems-of-Systems (JSOS). IEEE, 9–15.
Rebeca C Motta, Káthia M de Oliveira, and Guilherme H Travassos. 2019. A conceptual perspective on interoperability in context-aware software systems. Information and Software Technology 114 (2019), 231–257.
Srikanth Mujjiga and Srihari Sukumaran. 2007. Modelling and test generation using SAL for interoperability testing in Consumer Electronics. In Proceedings of the second workshop on Automated formal methods. 32–40.
Mohammad Abdur Razzaque, Marija Milojevic-Jevric, Andrei Palade, and Siobhán Clarke. 2015. Middleware for internet of things: a survey. IEEE Internet of things journal 3, 1 (2015), 70–95.
S Revell. 2013. Internet of things (IoT) and machine to machine communications (M2M) challenges and opportunities. Final Paper, London, UK Google Scholar (2013).
Bruno P Santos, Lucas A Silva, CSFS Celes, João B Borges, Bruna S Peres Neto, Marcos Augusto M Vieira, Luiz Filipe M Vieira, Olga N Goussevskaia, and Antonio Loureiro. 2016. Internet das coisas: da teoria à prática. Minicursos SBRC-Simpósio Brasileiro de Redes de Computadores e Sistemas Distribuıdos 31 (2016), 16.
Luis Fernando Sayão and Carlos Henrique Marcondes. 2008. O desafio da interoperabilidade e as novas perspectivas para as bibliotecas digitais. Transinformação 20 (2008), 133–148.
Sabrina Sicari, Alessandra Rizzardi, Luigi Alfredo Grieco, and Alberto Coen-Porisini. 2015. Security, privacy and trust in Internet of Things: The road ahead. Computer networks 76 (2015), 146–164.
Valéria Martins da Silva. 2019. ScenarIoT: support for scenario specification of internet of things-based software systems. (2019).
Delfina de Sá Soares. 2010. Interoperabilidade entre sistemas de informação na Administração Pública. (2010).
Harald Sundmaeker, Patrick Guillemin, Peter Friess, Sylvie Woelfflé, et al. 2010. Vision and challenges for realising the Internet of Things. Cluster of European research projects on the internet of things, European Commision 3, 3 (2010), 34–36.
Tasmota. 2024. Open source firmware for ESP devices. [link]
Souvik Pal Valentina Emilia Balas. 2020. Healthcare Paradigms in the Internet of Things Ecosystem. Academic Press; 1st edition.
Leila Cristina Weiss et al. 2019. Interoperabilidade semântica: uma análise sob a perspectiva da abordagem ontológica de Willard van Orman Quine. (2019).
Wireshark. 2024. The world’s most popular network protocol analyzer. [link]
Claes Wohlin, Per Runeson, Martin Höst, Magnus C Ohlsson, Björn Regnell, and Anders Wesslén. 2012. Experimentation in Software Engineering. Springer Science & Business Media.
Fatiha Zaidi, Emmanuel Bayse, and Ana Cavalli. 2009. Network protocol interoperability testing based on contextual signatures and passive testing. In Proceedings of the 2009 ACM symposium on Applied Computing. 2–7.
Publicado
14/10/2024
Como Citar
CASTELO BRANCO, Karina da Silva; DANTAS, Valéria Lelli Leitão; CARVALHO, Liana Mara.
Interoperability Testing Guide for the Internet of Things. In: BRAZILIAN SYMPOSIUM ON MULTIMEDIA AND THE WEB (WEBMEDIA), 30. , 2024, Juiz de Fora/MG.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2024
.
p. 188-196.
DOI: https://doi.org/10.5753/webmedia.2024.242058.
