Towards a Process for NFRs Evaluation in IoT Applications
Resumo
The Internet of Things (IoT) is a paradigm characterized by a variety of objects that interact with each other using the internet to achieve common goals. IoT applications are more and more present in our lives, either in our homes, or on the streets, or in our work environments. These applications bring new Non-Functional Requirements highly related to the user interaction quality, such as context-awareness, synchronicity, and calmness. The evaluation of these NFRs can be challenging, because we may have to take into account qualitative and quantitative aspects. In this way, the evaluators can be confused about the steps they need to follow and the best order to perform the NFRs evaluation. After conducting a systematic mapping study about the NFR evaluation in IoT applications, we could not find a process that systematizes these activities stepby-step. Therefore, this paper proposes a process for evaluating non-functional requirements in IoT applications. This process divides the quality evaluation into two aspects, qualitative and quantitative, to capture quality measurements and subjective aspects of the IoT applications. To verify whether the established process meets the evaluators' needs, we applied 2 questionnaires with the experts and, based on the obtained results, we made some adjustments and came up with a preliminary version of the process that is presented in this paper.
Referências
Andrade, R. M., Carvalho, R. M., de Araújo, I. L., Oliveira, K. M., and Maia, M. E. (2017). What changes from ubiquitous computing to internet of things in interaction evaluation? In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), volume 10291 LNCS, pages 3–21. Springer Verlag.
Atzori, L., Iera, A., and Morabito, G. (2010). The Internet of Things: A survey. Computer Networks, 54(15):2787–2805.
Basili, V. R., Caldiera, G., and Rombach, H. D. (1994). The goal question metric approach.
Bures, M., Bellekens, X., Frajtak, K., and Ahmed, B. S. (2020). A comprehensive view on quality characteristics of the iot solutions. In José, R., Van Laerhoven, K., and Rodrigues, H., editors, 3rd EAI International Conference on IoT in Urban Space, pages 59–69, Cham. Springer International Publishing.
Carvalho, R. M., Andrade, R. M., and Oliveira, K. M. (2020). How developers believe invisibility impacts nfrs related to user interaction. In 2020 IEEE 28th International Requirements Engineering Conference (RE), pages 102–112. IEEE.
Chung, L., Nixon, B. A., Yu, E., and Mylopoulos, J. (2012). Non-functional requirements in software engineering, volume 5. Springer Science & Business Media.
Corporation, I. D. (2020). Iot growth demands rethink of long-term storage strategies, says idc.
de Souza, B., Motta, R., and Travassos, G. (2019). The first version of scenariotcheck: A checklist for iot based scenarios. In Anais do XXXIII Brazilian Symposium on Software Engineering, Porto Alegre, RS, Brasil. SBC.
Gubbi, J., Buyya, R., Marusic, S., and Palaniswami, M. (2013). Internet of things (iot): A vision, architectural elements, and future directions. Future Generation Computer Systems, 29(7):1645–1660. Including Special sections: Cyber-enabled Distributed Computing for Ubiquitous Cloud and Network Services Cloud Computing and Scientific Applications — Big Data, Scalable Analytics, and Beyond.
ISO/IEC 25000 (2011). ISO/IEC 25000 - Systems and Software Engineering - Systems and Software Quality Requirements and Evaluation (SQuaRE). Technical report. Kim, M. (2016). A quality model for evaluating IoT applications. International Journal of Computer and Electrical Engineering, 8(1):66–76.
Ntoa, S., Margetis, G., Antona, M., and Stephanidis, C. (2021). User experience evaluation in intelligent environments: A comprehensive framework. Technologies, 9(2).
Paiva, J., Andrade, R., and Carvalho, R. (2021). Evaluation of non-functional requirements for IoT applications. In Proceedings of the 23rd International Conference on Enterprise Information Systems. SCITEPRESS - Science and Technology Publications.
Patel, K. K., Patel, S. M., and Scholar, P. G. (2016). Internet of Things-IOT: Definition, Characteristics, Architecture, Enabling Technologies, Application & Future Challenges. International Journal of Engineering Science and Computing.
Preece, J., Sharp, H., and Rogers, Y. (2013). Interaction Design: Beyond Human-Computer Interaction. (In portuguese, Design de interação: Além da Interação Humano-Computador). Bookman, Porto Alegre, Brasil, 3 edition.
Rocha, L. C., Andrade, R. M. C., Sampaio, A. L., and Lelli, V. (2017). Heuristics to evaluate the usability of ubiquitous systems. In Streitz, N. and Markopoulos, P., editors, Distributed, Ambient and Pervasive Interactions, pages 120–141, Cham. Springer International Publishing.
Rowland, C., Goodman, E., Charlier, M., Light, A., and Lui, A. (2015). Designing connected products: UX for the consumer Internet of Things. ” O’Reilly Media, Inc.”.
Ruiz-López, T., Rodríguez-Domínguez, C., Noguera, M., Rodríguez, M. J., Benghazi, K., and Garrido, J. L. (2013). Applying model-driven engineering to a method for systematic treatment of nfrs in ami systems. J. Ambient Intell. Smart Environ., 5(3):287–310.
Weiser, M. (1991). The computer for the 21 st century. Scientific american, 265(3):94–105.
Wiegers, K. and Beatty, J. (2013). Software Requirements, Third Edition. Microsoft Press.
Wittstock, V., Lorenz, M.,Wittstock, E., and Pürzel, F. (2012). A framework for user tests in a virtual environment. In Bebis, G., Boyle, R., Parvin, B., Koracin, D., Fowlkes, C., Wang, S., Choi, M.-H., Mantler, S., Schulze, J., Acevedo, D., Mueller, K., and Papka, M., editors, Advances in Visual Computing, pages 358–367, Berlin, Heidelberg. Springer Berlin Heidelberg.
