smAR2t: a Models at Runtime Architecture to Interact with the Web Of Things using Augmented Reality

  • Jagni Dasa Horta Bezerra
  • Cidcley Teixeira de Souza


The Internet of Things has a high heterogeneity of devices, cloud services, communication protocols and comprises different research and development areas. This implies in ease-of-use problems for users who interact with high-density smart environments using common interface solutions, demanding specific applications for each device. There are also situations where things change their locations and networks, bringing even more complexity to this scenery. A great number of recent researches point Augmented Reality(AR) as an interface solution that is capable of providing rich user experiences for high-density IoT environments. W3C's Web of Things standards(WoT) are proving to be a feasible solution for IoT's heterogeneity issues by using well-known web protocols and the Thing Description(TD) formal model. This paper's goal is to propose an architecture called smAR2t that integrates these solutions by managing mobility, heterogeneity and high-density of smart environments, allowing users to browse their surroundings with AR and to interact with things seamlessly according to each of their TDs. This could be done by: representing TDs in a higher level of abstraction with models; transforming these models at runtime to reflect real-time interactions and behaviors; updating an auto-generated AR interface according to these models.



Sandhya Baskaran and Hari Kumar Nagabushanam. 2018. Relational localization based Augmented reality Interface for IOT applications. In 9th International Conference on Information and Communication Technology Convergence: ICT Convergence Powered by Smart Intelligence, ICTC 2018. 103--106. https: //

Julie Carmigniani and Borko Furht. 2011. Augmented Reality: An Overview. Handbook of Augmented Reality (August 2011), 3--46.

João Pablo S. da Silva, Miguel Ecar, Marcelo S. Pimenta, Gilleanes T. A. Guedes, and Elder M. Rodrigues. 2018. Towards a domain-specific modeling language for self-adaptive systems conceptual modeling. In XXXII Brazilian Symposium on Software Engineering - SBES '18. 208--213.

Tito Gardel do Prado Filho and Cassio Vinicius Serafim Prazeres. 2015. MultiAuth-WoT. Proceedings of the 21st Brazilian Symposium on Multimedia and the Web (2015), 17--24.

Santiago P. Jácome-Guerrero, Marcelo Ferreira, and Alexandra Corral. 2017. Software Development Tools in Model-Driven Engineering. In CONISOFT, The International Conference on Software Engineering Research and Innovation.

Rebeca C. Motta, Káthia M. de Oliveira, and Guilherme H. Travassos. 2018. On challenges in engineering IoT software systems. In XXXII Brazilian Symposium on Software Engineering - SBES '18. 42--51.

Nahal Norouzi, Gerd Bruder, Brandon Belna, Stefanie Mutter, Damla Turgut, and Greg Welch. 2019. A Systematic Review of the Convergence of Augmented Reality, Intelligent Virtual Agents, and the Internet of Things. (2019), 1--24.

Francesco Poggi, Davide Rossi, Paolo Ciancarini, and Luca Bompani. 2016. Semantic run-time models for self-adaptive systems: A case study. In Proceedings - 25th IEEE International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises, WETICE 2016. 50--55.

Bruno P Santos, Lucas A M Silva, Clayson S F S Celes, João B Borges Neto, Bruna S Peres, Marcos Augusto M Vieira, Luiz Filipe M Vieira, Olga N, Goussevskaia, and Antonio A F Loureiro. 2016. Internet das Coisas: da Teoria à Prática. In Simpósio Brasileiro de Redes de Computadores.

Linus Schwab and Arnaud Durand. 2018. Universal Explorer for the Web of Things. Master's thesis. Faculty of Science University of Bern.

Michael Szvetits and Uwe Zdun. 2016. Systematic literature review of the objectives, techniques, kinds, and architectures of models at runtime. Software and Systems Modeling 15, 1 (2016), 31--69.

Arie van Deursen, Paul Klint, and Joost Visser. 2000. Domain-specific languages: an annotated bibliography. ACM SIGPLAN Notices 35, 6 (Jun 2000), 26--36.

Thomas Zachariah and Prabal Dutta. 2019. Browsing the Web of Things in Mobile Augmented Reality. Proceedings of the 20th International Workshop on Mobile Computing Systems and Applications (2019), 129--134.
Como Citar

Selecione um Formato
BEZERRA, Jagni Dasa Horta; DE SOUZA, Cidcley Teixeira. smAR2t: a Models at Runtime Architecture to Interact with the Web Of Things using Augmented Reality. In: INSIGHTFUL IDEAS AND EMERGING RESULTS - SIMPÓSIO BRASILEIRO DE ENGENHARIA DE SOFTWARE (SBES), 33. , 2019, Salvador. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2020 .