Proposal for an Interactional Environment based on a Programmable Intelligent Space

• Pedro Vinicius dos Santos Custodio UFES
• Felippe Mendonça de Queiroz UFES
• Douglas Almonfrey IFES http://orcid.org/0000-0002-0547-3494
• Wagner Augusto Aranda Cotta UFES http://orcid.org/0000-0002-6771-2972
• Alexandre Pereira do Carmo IFES http://orcid.org/0000-0002-7219-9229
• Raquel Frizera Vassallo UFES http://orcid.org/0000-0002-4762-3219

DOI: https://doi.org/10.5753/sbcup.2020.11224

Abstract

Recently, the creation of smart spaces has been the focus of many works. One of the features, usually sought for these environments, is the interaction with users. Aimming at this direction, this work proposes the creation of an Interactional Environment based on a Programmable Intelligent Space, which guarantees flexibility and scalability to the system. Thus, in this paper some essential services, such as 2D detection and 3D skeleton localization, to support more complex ones, are developed and tested. To validate the proposed approach, an application that makes use of all the essential services presented is executed and evaluated.

Keywords: Inteliigent Space, Interactional Space, Computer Vision, Skeleton Detection, Occupation Map

References

Almonfrey, D., do Carmo, A. P., de Queiroz, F. M., Picoreti, R., Vassallo, R. F., andSalles, E. O. T. (2018). A flexible human detection service suitable for intelligentspaces based on a multi-camera network.International Journal of DistributedSensor Networks, 14(3):1550147718763550.

Bhardwaj, S., Ozcelebi, T., Lukkien, J. J., and Lee, K. M. (2018). Smart spaceconcepts, properties and architectures.IEEE Access, 6:70088–70112.

Carmo, A. P., Vassallo, R. F., Queiroz, F. M., Picoreti, R., Fernandes, M. R.,Gomes, R. L., Martinello, M., Dominicini, C. K., Guimarães, R., Garcia, A. S.,Ribeiro, M. R. N., and Simeonidou, D. (2019). Programmable intelligent spacesfor Industry 4.0: Indoor visual localization driving attocell networks.Transactionson Emerging Telecommunications Technologies, page e3610.

Casillas-Perez, D., Macias-Guarasa, J., Marron-Romera, M., Fuentes-Jimenez, D.,and Fernandez-Rincon, A. (2016). Full body gesture recognition for human-machine interaction in intelligent spaces. In Ortu ̃no, F. and Rojas, I., editors,Bioinformatics and Biomedical Engineering. IWBBIO 2016, volume 9656, Cham.Springer International Publishing.

Chen, R., Wang, X., Liu, Y., Wang, S., and Huang, S. (2019). A survey of pedestriandetection based on deep learning. InInternational Conference in Communicati-ons, Signal Processing, and Systems, pages 1511–1516. Springer.

dos-Santos, C. C., Samatelo, J. L. A., and Vassallo, R. F. (2020). Dynamic gesturerecognition by using cnns and star rgb: A temporal information condensation.Neurocomputing, in Press.

Fowler, M. and Lewis, J. (2014). Microservices a definition of this new architecturalterm.http://martinfowler.com/articles/microservices.html.

Garrido-Jurado, S., Mu ̃noz-Salinas, R., Madrid-Cuevas, F., and Mar ́ın-Jim ́enez, M.(2014). Automatic generation and detection of highly reliable fiducial markersunder occlusion.Pattern Recognition, 47(6):2280 – 2292.

Gherghescu, I. (2018). Interactive spaces a change in scenographic aesthetics. In2018IEEE 14th International Conference on Intelligent Computer Communication andProcessing (ICCP), pages 159–163.

Glas., D. F., Kamei, K., Kanda, T., Miyashita, T., and Hagita, N. (2015). Human-robot interaction in public and smart spaces.Intelligent Assistive Robots: RecentAdvances in Assistive Robotics for Everyday Activities, 106:235–273.

Joo, H., Liu, H., Tan, L., Gui, L., Nabbe, B., Matthews, I., Kanade, T., Nobuhara,S., and Sheikh, Y. (2015). Panoptic studio: A massively multiview system forsocial motion capture. In2015 IEEE International Conference on ComputerVision (ICCV), pages 3334–3342.

Mitra, S. and Acharya, T. (2007). Gesture recognition: A survey.IEEE Tran-sactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews),37(3):311–324.

M ̈oller, D. P. F. (2016).Ubiquitous Computing, pages 185–234. Springer Internati-onal Publishing, Cham.

Picoreti, R., Pereira do Carmo, A., Mendon ̧ca de Queiroz, F., Salles Garcia,A., Frizera Vassallo, R., and Simeonidou, D. (2018).Multilevel observabi-lity in cloud orchestration. In2018 IEEE 16th International Conference onDASC/PiCom/DataCom/CyberSciTech, pages 776–784.

Queiroz, F., Picoreti, R., Canuto, C., Fernandes, M., and Vassallo, R. (2018). Esti-mating tridimensional coordinates of skeleton joints in a multicamera system. InAnais do XIV Workshop de Vis ̃ao Computacional.

Redmon, J. and Farhadi, A. (2018). Yolov3: An incremental improvement.arXiv.

Ryan, M.-L. (1999). Immersion vs. interactivity: Virtual reality and literary theory.SubStance, 28(2):110–137.

Vega-Barbas, M., Pau, I., Augusto, J. C., and Seoane, F. (2018). Interaction patternsfor smart spaces: A confident interaction design solution for pervasive sensitiveiot services.IEEE Access, 6:1126–1136.

Wang, X., Bernardos, A. M., Besada, J. A., Metola, E., and Casar, J. R. (2015). Agesture-based method for natural interaction in smart spaces.Journal of AmbientIntelligence and Smart Environments, 7:535–562.

Wei, S.-E., Ramakrishna, V., Kanade, T., and Sheikh, Y. (2016). Convolutional posemachines.2016 IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pages 4724–4732.

Zhang, H.-B., Zhang, Y.-X., Zhong, B., Lei, Q., Yang, L., Du, J.-X., and Chen,D.-S. (2019). A comprehensive survey of vision-based human action recognitionmethods.Sensors, 19(5):1005.