Integration of Smartwatches in Low-Cost Virtual Environments: A Systematic Literature Review with Emphasis on Cardboard Devices
Resumo
In this work, we investigated the integration between smartwatches and Cardboard devices for interaction in low-cost virtual environments. We analyzed five related works that explored this integration and discussed the main trends and challenges identified. The results revealed that different interaction methods, such as on-screen gestures, physical movements, and physiological sensors, were employed in the works. The integration between smartwatches and Cardboard devices presents a promising field for future research. New interaction methods, improvements in gesture recognition algorithms, and the expansion of additional device options are some of the identified research opportunities. This integration can offer a more immersive and interactive experience in virtual reality, making it more accessible and engaging for users. Future work can focus on refining these approaches, considering different devices, and exploring aspects related to usability and user acceptance. This work contributed to understanding the evolution and possibilities of integrating smartwatches and Cardboard devices, paving the way for innovations in this promising field of low-cost virtual reality.
Palavras-chave:
HMD devices, Google cardboard, smartwatches, virtual reality, interaction
Referências
Carlos Bermejo and Pan Hui. 2021. A Survey on Haptic Technologies for Mobile Augmented Reality. ACM Comput. Surv. 54, 9, Article 184 (10 2021).
Damien Brun. 2018. Multimodal and Context-Aware Interaction in Augmented Reality for Active Assistance. In Proceedings of the 20th ACM International Conference on Multimodal Interaction (Boulder, CO, USA) (ICMI ’18). Association for Computing Machinery, New York, NY, USA.
Damien Brun, Susan M Ferreira, Charles Gouin-Vallerand, and Sébastien George. 2017. A mobile platform for controlling and interacting with a do-it-yourself smart eyewear. International Journal of Pervasive Computing and Communications 13, 1 (2017).
Paul Dourish. 2001. Where the action is: the foundations of embodied interaction. MIT press.
Augusto Esteves, Yonghwan Shin, and Ian Oakley. 2020. Comparing selection mechanisms for gaze input techniques in head-mounted displays. International Journal of Human-Computer Studies 139 (2020).
Thamer Horbylon Nascimento, Cristiane B. R. Ferreira, Wellington G. Rodrigues, and Fabrizzio Soares. 2020. Interaction with Smartwatches Using Gesture Recognition: A Systematic Literature Review. In 2020 IEEE 44th Annual Computers, Software, and Applications Conference (COMPSAC). 1661–1666. https://doi.org/10.1109/COMPSAC48688.2020.00-17
Muhammad Ismail Mat Isham, Habibah Norehan Hj Haron, Farhan bin Mohamed, Chan Vei Siang, Mohd Khalid Mokhtar, and Adlin Shaflina binti Azizo. 2020. Mobile VR and marker tracking method applied in virtual welding simulation kit for welding training. In 2020 6th International Conference on Interactive Digital Media (ICIDM). IEEE.
Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’97). Association for Computing Machinery, New York, NY, USA, 234–241. https://doi.org/10.1145/258549.258715
Mauri Kaipainen, Niklas Ravaja, Pia Tikka, Rasmus Vuori, Roberto Pugliese, Marco Rapino, and Tapio Takala. 2011. Enactive Systems and Enactive Media: Embodied Human-Machine Coupling beyond Interfaces. Leonardo 44, 5 (10 2011), 433–438. https://doi.org/10.1162/LEON_a_00244 arXiv: [link].
Daniel Kharlamov, Brandon Woodard, Liudmila Tahai, and Krzysztof Pietroszek. 2016. TickTockRay: Smartwatch-Based 3D Pointing for Smartphone-Based Virtual Reality. In Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology (Munich, Germany) (VRST ’16). Association for Computing Machinery, New York, NY, USA.
Barbara Kitchenham. 2004. Procedures for performing systematic reviews. Keele, UK, Keele University 33, 2004 (2004), 1–26.
Lik-Hang Lee and Pan Hui. 2018. Interaction Methods for Smart Glasses: A Survey. IEEE Access 6 (2018). https://doi.org/10.1109/ACCESS.2018.2831081
David Moher, Alessandro Liberati, Jennifer Tetzlaff, Douglas G Altman, and the PRISMA Group*. 2009. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Annals of internal medicine 151, 4 (2009), 264–269.
John Edison Muñoz, Teresa Paulino, Harry Vasanth, and Karolina Baras. 2016. PhysioVR: A novel mobile virtual reality framework for physiological computing. In 2016 IEEE 18th International Conference on e-Health Networking, Applications and Services (Healthcom). https://doi.org/10.1109/HealthCom.2016.7749512
Thamer Horbylon Nascimento, Fabrizzio Alphonsus A. M. Nunes Soares, Danilo Vieira Oliveira, Rogerio Lopes Salvini, Ronaldo Martins da Costa, and Cristhiane Gonçalves. 2017. Method for Text Input with Google Cardboard: An Approach Using Smartwatches and Continuous Gesture Recognition. In 2017 19th Symposium on Virtual and Augmented Reality (SVR). https://doi.org/10.1109/SVR.2017.36
Kyeong-Beom Park and Jae Yeol Lee. 2019. New Design and Comparative Analysis of Smartwatch Metaphor-Based Hand Gestures for 3D Navigation in Mobile Virtual Reality. Multimedia Tools Appl. 78, 5 (3 2019).
Francisco J Varela, Evan Thompson, and Eleanor Rosch. 1992. The embodied mind: Cognitive science and human experience. MIT press.
Mark Weiser. 1991. The Computer for the 21 st Century. Scientific American 265, 3 (1991), 94–105. [link]
Damien Brun. 2018. Multimodal and Context-Aware Interaction in Augmented Reality for Active Assistance. In Proceedings of the 20th ACM International Conference on Multimodal Interaction (Boulder, CO, USA) (ICMI ’18). Association for Computing Machinery, New York, NY, USA.
Damien Brun, Susan M Ferreira, Charles Gouin-Vallerand, and Sébastien George. 2017. A mobile platform for controlling and interacting with a do-it-yourself smart eyewear. International Journal of Pervasive Computing and Communications 13, 1 (2017).
Paul Dourish. 2001. Where the action is: the foundations of embodied interaction. MIT press.
Augusto Esteves, Yonghwan Shin, and Ian Oakley. 2020. Comparing selection mechanisms for gaze input techniques in head-mounted displays. International Journal of Human-Computer Studies 139 (2020).
Thamer Horbylon Nascimento, Cristiane B. R. Ferreira, Wellington G. Rodrigues, and Fabrizzio Soares. 2020. Interaction with Smartwatches Using Gesture Recognition: A Systematic Literature Review. In 2020 IEEE 44th Annual Computers, Software, and Applications Conference (COMPSAC). 1661–1666. https://doi.org/10.1109/COMPSAC48688.2020.00-17
Muhammad Ismail Mat Isham, Habibah Norehan Hj Haron, Farhan bin Mohamed, Chan Vei Siang, Mohd Khalid Mokhtar, and Adlin Shaflina binti Azizo. 2020. Mobile VR and marker tracking method applied in virtual welding simulation kit for welding training. In 2020 6th International Conference on Interactive Digital Media (ICIDM). IEEE.
Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’97). Association for Computing Machinery, New York, NY, USA, 234–241. https://doi.org/10.1145/258549.258715
Mauri Kaipainen, Niklas Ravaja, Pia Tikka, Rasmus Vuori, Roberto Pugliese, Marco Rapino, and Tapio Takala. 2011. Enactive Systems and Enactive Media: Embodied Human-Machine Coupling beyond Interfaces. Leonardo 44, 5 (10 2011), 433–438. https://doi.org/10.1162/LEON_a_00244 arXiv: [link].
Daniel Kharlamov, Brandon Woodard, Liudmila Tahai, and Krzysztof Pietroszek. 2016. TickTockRay: Smartwatch-Based 3D Pointing for Smartphone-Based Virtual Reality. In Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology (Munich, Germany) (VRST ’16). Association for Computing Machinery, New York, NY, USA.
Barbara Kitchenham. 2004. Procedures for performing systematic reviews. Keele, UK, Keele University 33, 2004 (2004), 1–26.
Lik-Hang Lee and Pan Hui. 2018. Interaction Methods for Smart Glasses: A Survey. IEEE Access 6 (2018). https://doi.org/10.1109/ACCESS.2018.2831081
David Moher, Alessandro Liberati, Jennifer Tetzlaff, Douglas G Altman, and the PRISMA Group*. 2009. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Annals of internal medicine 151, 4 (2009), 264–269.
John Edison Muñoz, Teresa Paulino, Harry Vasanth, and Karolina Baras. 2016. PhysioVR: A novel mobile virtual reality framework for physiological computing. In 2016 IEEE 18th International Conference on e-Health Networking, Applications and Services (Healthcom). https://doi.org/10.1109/HealthCom.2016.7749512
Thamer Horbylon Nascimento, Fabrizzio Alphonsus A. M. Nunes Soares, Danilo Vieira Oliveira, Rogerio Lopes Salvini, Ronaldo Martins da Costa, and Cristhiane Gonçalves. 2017. Method for Text Input with Google Cardboard: An Approach Using Smartwatches and Continuous Gesture Recognition. In 2017 19th Symposium on Virtual and Augmented Reality (SVR). https://doi.org/10.1109/SVR.2017.36
Kyeong-Beom Park and Jae Yeol Lee. 2019. New Design and Comparative Analysis of Smartwatch Metaphor-Based Hand Gestures for 3D Navigation in Mobile Virtual Reality. Multimedia Tools Appl. 78, 5 (3 2019).
Francisco J Varela, Evan Thompson, and Eleanor Rosch. 1992. The embodied mind: Cognitive science and human experience. MIT press.
Mark Weiser. 1991. The Computer for the 21 st Century. Scientific American 265, 3 (1991), 94–105. [link]
Publicado
06/11/2023
Como Citar
DE CASTRO, Murilo Santos; GOMES, Pedro Raphael Inácio; NASCIMENTO, Thamer Horbylon.
Integration of Smartwatches in Low-Cost Virtual Environments: A Systematic Literature Review with Emphasis on Cardboard Devices. In: SIMPÓSIO DE REALIDADE VIRTUAL E AUMENTADA (SVR), 25. , 2023, Rio Grande/RS.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2023
.
p. 279–283.
