Murilo Santos de Castro
ABSTRACT
In this work, we investigated the integration between smartwatches and Cardboard devices for interaction in low-cost virtual environments. We analyzed five related works that explored this integration and discussed the main trends and challenges identified. The results revealed that different interaction methods, such as on-screen gestures, physical movements, and physiological sensors, were employed in the works. The integration between smartwatches and Cardboard devices presents a promising field for future research. New interaction methods, improvements in gesture recognition algorithms, and the expansion of additional device options are some of the identified research opportunities. This integration can offer a more immersive and interactive experience in virtual reality, making it more accessible and engaging for users. Future work can focus on refining these approaches, considering different devices, and exploring aspects related to usability and user acceptance. This work contributed to understanding the evolution and possibilities of integrating smartwatches and Cardboard devices, paving the way for innovations in this promising field of low-cost virtual reality.
- Carlos Bermejo and Pan Hui. 2021. A Survey on Haptic Technologies for Mobile Augmented Reality. ACM Comput. Surv. 54, 9, Article 184 (10 2021).Google Scholar
- Damien Brun. 2018. Multimodal and Context-Aware Interaction in Augmented Reality for Active Assistance. In Proceedings of the 20th ACM International Conference on Multimodal Interaction (Boulder, CO, USA) (ICMI ’18). Association for Computing Machinery, New York, NY, USA.Google ScholarDigital Library
- Damien Brun, Susan M Ferreira, Charles Gouin-Vallerand, and Sébastien George. 2017. A mobile platform for controlling and interacting with a do-it-yourself smart eyewear. International Journal of Pervasive Computing and Communications 13, 1 (2017).Google ScholarCross Ref
- Paul Dourish. 2001. Where the action is: the foundations of embodied interaction. MIT press.Google Scholar
- Augusto Esteves, Yonghwan Shin, and Ian Oakley. 2020. Comparing selection mechanisms for gaze input techniques in head-mounted displays. International Journal of Human-Computer Studies 139 (2020).Google ScholarCross Ref
- Thamer Horbylon Nascimento, Cristiane B. R. Ferreira, Wellington G. Rodrigues, and Fabrizzio Soares. 2020. Interaction with Smartwatches Using Gesture Recognition: A Systematic Literature Review. In 2020 IEEE 44th Annual Computers, Software, and Applications Conference (COMPSAC). 1661–1666. https://doi.org/10.1109/COMPSAC48688.2020.00-17Google ScholarCross Ref
- Muhammad Ismail Mat Isham, Habibah Norehan Hj Haron, Farhan bin Mohamed, Chan Vei Siang, Mohd Khalid Mokhtar, and Adlin Shaflina binti Azizo. 2020. Mobile VR and marker tracking method applied in virtual welding simulation kit for welding training. In 2020 6th International Conference on Interactive Digital Media (ICIDM). IEEE.Google Scholar
- Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’97). Association for Computing Machinery, New York, NY, USA, 234–241. https://doi.org/10.1145/258549.258715Google ScholarDigital Library
- Mauri Kaipainen, Niklas Ravaja, Pia Tikka, Rasmus Vuori, Roberto Pugliese, Marco Rapino, and Tapio Takala. 2011. Enactive Systems and Enactive Media: Embodied Human-Machine Coupling beyond Interfaces. Leonardo 44, 5 (10 2011), 433–438. https://doi.org/10.1162/LEON_a_00244 arXiv:https://direct.mit.edu/leon/article-pdf/44/5/433/1580121/leon_a_00244.pdfGoogle ScholarCross Ref
- Daniel Kharlamov, Brandon Woodard, Liudmila Tahai, and Krzysztof Pietroszek. 2016. TickTockRay: Smartwatch-Based 3D Pointing for Smartphone-Based Virtual Reality. In Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology (Munich, Germany) (VRST ’16). Association for Computing Machinery, New York, NY, USA.Google ScholarDigital Library
- Barbara Kitchenham. 2004. Procedures for performing systematic reviews. Keele, UK, Keele University 33, 2004 (2004), 1–26.Google Scholar
- Lik-Hang Lee and Pan Hui. 2018. Interaction Methods for Smart Glasses: A Survey. IEEE Access 6 (2018). https://doi.org/10.1109/ACCESS.2018.2831081Google ScholarCross Ref
- David Moher, Alessandro Liberati, Jennifer Tetzlaff, Douglas G Altman, and the PRISMA Group*. 2009. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Annals of internal medicine 151, 4 (2009), 264–269.Google ScholarCross Ref
- John Edison Muñoz, Teresa Paulino, Harry Vasanth, and Karolina Baras. 2016. PhysioVR: A novel mobile virtual reality framework for physiological computing. In 2016 IEEE 18th International Conference on e-Health Networking, Applications and Services (Healthcom). https://doi.org/10.1109/HealthCom.2016.7749512Google ScholarCross Ref
- Thamer Horbylon Nascimento, Fabrizzio Alphonsus A. M. Nunes Soares, Danilo Vieira Oliveira, Rogerio Lopes Salvini, Ronaldo Martins da Costa, and Cristhiane Gonçalves. 2017. Method for Text Input with Google Cardboard: An Approach Using Smartwatches and Continuous Gesture Recognition. In 2017 19th Symposium on Virtual and Augmented Reality (SVR). https://doi.org/10.1109/SVR.2017.36Google ScholarCross Ref
- Kyeong-Beom Park and Jae Yeol Lee. 2019. New Design and Comparative Analysis of Smartwatch Metaphor-Based Hand Gestures for 3D Navigation in Mobile Virtual Reality. Multimedia Tools Appl. 78, 5 (3 2019).Google Scholar
- Francisco J Varela, Evan Thompson, and Eleanor Rosch. 1992. The embodied mind: Cognitive science and human experience. MIT press.Google Scholar
- Mark Weiser. 1991. The Computer for the 21 st Century. Scientific American 265, 3 (1991), 94–105. http://www.jstor.org/stable/24938718Google ScholarCross Ref
Index Terms
- Integration of Smartwatches in Low-Cost Virtual Environments: A Systematic Literature Review with Emphasis on Cardboard Devices
Recommendations
Exploring Interaction in a Virtual Music Studio through Gesture Recognition on Smartwatches and HMD Devices
SVR '23: Proceedings of the 25th Symposium on Virtual and Augmented RealityThis work proposes the development of an innovative virtual environment that simulates a music studio, exploring interaction through gesture recognition on smartwatches and mobile virtual reality devices (mVR). By utilizing Multiple Dimensional Dynamic ...
MazeVR: Immersion and Interaction Using Google Cardboard and Continuous Gesture Recognition on Smartwatches
Web3D '23: Proceedings of the 28th International ACM Conference on 3D Web TechnologyThis work presents the development and usability evaluation of the MazeVR game, a maze game designed for the Google Cardboard device. The game allows interactions through head movements to control the camera and gestures on the smartwatch to perform ...
Controller-less Interaction Methods for Google Cardboard
SUI '15: Proceedings of the 3rd ACM Symposium on Spatial User InteractionGoogle Cardboard was recently released as Google's attempt to virtual reality (VR) which has made it more accessible, with its low-cost and easy assembly. The purpose of this research is to provide an initial analysis of controller-less interaction and ...
Comments