Hand gestures for continuous locomotion and snap turn for VR Experiences
Resumo
Virtual Reality (VR) allows users to move through a plethora of immersive 3D worlds without leaving their spot with techniques such as smooth continuous locomotion. Nowadays, the standard is to do those sorts of inputs with controllers, however, hand tracking is an ever-growing technology that is gradually becoming relevant as one of the main input modalities available. The purpose of this study is to investigate which gestures works better to allow the user to move continuously in Virtual Environments (VEs) while also allowing it to do quick rotations in 45 and 180 degrees (snap turns). The inputs are compared in terms of efficiency, usability, and user preference.
Palavras-chave:
Virtual Reality, Locomotion, Hand Tracking, Human-Computer Interaction, Immersive inputs
Referências
Apple. 2023. Design for spatial input - WWDC23 - Videos - Apple Developer. [link].
Costas Boletsis. 2017. The New Era of Virtual Reality Locomotion: A Systematic Literature Review of Techniques and a Proposed Typology. Multimodal Technologies and Interaction 1, 4 (2017). https://doi.org/10.3390/mti1040024
Gavin Buckingham. 2021. Hand Tracking for Immersive Virtual Reality: Opportunities and Challenges. Frontiers in Virtual Reality 2 (2021). https://doi.org/10.3389/frvir.2021.728461
Massimiliano Di Luca, Hasti Seifi, Simon Egan, and Mar Gonzalez-Franco. 2021. Locomotion Vault: The Extra Mile in Analyzing VR Locomotion Techniques. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 128, 10 pages. https://doi.org/10.1145/3411764.3445319
Aldin Dynamics. 2020. Waltz of the Wizard. [link]
Asim Hameed, Andrew Perkis, and Sebastian Möller. 2021. Evaluating hand-tracking interaction for performing motor-tasks in vr learning environments. In 2021 13th International Conference on Quality of Multimedia Experience (QoMEX). IEEE, 219–224.
Rachel Huang, Carisa Harris-Adamson, Dan Odell, and David Rempel. 2019. Design of finger gestures for locomotion in virtual reality. Virtual Reality & Intelligent Hardware 1, 1 (2019), 1–9.
Jinwook Kim, Hyunyoung Jang, Dooyoung Kim, and Jeongmi Lee. 2022. Exploration of the Virtual Reality Teleportation Methods Using Hand-Tracking, Eye-Tracking, and EEG. International Journal of Human–Computer Interaction 0, 0 (2022), 1–14. https://doi.org/10.1080/10447318.2022.2109248 arXiv: [link].
Facebook Labs. 2021. Elixir VR. [link]
Owlchemy Labs. 2022. Vacation Simulator. [link].
Ultra Leap. [n. d.]. Hand poses - Ultraleap documentation. [link].
Meta. [n. d.]. Best Practices | Oculus Developers. [link].
Meta. 2022. Rogue Ascent VR. [link]
Leap Motion. 2021. Ultraleap.
Thiago Porcino, Derek Reilly, Esteban Clua, and Daniela Trevisan. 2022. A guideline proposal for minimizing cybersickness in VR-based serious games and applications. arxiv:2207.06346 [cs.HC]
Jussi Rantala, Jari Kangas, Olli Koskinen, Tomi Nukarinen, and Roope Raisamo. 2021. Comparison of Controller-Based Locomotion Techniques for Visual Observation in Virtual Reality. Multimodal Technologies and Interaction 5, 7 (2021). https://doi.org/10.3390/mti5070031
David Saffo, Caglar Yildirim, Sara Di Bartolomeo, and Cody Dunne. 2020. Crowdsourcing virtual reality experiments using vrchat. In Extended abstracts of the 2020 chi conference on human factors in computing systems. 1–8.
Alexander Schäfer, Gerd Reis, and Didier Stricker. 2022. Controlling Continuous Locomotion in Virtual Reality with Bare Hands Using Hand Gestures. In Virtual Reality and Mixed Reality, Gabriel Zachmann, Mariano Alcañiz Raya, Patrick Bourdot, Maud Marchal, Jeanine Stefanucci, and Xubo Yang (Eds.). Springer International Publishing, Cham, 191–205.
Alexander Schäfer, Gerd Reis, and Didier Stricker. 2021. Controlling Teleportation-Based Locomotion in Virtual Reality with Hand Gestures: A Comparative Evaluation of Two-Handed and One-Handed Techniques. Electronics 10, 6 (2021). https://doi.org/10.3390/electronics10060715
Alexander Schäfer, Gerd Reis, and Didier Stricker. 2022. Comparing Controller with the Hand Gestures Pinch and Grab for Picking Up and Placing Virtual Objects. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 738–739. https://doi.org/10.1109/VRW55335.2022.00220
Jan-Niklas Voigt-Antons, Tanja Kojic, Danish Ali, and Sebastian Möller. 2020. Influence of hand tracking as a way of interaction in virtual reality on user experience. In 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX). IEEE, 1–4.
Costas Boletsis. 2017. The New Era of Virtual Reality Locomotion: A Systematic Literature Review of Techniques and a Proposed Typology. Multimodal Technologies and Interaction 1, 4 (2017). https://doi.org/10.3390/mti1040024
Gavin Buckingham. 2021. Hand Tracking for Immersive Virtual Reality: Opportunities and Challenges. Frontiers in Virtual Reality 2 (2021). https://doi.org/10.3389/frvir.2021.728461
Massimiliano Di Luca, Hasti Seifi, Simon Egan, and Mar Gonzalez-Franco. 2021. Locomotion Vault: The Extra Mile in Analyzing VR Locomotion Techniques. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 128, 10 pages. https://doi.org/10.1145/3411764.3445319
Aldin Dynamics. 2020. Waltz of the Wizard. [link]
Asim Hameed, Andrew Perkis, and Sebastian Möller. 2021. Evaluating hand-tracking interaction for performing motor-tasks in vr learning environments. In 2021 13th International Conference on Quality of Multimedia Experience (QoMEX). IEEE, 219–224.
Rachel Huang, Carisa Harris-Adamson, Dan Odell, and David Rempel. 2019. Design of finger gestures for locomotion in virtual reality. Virtual Reality & Intelligent Hardware 1, 1 (2019), 1–9.
Jinwook Kim, Hyunyoung Jang, Dooyoung Kim, and Jeongmi Lee. 2022. Exploration of the Virtual Reality Teleportation Methods Using Hand-Tracking, Eye-Tracking, and EEG. International Journal of Human–Computer Interaction 0, 0 (2022), 1–14. https://doi.org/10.1080/10447318.2022.2109248 arXiv: [link].
Facebook Labs. 2021. Elixir VR. [link]
Owlchemy Labs. 2022. Vacation Simulator. [link].
Ultra Leap. [n. d.]. Hand poses - Ultraleap documentation. [link].
Meta. [n. d.]. Best Practices | Oculus Developers. [link].
Meta. 2022. Rogue Ascent VR. [link]
Leap Motion. 2021. Ultraleap.
Thiago Porcino, Derek Reilly, Esteban Clua, and Daniela Trevisan. 2022. A guideline proposal for minimizing cybersickness in VR-based serious games and applications. arxiv:2207.06346 [cs.HC]
Jussi Rantala, Jari Kangas, Olli Koskinen, Tomi Nukarinen, and Roope Raisamo. 2021. Comparison of Controller-Based Locomotion Techniques for Visual Observation in Virtual Reality. Multimodal Technologies and Interaction 5, 7 (2021). https://doi.org/10.3390/mti5070031
David Saffo, Caglar Yildirim, Sara Di Bartolomeo, and Cody Dunne. 2020. Crowdsourcing virtual reality experiments using vrchat. In Extended abstracts of the 2020 chi conference on human factors in computing systems. 1–8.
Alexander Schäfer, Gerd Reis, and Didier Stricker. 2022. Controlling Continuous Locomotion in Virtual Reality with Bare Hands Using Hand Gestures. In Virtual Reality and Mixed Reality, Gabriel Zachmann, Mariano Alcañiz Raya, Patrick Bourdot, Maud Marchal, Jeanine Stefanucci, and Xubo Yang (Eds.). Springer International Publishing, Cham, 191–205.
Alexander Schäfer, Gerd Reis, and Didier Stricker. 2021. Controlling Teleportation-Based Locomotion in Virtual Reality with Hand Gestures: A Comparative Evaluation of Two-Handed and One-Handed Techniques. Electronics 10, 6 (2021). https://doi.org/10.3390/electronics10060715
Alexander Schäfer, Gerd Reis, and Didier Stricker. 2022. Comparing Controller with the Hand Gestures Pinch and Grab for Picking Up and Placing Virtual Objects. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 738–739. https://doi.org/10.1109/VRW55335.2022.00220
Jan-Niklas Voigt-Antons, Tanja Kojic, Danish Ali, and Sebastian Möller. 2020. Influence of hand tracking as a way of interaction in virtual reality on user experience. In 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX). IEEE, 1–4.
Publicado
06/11/2023
Como Citar
KRONEMBERGER, Victhor; CHERULLO, Renato; AZEVEDO, Thiago; PORCINO, Thiago; RAPOSO, Alberto.
Hand gestures for continuous locomotion and snap turn for VR Experiences. In: SIMPÓSIO DE REALIDADE VIRTUAL E AUMENTADA (SVR), 25. , 2023, Rio Grande/RS.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2023
.
p. 243–247.
