Quantifying the 'Gorilla Arm' Effect in a Virtual Reality Text Entry Task via Ray-Casting: A Preliminary Single-Subject Study
Resumo
Inputting text is a fundamental task users perform in immersive virtual reality (VR) environments. This preliminary study quantifies the ‘gorilla arm’ effect regarding the required torque in the upper limb joints of an individual during a VR text entry task via raycasting. This type of fatigue can be caused by the weight of the users’ arms, depending on the arm pose maintained during a task. We used motion capture technology to compare the required arm joints’ torque in two typical arm poses during VR text entry tasks. The results suggest that extending the arm higher and in front of the body towards the virtual keyboard causes about 3.77 times more net torque on the shoulder joint and 2.00 times more on the elbow joint, compared to when the arm is in a more relaxed and lowered position. These findings can support future VR text entry studies concerned with physical ergonomics.
Palavras-chave:
virtual reality, text input, gorilla arm syndrome, biomechanics
Referências
Jiban Adhikary and Keith Vertanen. 2021. Text Entry in Virtual Environments using Speech and a Midair Keyboard. IEEE Transactions on Visualization and Computer Graphics 27, 5 (2021), 2648–2658. https://doi.org/10.1109/TVCG.2021.3067776
Meta Quest Blog. 2023. Meta Quest v50 Update: ‘Tap’ and ‘Swipe’ Through the Home UI With New Direct Touch Feature, Plus In-Game Multitasking and More. Retrieved Jun 16, 2023 from [link].
Sebastian Boring, Marko Jurmu, and Andreas Butz. 2009. Scroll, Tilt or Move It: Using Mobile Phones to Continuously Control Pointers on Large Public Displays. In Proceedings of the 21st Annual Conference of the Australian ComputerHuman Interaction Special Interest Group: Design: Open 24/7 (Melbourne, Australia) (OZCHI ’09). Association for Computing Machinery, New York, NY, USA, 161–168. https://doi.org/10.1145/1738826.1738853
Douglas A. Bowman. 1999. Interaction Techniques for Common Tasks in Immersive Virtual Environments: Design, Evaluation, and Application. Ph. D. Dissertation. Georgia Institute of Technology, Atlanta, GA, USA.
Don B. Chaffin, Gunnar B. J. Andersson, and Bernard J. Martin. 2006. Occupational Biomechanics (4 ed.). John Wiley & Sons, New Jersey. 376 pages.
A. Cockburn, P. Quinn, C. Gutwin, G. Ramos, and J. Looser. 2011. Air pointing: Design and evaluation of spatial target acquisition with and without visual feedback. International Journal of Human-Computer Studies 69, 6 (2011), 401–414. https://doi.org/10.1016/j.ijhcs.2011.02.005
Jessyca L. Derby, Emily A. Rickel, Kelly J. Harris, Jade A. Lovell, and Barbara S. Chaparro. 2020. “We Didn’t Catch That!” Using Voice Text Input on a Mixed Reality Headset in Noisy Environments. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 64, 1 (2020), 2102–2106. https://doi.org/10.1177/1071181320641509
Tafadzwa Joseph Dube and Ahmed Sabbir Arif. 2019. Text Entry in Virtual Reality: A Comprehensive Review of the Literature. In Human-Computer Interaction. Recognition and Interaction Technologies, Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 419–437. https://doi.org/10.1007/978-3-030-22643-5_33
Jens Grubert, Lukas Witzani, Eyal Ofek, Michel Pahud, Matthias Kranz, and Per Ola Kristensson. 2018. Text Entry in Immersive Head-Mounted DisplayBased Virtual Reality Using Standard Keyboards. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 159–166. https://doi.org/10.1109/VR.2018.8446059
Joseph Hamill, Kathleen M. Knutzen, and Timothy R. Derrick. 2015. Biomechanical Basis of Human Movement (4 ed.). Wolters Kluwer Health, Philadelphia. 484 pages.
Chris Harrison, Shilpa Ramamurthy, and Scott E. Hudson. 2012. On-Body Interaction: Armed and Dangerous. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction (Kingston, Ontario, Canada) (TEI ’12). Association for Computing Machinery, New York, NY, USA, 69–76. https://doi.org/10.1145/2148131.2148148
Robert H. Horner, Edward G. Carr, James Halle, Gail McGee, Samuel Odom, and Mark Wolery. 2005. The Use of Single-Subject Research to Identify EvidenceBased Practice in Special Education. Exceptional Children 71, 2 (2005), 165–179. https://doi.org/10.1177/001440290507100203
Shigeru Iwakabe and Nicola Gazzola. 2009. From single-case studies to practicebased knowledge: Aggregating and synthesizing case studies. Psychotherapy Research 19, 4-5 (2009), 601–611. https://doi.org/10.1080/10503300802688494
Sujin Jang, Wolfgang Stuerzlinger, Satyajit Ambike, and Karthik Ramani. 2017. Modeling Cumulative Arm Fatigue in Mid-Air Interaction Based on Perceived Exertion and Kinetics of Arm Motion. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3328–3339. https://doi.org/10.1145/3025453.3025523
Jason Jerald. 2015. The VR Book: Human-Centered Design for Virtual Reality. Association for Computing Machinery and Morgan & Claypool Publishers. 635 pages. https://doi.org/10.1145/2792790
Joseph J. LaViola Jr., Ernst Kruijff, Ryan P. McMahan, Doug A. Bowman, and Ivan Poupyrev. 2017. 3D User Interfaces: Theory and Practice (2 ed.). Addison-Wesley Professional, Boston. 624 pages.
I. Scott MacKenzie and R. William Soukoreff. 2003. Phrase Sets for Evaluating Text Entry Techniques. Association for Computing Machinery, New York, NY, USA, 754–755. https://doi.org/10.1145/765891.765971
Mark McGill, Daniel Boland, Roderick Murray-Smith, and Stephen Brewster. 2015. A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 2143–2152. https://doi.org/10.1145/2702123.2702382
D. Mendes, F. M. Caputo, A. Giachetti, A. Ferreira, and J. Jorge. 2019. A Survey on 3D Virtual Object Manipulation: From the Desktop to Immersive Virtual Environments. Computer Graphics Forum 38, 1 (2019), 21–45. https://doi.org/10.1111/cgf.13390
Aarthi Easwara Moorthy and Kim-Phuong L. Vu. 2015. Privacy Concerns for Use of Voice Activated Personal Assistant in the Public Space. International Journal of Human–Computer Interaction 31, 4 (2015), 307–335. https://doi.org/10.1080/10447318.2014.986642
Vijayakumar Nanjappan, Hai-Ning Liang, Feiyu Lu, Konstantinos Papangelis, Yong Yue, and Ka Lok Man. 2018. User-Elicited Dual-Hand Interactions for Manipulating 3D Objects in Virtual Reality Environments. Human-centric Computing and Information Sciences 8, 1, Article 154 (2018), 16 pages. https://doi.org/10.1186/s13673-018-0154-5
Krzysztof Pietroszek. 2018. Raycasting in Virtual Reality. In Encyclopedia of Computer Graphics and Games, Newton Lee (Ed.). Springer International Publishing, Cham, 1–3. https://doi.org/10.1007/978-3-319-08234-9_180-1
Stanley Plagenhoef, F. Gaynor Evans, and Thomas Abdelnour. 1983. Anatomical Data for Analyzing Human Motion. Research Quarterly for Exercise and Sport 54, 2 (1983), 169–178. https://doi.org/10.1080/02701367.1983.10605290
Marco Speicher, Anna Maria Feit, Pascal Ziegler, and Antonio Krüger. 2018. Selection-Based Text Entry in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174221
Keith Vertanen. 2009. Efficient Correction Interfaces for Speech Recognition. Ph. D. Dissertation. University of Cambridge, Cambridge, UK. [link].
Ana Villanueva, Sujin Jang, Wolfgang Stuerzlinger, Satyajit Ambike, and Karthik Ramani. 2023. Advanced modeling method for quantifying cumulative subjective fatigue in mid-air interaction. International Journal of Human-Computer Studies 169 (2023), 102931. https://doi.org/10.1016/j.ijhcs.2022.102931
Oculus VR. 2020. Introducing Oculus Quest 2, the Next Generation of All-in-One VR. Retrieved Nov 25, 2022 from [link].
James Walker, Bochao Li, Keith Vertanen, and Scott Kuhl. 2017. Efficient Typing on a Visually Occluded Physical Keyboard. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 5457–5461. https://doi.org/10.1145/3025453.3025783
Meta Quest Blog. 2023. Meta Quest v50 Update: ‘Tap’ and ‘Swipe’ Through the Home UI With New Direct Touch Feature, Plus In-Game Multitasking and More. Retrieved Jun 16, 2023 from [link].
Sebastian Boring, Marko Jurmu, and Andreas Butz. 2009. Scroll, Tilt or Move It: Using Mobile Phones to Continuously Control Pointers on Large Public Displays. In Proceedings of the 21st Annual Conference of the Australian ComputerHuman Interaction Special Interest Group: Design: Open 24/7 (Melbourne, Australia) (OZCHI ’09). Association for Computing Machinery, New York, NY, USA, 161–168. https://doi.org/10.1145/1738826.1738853
Douglas A. Bowman. 1999. Interaction Techniques for Common Tasks in Immersive Virtual Environments: Design, Evaluation, and Application. Ph. D. Dissertation. Georgia Institute of Technology, Atlanta, GA, USA.
Don B. Chaffin, Gunnar B. J. Andersson, and Bernard J. Martin. 2006. Occupational Biomechanics (4 ed.). John Wiley & Sons, New Jersey. 376 pages.
A. Cockburn, P. Quinn, C. Gutwin, G. Ramos, and J. Looser. 2011. Air pointing: Design and evaluation of spatial target acquisition with and without visual feedback. International Journal of Human-Computer Studies 69, 6 (2011), 401–414. https://doi.org/10.1016/j.ijhcs.2011.02.005
Jessyca L. Derby, Emily A. Rickel, Kelly J. Harris, Jade A. Lovell, and Barbara S. Chaparro. 2020. “We Didn’t Catch That!” Using Voice Text Input on a Mixed Reality Headset in Noisy Environments. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 64, 1 (2020), 2102–2106. https://doi.org/10.1177/1071181320641509
Tafadzwa Joseph Dube and Ahmed Sabbir Arif. 2019. Text Entry in Virtual Reality: A Comprehensive Review of the Literature. In Human-Computer Interaction. Recognition and Interaction Technologies, Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 419–437. https://doi.org/10.1007/978-3-030-22643-5_33
Jens Grubert, Lukas Witzani, Eyal Ofek, Michel Pahud, Matthias Kranz, and Per Ola Kristensson. 2018. Text Entry in Immersive Head-Mounted DisplayBased Virtual Reality Using Standard Keyboards. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 159–166. https://doi.org/10.1109/VR.2018.8446059
Joseph Hamill, Kathleen M. Knutzen, and Timothy R. Derrick. 2015. Biomechanical Basis of Human Movement (4 ed.). Wolters Kluwer Health, Philadelphia. 484 pages.
Chris Harrison, Shilpa Ramamurthy, and Scott E. Hudson. 2012. On-Body Interaction: Armed and Dangerous. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction (Kingston, Ontario, Canada) (TEI ’12). Association for Computing Machinery, New York, NY, USA, 69–76. https://doi.org/10.1145/2148131.2148148
Robert H. Horner, Edward G. Carr, James Halle, Gail McGee, Samuel Odom, and Mark Wolery. 2005. The Use of Single-Subject Research to Identify EvidenceBased Practice in Special Education. Exceptional Children 71, 2 (2005), 165–179. https://doi.org/10.1177/001440290507100203
Shigeru Iwakabe and Nicola Gazzola. 2009. From single-case studies to practicebased knowledge: Aggregating and synthesizing case studies. Psychotherapy Research 19, 4-5 (2009), 601–611. https://doi.org/10.1080/10503300802688494
Sujin Jang, Wolfgang Stuerzlinger, Satyajit Ambike, and Karthik Ramani. 2017. Modeling Cumulative Arm Fatigue in Mid-Air Interaction Based on Perceived Exertion and Kinetics of Arm Motion. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3328–3339. https://doi.org/10.1145/3025453.3025523
Jason Jerald. 2015. The VR Book: Human-Centered Design for Virtual Reality. Association for Computing Machinery and Morgan & Claypool Publishers. 635 pages. https://doi.org/10.1145/2792790
Joseph J. LaViola Jr., Ernst Kruijff, Ryan P. McMahan, Doug A. Bowman, and Ivan Poupyrev. 2017. 3D User Interfaces: Theory and Practice (2 ed.). Addison-Wesley Professional, Boston. 624 pages.
I. Scott MacKenzie and R. William Soukoreff. 2003. Phrase Sets for Evaluating Text Entry Techniques. Association for Computing Machinery, New York, NY, USA, 754–755. https://doi.org/10.1145/765891.765971
Mark McGill, Daniel Boland, Roderick Murray-Smith, and Stephen Brewster. 2015. A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 2143–2152. https://doi.org/10.1145/2702123.2702382
D. Mendes, F. M. Caputo, A. Giachetti, A. Ferreira, and J. Jorge. 2019. A Survey on 3D Virtual Object Manipulation: From the Desktop to Immersive Virtual Environments. Computer Graphics Forum 38, 1 (2019), 21–45. https://doi.org/10.1111/cgf.13390
Aarthi Easwara Moorthy and Kim-Phuong L. Vu. 2015. Privacy Concerns for Use of Voice Activated Personal Assistant in the Public Space. International Journal of Human–Computer Interaction 31, 4 (2015), 307–335. https://doi.org/10.1080/10447318.2014.986642
Vijayakumar Nanjappan, Hai-Ning Liang, Feiyu Lu, Konstantinos Papangelis, Yong Yue, and Ka Lok Man. 2018. User-Elicited Dual-Hand Interactions for Manipulating 3D Objects in Virtual Reality Environments. Human-centric Computing and Information Sciences 8, 1, Article 154 (2018), 16 pages. https://doi.org/10.1186/s13673-018-0154-5
Krzysztof Pietroszek. 2018. Raycasting in Virtual Reality. In Encyclopedia of Computer Graphics and Games, Newton Lee (Ed.). Springer International Publishing, Cham, 1–3. https://doi.org/10.1007/978-3-319-08234-9_180-1
Stanley Plagenhoef, F. Gaynor Evans, and Thomas Abdelnour. 1983. Anatomical Data for Analyzing Human Motion. Research Quarterly for Exercise and Sport 54, 2 (1983), 169–178. https://doi.org/10.1080/02701367.1983.10605290
Marco Speicher, Anna Maria Feit, Pascal Ziegler, and Antonio Krüger. 2018. Selection-Based Text Entry in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174221
Keith Vertanen. 2009. Efficient Correction Interfaces for Speech Recognition. Ph. D. Dissertation. University of Cambridge, Cambridge, UK. [link].
Ana Villanueva, Sujin Jang, Wolfgang Stuerzlinger, Satyajit Ambike, and Karthik Ramani. 2023. Advanced modeling method for quantifying cumulative subjective fatigue in mid-air interaction. International Journal of Human-Computer Studies 169 (2023), 102931. https://doi.org/10.1016/j.ijhcs.2022.102931
Oculus VR. 2020. Introducing Oculus Quest 2, the Next Generation of All-in-One VR. Retrieved Nov 25, 2022 from [link].
James Walker, Bochao Li, Keith Vertanen, and Scott Kuhl. 2017. Efficient Typing on a Visually Occluded Physical Keyboard. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 5457–5461. https://doi.org/10.1145/3025453.3025783
Publicado
06/11/2023
Como Citar
PALMEIRA, Eduardo G. Q.; CAMPOS, Alexandre; MORAES, Ígor A.; DE SIQUEIRA, Alexandre G.; FERREIRA, Marcelo G. G..
Quantifying the 'Gorilla Arm' Effect in a Virtual Reality Text Entry Task via Ray-Casting: A Preliminary Single-Subject Study. In: SIMPÓSIO DE REALIDADE VIRTUAL E AUMENTADA (SVR), 25. , 2023, Rio Grande/RS.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2023
.
p. 274–278.
