ABSTRACT
Inputting text is a fundamental task users perform in immersive virtual reality (VR) environments. This preliminary study quantifies the ‘gorilla arm’ effect regarding the required torque in the upper limb joints of an individual during a VR text entry task via ray-casting. This type of fatigue can be caused by the weight of the users’ arms, depending on the arm pose maintained during a task. We used motion capture technology to compare the required arm joints’ torque in two typical arm poses during VR text entry tasks. The results suggest that extending the arm higher and in front of the body towards the virtual keyboard causes about 3.77 times more net torque on the shoulder joint and 2.00 times more on the elbow joint, compared to when the arm is in a more relaxed and lowered position. These findings can support future VR text entry studies concerned with physical ergonomics.
- Jiban Adhikary and Keith Vertanen. 2021. Text Entry in Virtual Environments using Speech and a Midair Keyboard. IEEE Transactions on Visualization and Computer Graphics 27, 5 (2021), 2648–2658. https://doi.org/10.1109/TVCG.2021.3067776Google ScholarCross Ref
- Meta Quest Blog. 2023. Meta Quest v50 Update: ‘Tap’ and ‘Swipe’ Through the Home UI With New Direct Touch Feature, Plus In-Game Multitasking and More. Retrieved Jun 16, 2023 from https://www.meta.com/blog/quest/meta-quest-v50-direct-touch-in-game-multitasking/Google Scholar
- Sebastian Boring, Marko Jurmu, and Andreas Butz. 2009. Scroll, Tilt or Move It: Using Mobile Phones to Continuously Control Pointers on Large Public Displays. In Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7 (Melbourne, Australia) (OZCHI ’09). Association for Computing Machinery, New York, NY, USA, 161–168. https://doi.org/10.1145/1738826.1738853Google ScholarDigital Library
- Douglas A. Bowman. 1999. Interaction Techniques for Common Tasks in Immersive Virtual Environments: Design, Evaluation, and Application. Ph. D. Dissertation. Georgia Institute of Technology, Atlanta, GA, USA.Google Scholar
- Don B. Chaffin, Gunnar B. J. Andersson, and Bernard J. Martin. 2006. Occupational Biomechanics (4 ed.). John Wiley & Sons, New Jersey. 376 pages.Google Scholar
- A. Cockburn, P. Quinn, C. Gutwin, G. Ramos, and J. Looser. 2011. Air pointing: Design and evaluation of spatial target acquisition with and without visual feedback. International Journal of Human-Computer Studies 69, 6 (2011), 401–414. https://doi.org/10.1016/j.ijhcs.2011.02.005Google ScholarDigital Library
- Jessyca L. Derby, Emily A. Rickel, Kelly J. Harris, Jade A. Lovell, and Barbara S. Chaparro. 2020. “We Didn’t Catch That!” Using Voice Text Input on a Mixed Reality Headset in Noisy Environments. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 64, 1 (2020), 2102–2106. https://doi.org/10.1177/1071181320641509Google ScholarCross Ref
- Tafadzwa Joseph Dube and Ahmed Sabbir Arif. 2019. Text Entry in Virtual Reality: A Comprehensive Review of the Literature. In Human-Computer Interaction. Recognition and Interaction Technologies, Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 419–437. https://doi.org/10.1007/978-3-030-22643-5_33Google ScholarDigital Library
- Jens Grubert, Lukas Witzani, Eyal Ofek, Michel Pahud, Matthias Kranz, and Per Ola Kristensson. 2018. Text Entry in Immersive Head-Mounted Display-Based Virtual Reality Using Standard Keyboards. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 159–166. https://doi.org/10.1109/VR.2018.8446059Google ScholarCross Ref
- Joseph Hamill, Kathleen M. Knutzen, and Timothy R. Derrick. 2015. Biomechanical Basis of Human Movement (4 ed.). Wolters Kluwer Health, Philadelphia. 484 pages.Google Scholar
- Chris Harrison, Shilpa Ramamurthy, and Scott E. Hudson. 2012. On-Body Interaction: Armed and Dangerous. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction (Kingston, Ontario, Canada) (TEI ’12). Association for Computing Machinery, New York, NY, USA, 69–76. https://doi.org/10.1145/2148131.2148148Google ScholarDigital Library
- Robert H. Horner, Edward G. Carr, James Halle, Gail McGee, Samuel Odom, and Mark Wolery. 2005. The Use of Single-Subject Research to Identify Evidence-Based Practice in Special Education. Exceptional Children 71, 2 (2005), 165–179. https://doi.org/10.1177/001440290507100203Google ScholarCross Ref
- Shigeru Iwakabe and Nicola Gazzola. 2009. From single-case studies to practice-based knowledge: Aggregating and synthesizing case studies. Psychotherapy Research 19, 4-5 (2009), 601–611. https://doi.org/10.1080/10503300802688494Google ScholarCross Ref
- Sujin Jang, Wolfgang Stuerzlinger, Satyajit Ambike, and Karthik Ramani. 2017. Modeling Cumulative Arm Fatigue in Mid-Air Interaction Based on Perceived Exertion and Kinetics of Arm Motion. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3328–3339. https://doi.org/10.1145/3025453.3025523Google ScholarDigital Library
- Jason Jerald. 2015. The VR Book: Human-Centered Design for Virtual Reality. Association for Computing Machinery and Morgan & Claypool Publishers. 635 pages. https://doi.org/10.1145/2792790Google ScholarDigital Library
- Joseph J. LaViola Jr., Ernst Kruijff, Ryan P. McMahan, Doug A. Bowman, and Ivan Poupyrev. 2017. 3D User Interfaces: Theory and Practice (2 ed.). Addison-Wesley Professional, Boston. 624 pages.Google Scholar
- I. Scott MacKenzie and R. William Soukoreff. 2003. Phrase Sets for Evaluating Text Entry Techniques. Association for Computing Machinery, New York, NY, USA, 754–755. https://doi.org/10.1145/765891.765971Google ScholarDigital Library
- Mark McGill, Daniel Boland, Roderick Murray-Smith, and Stephen Brewster. 2015. A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 2143–2152. https://doi.org/10.1145/2702123.2702382Google ScholarDigital Library
- D. Mendes, F. M. Caputo, A. Giachetti, A. Ferreira, and J. Jorge. 2019. A Survey on 3D Virtual Object Manipulation: From the Desktop to Immersive Virtual Environments. Computer Graphics Forum 38, 1 (2019), 21–45. https://doi.org/10.1111/cgf.13390Google ScholarCross Ref
- Aarthi Easwara Moorthy and Kim-Phuong L. Vu. 2015. Privacy Concerns for Use of Voice Activated Personal Assistant in the Public Space. International Journal of Human–Computer Interaction 31, 4 (2015), 307–335. https://doi.org/10.1080/10447318.2014.986642Google ScholarCross Ref
- Vijayakumar Nanjappan, Hai-Ning Liang, Feiyu Lu, Konstantinos Papangelis, Yong Yue, and Ka Lok Man. 2018. User-Elicited Dual-Hand Interactions for Manipulating 3D Objects in Virtual Reality Environments. Human-centric Computing and Information Sciences 8, 1, Article 154 (2018), 16 pages. https://doi.org/10.1186/s13673-018-0154-5Google ScholarDigital Library
- Krzysztof Pietroszek. 2018. Raycasting in Virtual Reality. In Encyclopedia of Computer Graphics and Games, Newton Lee (Ed.). Springer International Publishing, Cham, 1–3. https://doi.org/10.1007/978-3-319-08234-9_180-1Google ScholarCross Ref
- Stanley Plagenhoef, F. Gaynor Evans, and Thomas Abdelnour. 1983. Anatomical Data for Analyzing Human Motion. Research Quarterly for Exercise and Sport 54, 2 (1983), 169–178. https://doi.org/10.1080/02701367.1983.10605290Google ScholarCross Ref
- Marco Speicher, Anna Maria Feit, Pascal Ziegler, and Antonio Krüger. 2018. Selection-Based Text Entry in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174221Google ScholarDigital Library
- Keith Vertanen. 2009. Efficient Correction Interfaces for Speech Recognition. Ph. D. Dissertation. University of Cambridge, Cambridge, UK. https://www.keithv.com/pub/phd/efficient_correction_speech.pdfGoogle Scholar
- Ana Villanueva, Sujin Jang, Wolfgang Stuerzlinger, Satyajit Ambike, and Karthik Ramani. 2023. Advanced modeling method for quantifying cumulative subjective fatigue in mid-air interaction. International Journal of Human-Computer Studies 169 (2023), 102931. https://doi.org/10.1016/j.ijhcs.2022.102931Google ScholarDigital Library
- Oculus VR. 2020. Introducing Oculus Quest 2, the Next Generation of All-in-One VR. Retrieved Nov 25, 2022 from https://developer.oculus.com/blog/introducing-oculus-quest-2-the-next-generation-of-all-in-one-vr/Google Scholar
- James Walker, Bochao Li, Keith Vertanen, and Scott Kuhl. 2017. Efficient Typing on a Visually Occluded Physical Keyboard. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 5457–5461. https://doi.org/10.1145/3025453.3025783Google ScholarDigital Library
Index Terms
- Quantifying the 'Gorilla Arm' Effect in a Virtual Reality Text Entry Task via Ray-Casting: A Preliminary Single-Subject Study
Recommendations
Walking in Virtual Reality: Effects of Manipulated Visual Self-Motion on Walking Biomechanics
Walking constitutes the predominant form of self-propelled movement from one geographic location to another in our real world. Likewise, walking in virtual environments (VEs) is an essential part of a users experience in many application domains ...
Investigating the Effects of Position and Angle of Virtual Keyboard on Text Entry Performance and Workload
Asian CHI '21: Proceedings of the Asian CHI Symposium 2021The Virtual Reality (VR) users suffer from neck and arm fatigue. This is because the VR users are required to wear the heavy head–mounted display (HMD) and keep raising the arms. In particular, the virtual keyboards are frequently used and they are time–...
Effect of six degrees of freedom knee kinematics on ligament length and moment arm in an intact knee model
BACKGROUND: Biomechanics studies can help improve athletic performance. However, the biomechanics of knee joint ligament length changes and moment arms over six degrees of freedom (DOF) have yet to be established.
OBJECTIVE: To construct a knee model to ...
Comments