skip to main content
10.1145/3625008.3625046acmotherconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
short-paper

Quantifying the 'Gorilla Arm' Effect in a Virtual Reality Text Entry Task via Ray-Casting: A Preliminary Single-Subject Study

Published:06 January 2024Publication History

ABSTRACT

Inputting text is a fundamental task users perform in immersive virtual reality (VR) environments. This preliminary study quantifies the ‘gorilla arm’ effect regarding the required torque in the upper limb joints of an individual during a VR text entry task via ray-casting. This type of fatigue can be caused by the weight of the users’ arms, depending on the arm pose maintained during a task. We used motion capture technology to compare the required arm joints’ torque in two typical arm poses during VR text entry tasks. The results suggest that extending the arm higher and in front of the body towards the virtual keyboard causes about 3.77 times more net torque on the shoulder joint and 2.00 times more on the elbow joint, compared to when the arm is in a more relaxed and lowered position. These findings can support future VR text entry studies concerned with physical ergonomics.

References

  1. Jiban Adhikary and Keith Vertanen. 2021. Text Entry in Virtual Environments using Speech and a Midair Keyboard. IEEE Transactions on Visualization and Computer Graphics 27, 5 (2021), 2648–2658. https://doi.org/10.1109/TVCG.2021.3067776Google ScholarGoogle ScholarCross RefCross Ref
  2. Meta Quest Blog. 2023. Meta Quest v50 Update: ‘Tap’ and ‘Swipe’ Through the Home UI With New Direct Touch Feature, Plus In-Game Multitasking and More. Retrieved Jun 16, 2023 from https://www.meta.com/blog/quest/meta-quest-v50-direct-touch-in-game-multitasking/Google ScholarGoogle Scholar
  3. Sebastian Boring, Marko Jurmu, and Andreas Butz. 2009. Scroll, Tilt or Move It: Using Mobile Phones to Continuously Control Pointers on Large Public Displays. In Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7 (Melbourne, Australia) (OZCHI ’09). Association for Computing Machinery, New York, NY, USA, 161–168. https://doi.org/10.1145/1738826.1738853Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Douglas A. Bowman. 1999. Interaction Techniques for Common Tasks in Immersive Virtual Environments: Design, Evaluation, and Application. Ph. D. Dissertation. Georgia Institute of Technology, Atlanta, GA, USA.Google ScholarGoogle Scholar
  5. Don B. Chaffin, Gunnar B. J. Andersson, and Bernard J. Martin. 2006. Occupational Biomechanics (4 ed.). John Wiley & Sons, New Jersey. 376 pages.Google ScholarGoogle Scholar
  6. A. Cockburn, P. Quinn, C. Gutwin, G. Ramos, and J. Looser. 2011. Air pointing: Design and evaluation of spatial target acquisition with and without visual feedback. International Journal of Human-Computer Studies 69, 6 (2011), 401–414. https://doi.org/10.1016/j.ijhcs.2011.02.005Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Jessyca L. Derby, Emily A. Rickel, Kelly J. Harris, Jade A. Lovell, and Barbara S. Chaparro. 2020. “We Didn’t Catch That!” Using Voice Text Input on a Mixed Reality Headset in Noisy Environments. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 64, 1 (2020), 2102–2106. https://doi.org/10.1177/1071181320641509Google ScholarGoogle ScholarCross RefCross Ref
  8. Tafadzwa Joseph Dube and Ahmed Sabbir Arif. 2019. Text Entry in Virtual Reality: A Comprehensive Review of the Literature. In Human-Computer Interaction. Recognition and Interaction Technologies, Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 419–437. https://doi.org/10.1007/978-3-030-22643-5_33Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Jens Grubert, Lukas Witzani, Eyal Ofek, Michel Pahud, Matthias Kranz, and Per Ola Kristensson. 2018. Text Entry in Immersive Head-Mounted Display-Based Virtual Reality Using Standard Keyboards. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 159–166. https://doi.org/10.1109/VR.2018.8446059Google ScholarGoogle ScholarCross RefCross Ref
  10. Joseph Hamill, Kathleen M. Knutzen, and Timothy R. Derrick. 2015. Biomechanical Basis of Human Movement (4 ed.). Wolters Kluwer Health, Philadelphia. 484 pages.Google ScholarGoogle Scholar
  11. Chris Harrison, Shilpa Ramamurthy, and Scott E. Hudson. 2012. On-Body Interaction: Armed and Dangerous. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction (Kingston, Ontario, Canada) (TEI ’12). Association for Computing Machinery, New York, NY, USA, 69–76. https://doi.org/10.1145/2148131.2148148Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Robert H. Horner, Edward G. Carr, James Halle, Gail McGee, Samuel Odom, and Mark Wolery. 2005. The Use of Single-Subject Research to Identify Evidence-Based Practice in Special Education. Exceptional Children 71, 2 (2005), 165–179. https://doi.org/10.1177/001440290507100203Google ScholarGoogle ScholarCross RefCross Ref
  13. Shigeru Iwakabe and Nicola Gazzola. 2009. From single-case studies to practice-based knowledge: Aggregating and synthesizing case studies. Psychotherapy Research 19, 4-5 (2009), 601–611. https://doi.org/10.1080/10503300802688494Google ScholarGoogle ScholarCross RefCross Ref
  14. Sujin Jang, Wolfgang Stuerzlinger, Satyajit Ambike, and Karthik Ramani. 2017. Modeling Cumulative Arm Fatigue in Mid-Air Interaction Based on Perceived Exertion and Kinetics of Arm Motion. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3328–3339. https://doi.org/10.1145/3025453.3025523Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Jason Jerald. 2015. The VR Book: Human-Centered Design for Virtual Reality. Association for Computing Machinery and Morgan & Claypool Publishers. 635 pages. https://doi.org/10.1145/2792790Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Joseph J. LaViola Jr., Ernst Kruijff, Ryan P. McMahan, Doug A. Bowman, and Ivan Poupyrev. 2017. 3D User Interfaces: Theory and Practice (2 ed.). Addison-Wesley Professional, Boston. 624 pages.Google ScholarGoogle Scholar
  17. I. Scott MacKenzie and R. William Soukoreff. 2003. Phrase Sets for Evaluating Text Entry Techniques. Association for Computing Machinery, New York, NY, USA, 754–755. https://doi.org/10.1145/765891.765971Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Mark McGill, Daniel Boland, Roderick Murray-Smith, and Stephen Brewster. 2015. A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 2143–2152. https://doi.org/10.1145/2702123.2702382Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. D. Mendes, F. M. Caputo, A. Giachetti, A. Ferreira, and J. Jorge. 2019. A Survey on 3D Virtual Object Manipulation: From the Desktop to Immersive Virtual Environments. Computer Graphics Forum 38, 1 (2019), 21–45. https://doi.org/10.1111/cgf.13390Google ScholarGoogle ScholarCross RefCross Ref
  20. Aarthi Easwara Moorthy and Kim-Phuong L. Vu. 2015. Privacy Concerns for Use of Voice Activated Personal Assistant in the Public Space. International Journal of Human–Computer Interaction 31, 4 (2015), 307–335. https://doi.org/10.1080/10447318.2014.986642Google ScholarGoogle ScholarCross RefCross Ref
  21. Vijayakumar Nanjappan, Hai-Ning Liang, Feiyu Lu, Konstantinos Papangelis, Yong Yue, and Ka Lok Man. 2018. User-Elicited Dual-Hand Interactions for Manipulating 3D Objects in Virtual Reality Environments. Human-centric Computing and Information Sciences 8, 1, Article 154 (2018), 16 pages. https://doi.org/10.1186/s13673-018-0154-5Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Krzysztof Pietroszek. 2018. Raycasting in Virtual Reality. In Encyclopedia of Computer Graphics and Games, Newton Lee (Ed.). Springer International Publishing, Cham, 1–3. https://doi.org/10.1007/978-3-319-08234-9_180-1Google ScholarGoogle ScholarCross RefCross Ref
  23. Stanley Plagenhoef, F. Gaynor Evans, and Thomas Abdelnour. 1983. Anatomical Data for Analyzing Human Motion. Research Quarterly for Exercise and Sport 54, 2 (1983), 169–178. https://doi.org/10.1080/02701367.1983.10605290Google ScholarGoogle ScholarCross RefCross Ref
  24. Marco Speicher, Anna Maria Feit, Pascal Ziegler, and Antonio Krüger. 2018. Selection-Based Text Entry in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174221Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Keith Vertanen. 2009. Efficient Correction Interfaces for Speech Recognition. Ph. D. Dissertation. University of Cambridge, Cambridge, UK. https://www.keithv.com/pub/phd/efficient_correction_speech.pdfGoogle ScholarGoogle Scholar
  26. Ana Villanueva, Sujin Jang, Wolfgang Stuerzlinger, Satyajit Ambike, and Karthik Ramani. 2023. Advanced modeling method for quantifying cumulative subjective fatigue in mid-air interaction. International Journal of Human-Computer Studies 169 (2023), 102931. https://doi.org/10.1016/j.ijhcs.2022.102931Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Oculus VR. 2020. Introducing Oculus Quest 2, the Next Generation of All-in-One VR. Retrieved Nov 25, 2022 from https://developer.oculus.com/blog/introducing-oculus-quest-2-the-next-generation-of-all-in-one-vr/Google ScholarGoogle Scholar
  28. James Walker, Bochao Li, Keith Vertanen, and Scott Kuhl. 2017. Efficient Typing on a Visually Occluded Physical Keyboard. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 5457–5461. https://doi.org/10.1145/3025453.3025783Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Quantifying the 'Gorilla Arm' Effect in a Virtual Reality Text Entry Task via Ray-Casting: A Preliminary Single-Subject Study

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          SVR '23: Proceedings of the 25th Symposium on Virtual and Augmented Reality
          November 2023
          315 pages
          ISBN:9798400709432
          DOI:10.1145/3625008

          Copyright © 2023 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 6 January 2024

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • short-paper
          • Research
          • Refereed limited
        • Article Metrics

          • Downloads (Last 12 months)28
          • Downloads (Last 6 weeks)13

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format