Exploring Human Interaction in Virtual Reality: An Experience Report on Users with and without Visual Impairment

Paula C. Fernandes; Gabriel Henrique M. Rocha; Bruno H. Adachi; Flávia P. C. Silvas; Bruno N. Coelho; Saul Delabrida

Paula C. Fernandes Federal University of Ouro Preto / Vale Technological Institute https://orcid.org/0000-0003-0338-7231
Gabriel Henrique M. Rocha Federal University of Ouro Preto https://orcid.org/0009-0006-0435-297X
Bruno H. Adachi Federal University of Ouro Preto https://orcid.org/0009-0000-9740-1959
Flávia P. C. Silvas Vale Technological Institute https://orcid.org/0000-0001-7040-018X
Bruno N. Coelho Federal University of Ouro Preto https://orcid.org/0000-0002-2809-7778
Saul Delabrida Federal University of Ouro Preto https://orcid.org/0000-0002-8961-5313

Abstract

Virtual reality (VR) offers diverse applications across various areas and purposes, yet understanding inclusive and accessible environments for persons with disability (PwD) remains incomplete. Creating scenarios with users of varying interaction abilities is essential to promote equity in virtual environments and ensure inclusive, comprehensive design solutions. Specifically, enabling a level playing field for persons with low vision presents significant challenges, as visual feedback is a primary mode of interaction. This experience report describes the human interaction and user studies involving sixteen volunteers, including nine individuals without disabilities and seven with low vision, within VR environments. The research investigates how VR can be leveraged as a tool for inclusion, creating spaces that are more integrative for PwD. It highlights the necessity of adapting these virtual spaces through tailored approaches that meet the unique needs of persons with visual impairment. The preparation and experimentation emphasize the importance of understanding and anticipating interaction dynamics in VR to effectively include PwD in the technology. Additionally, the study considers alternative feedback, design considerations, and other interaction interfaces to enhance inclusion. The paper discusses the experiences, challenges, and shared insights, aiming to guide future user tests and address VR interactions for individuals with low vision.

Keywords: report experience, user studies, people with disabilities, low vision, visual impairment, virtual reality

References

Alexa F Siu, Mike Sinclair, Robert Kovacs, Eyal Ofek, Christian Holz, and Edward Cutrell. 2020. Virtual reality without vision: A haptic and auditory white cane to navigate complex virtual worlds. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1–13.

Catherine Sable, Alison Gourvès-Hayward, Lovrek Ignac, Babic Jurica, Matea Zilak, Vedran Podobnik, Zeljka Car, Ivana Gace, Iva Topolovac, Hrvoje Vdovic, Ildiko Papp, Marianna Zichar, Maria Potes, Carlos Hernandez, Felipe Peneranda, Ana Keselj, Krunoslav Zubrinic, Teodora Shek, and Dinka Vukovic. 2020. Analysis Of Emerging Technologies For Improving Social Inclusion Of People With Disabilities. Technical Report. University of Zagreb. [link].

Chris Creed, Maadh Al-Kalbani, Arthur Theil, Sayan Sarcar, and Ian Williams. 2023. Inclusive Augmented and Virtual Reality: A Research Agenda. International Journal of Human-Computer Interaction (2023), 1–20. DOI: 10.1080/10447318.2023.2247614

Daniel Sutopo Pamungkas and Koren Ward. 2016. Electro-tactile feedback system to enhance virtual reality experience. International Journal of Computer Theory and Engineering 8, 6 (2016), 465–470. DOI: 10.7763/IJCTE.2016.V8.1090

Gareth R. White, Geraldine Fitzpatrick, and Graham McAllister. 2008. Toward accessible 3D virtual environments for the blind and visually impaired. In Proceedings of the 3rd International Conference on Digital Interactive Media in Entertainment and Arts (Athens, Greece) (DIMEA ’08). Association for Computing Machinery, New York, NY, USA, 134–141. DOI: 10.1145/1413634.1413663

Jinmo Kim. 2020. VIVR: Presence of Immersive Interaction for Visual Impairment Virtual Reality. IEEE Access 8 (2020), 196151–196159. DOI: 10.1109/ACCESS.2020.3034363

John Annett. 2003. Hierarchical task analysis. In Handbook of cognitive task design. CRC Press, 17–36.

Julian Kreimeier and Timo Götzelmann. 2020. Two decades of touchable and walkable virtual reality for blind and visually impaired people: A high-level taxonomy. Multimodal Technologies and interaction 4, 4 (2020), 79.

Khang Dang, Hamdi Korreshi, Yasir Iqbal, and Sooyeon Lee. 2023. Opportunities for Accessible Virtual Reality Design for Immersive Musical Performances for Blind and Low-Vision People. In Proceedings of the 2023 ACM Symposium on Spatial User Interaction (Sydney, Australia) (SUI ’23). Association for Computing Machinery, New York, NY, USA, Article 33, 21 pages. DOI: 10.1145/3607822.3614540

Kristine Jørgensen Isak de Villiers Bosman, Oğuz ‘Oz’ Buruk and Juho Hamari. 2024. The effect of audio on the experience in virtual reality: a scoping review. Behaviour & Information Technology 43, 1 (2024), 165–199. DOI: 10.1080/0144929X.2022.2158371

Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Human Mental Workload, Peter A. Hancock and Najmedin Meshkati (Eds.). Advances in Psychology, Vol. 52. North-Holland, USA, 139–183. DOI: 10.1016/S01664115(08)62386-9

Tonja-katrin Machulla Markus Wieland, Michael Sedlmaior. 2023. VR, Gaze, and Visual Impairment: An Exploratory Study of the Perception of Eye Contact across different Sensory Modalities for People with Visual Impairments in Virtual Reality. Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (2023).