Virtual Reality for People with Visual Impairments in the development of Left-Right Discrimination Skills: A Systematic Mapping Study

  • José Martônio Lopes de Moraes Júnior UFC
  • Windson Viana UFC
  • Agebson Rocha Façanha IFCE

Resumo


Integrating digital technologies, particularly Virtual Reality (VR) games, into Orientation and Mobility (OM) training has shown significant potential for enhancing the rehabilitation process for People with Visual Impairments (PVI). These technologies provide immersive and interactive experiences that foster greater autonomy and independence. In OM training, left-right discrimination helps individuals establish spatial relationships and shapes the foundation for learning more complex orientation skills. This systematic mapping study examines how VR games can be used to train left-right discrimination abilities in PVI, offering them new experiences. We reviewed 758 articles and selected 19 studies that highlight the importance of considering all types of visual impairments, involving PVI in the development process, and accounting for their existing skills when designing game interactions.

Palavras-chave: Orientation and Mobility, Virtual Reality, VR, Left-Right Discrimination, Games

Referências

Ronny Andrade, Jenny Waycott, Steven Baker, and Frank Vetere. 2021. Echolocation as a Means for People with Visual Impairment (PVI) to Acquire Spatial Knowledge of Virtual Space. ACM Trans. Access. Comput. 14, 1, Article 4 ( mar 2021), 25 pages. DOI: 10.1145/3448273

Nida Aziz, Tony Stockman, and Rebecca Stewart. 2022. Planning your journey in audio: design and evaluation of auditory route overviews. ACM Transactions on Accessible Computing 15, 4 (2022), 1–48.

John Brooke. 2013. SUS: a retrospective. Journal of usability studies 8, 2 (2013) , 29–40.

Emeline Brule, Gilles Bailly, Anke Brock, Frédéric Valentin, Grégoire Denis, and Christophe Jouffrais. 2016. MapSense: multi-sensory interactive maps for children living with visual impairments. In Proceedings of the 2016 CHI conference on human factors in computing systems. 445–457.

Heather Burte and Daniel R Montello. 2017. How sense-of-direction and learning intentionality relate to spatial knowledge acquisition in the environment. Cognitive Research: Principles and Implications 2 (2017), 1–17.

Jack Shen-Kuen Chang, Alison Doucette, Georgina Yeboah, Timothy Welsh, Michael Nitsche, and Ali Mazalek. 2019. Keep the ball rolling: Designing gamebased tangible vr for spatial penetrative thinking ability. In Proceedings of the 2019 on Designing Interactive Systems Conference. 215–226.

Ahmed Choueib and Mehmet İlker Berkman. 2023. Comparing Performance and Experience in VR vs. Real-World Through a Puzzle Game. In International Conference on Videogame Sciences and Arts. Springer Nature Switzerland, 72–85.

Lee Anna Clark and David Watson. 2019. Constructing validity: New developments in creating objective measuring instruments. Psychological assessment 31 , 12 (2019), 1412.

Alexandra Covaci, Anne-Hélène Olivier, and Franck Multon. 2014. Third Person View and Guidance for More Natural Motor Behaviour in Immersive Basketball Playing. In Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology (Edinburgh, Scotland) (VRST ’14). Association for Computing Machinery, New York, NY, USA, 55–64. DOI: 10.1145/2671015.2671023

Aviv Elor, Michael Powell, Evanjelin Mahmoodi, Nico Hawthorne, Mircea Teodorescu, and Sri Kurniawan. 2020. On shooting stars: Comparing cave and hmd immersive virtual reality exergaming for adults with mixed ability. ACM Transactions on Computing for Healthcare 1, 4 (2020), 1–22.

Agebson Rocha Façanha, Ticianne Darin, Windson Viana, and Jaime Sánchez. 2020. O&M Indoor Virtual Environments for People Who Are Blind: A Systematic Literature Review. ACM Trans. Access. Comput. 13, 2, Article 9a (aug 2020), 42 pages. DOI: 10.1145/3395769

Marcos Valadão Gualberto Ferreira and Jairo Francisco de Souza. 2017. Use of Automatic Speech Recognition Systems for Multimedia Applications. In Proceedings of the 23rd Brazillian Symposium on Multimedia and the Web, Webmedia 2017, Gramado, Brazil, October 17 - 20, 2017, Valter Roesler, José Valdeni de Lima, Celso Alberto Saibel Santos, and Roberto Willrich (Eds.). ACM, 33–36. DOI: 10.1145/3126858.3131630

Itamar Rocha Filho, Felipe Honorato, J. Wallace Lucena, J. Pedro Teixeira, and Tiago Maritan U. Araújo. 2021. An Approach for Automatic Description of Characters for Blind People. In WebMedia ’21: Brazilian Symposium on Multimedia and the Web, Belo Horizonte, Minas Gerais, Brazil, November 5-12, 2021, Adriano César Machado Pereira and Leonardo Chaves Dutra da Rocha (Eds.). ACM, 53–56. DOI: 10.1145/3470482.3479617

Marcio Maestrelo Funes, Leandro Agostini do Amaral, Renata P. M. Fortes, and Rudinei Goularte. 2017. Game Development for Researchers: From Concept to User Experience Data Collection. In Proceedings of the 23rd Brazillian Symposium on Multimedia and the Web, Webmedia 2017, Gramado, Brazil, October 17 - 20, 2017, Valter Roesler, José Valdeni de Lima, Celso Alberto Saibel Santos, and Roberto Willrich (Eds.). ACM, 27–28. DOI: 10.1145/3126858.3131632

Marcio Maestrelo Funes, Renata P. M. Fortes, and Rudinei Goularte. 2017. Gestural Interaction for Accessibility of Web Videos: A Case Study Analysis with Blind and Visually Impaired Users. In Proceedings of the 23rd Brazillian Symposium on Multimedia and the Web, Webmedia 2017, Gramado, Brazil, October 17 - 20, 2017, Valter Roesler, José Valdeni de Lima, Celso Alberto Saibel Santos, and Roberto Willrich (Eds.). ACM, 501–504. DOI: 10.1145/3126858.3131588

David Gonçalves, Manuel Piçarra, Pedro Pais, João Guerreiro, and André Rodrigues. 2023. " My Zelda Cane": Strategies Used by Blind Players to Play VisualCentric Digital Games. In Proceedings of the 2023 CHI conference on human factors in computing systems. 1–15.

Inês Gonçalves, André Rodrigues, Tiago Guerreiro, and João Guerreiro. 2023. Inclusive Social Virtual Environments: Exploring the Acceptability of Different Navigation and Awareness Techniques. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI EA ’23). Association for Computing Machinery, New York, NY, USA, Article 177, 7 pages. DOI: 10.1145/3544549.3585700

Ricardo E. Gonzalez Penuela, Wren Poremba, Christina Trice, and Shiri Azenkot. 2022. Hands-On: Using Gestures to Control Descriptions of a Virtual Environment for People with Visual Impairments. In Adjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (Bend, OR, USA) (UIST ’22 Adjunct). Association for Computing Machinery, New York, NY, USA, Article 84, 4 pages. DOI: 10.1145/3526114.3558669

Gerard J Gormley, Carl Brennan, and Martin Dempster. 2019. ‘What... you can’t tell left from right?’Medical students’ experiences in making laterality decisions. Medical Education 53, 5 (2019), 458–466.

Debra Griffiths, Andre Bester, and Kenny R Coventry. 2019. Space trumps time when talking about objects. Cognitive Science 43, 3 (2019), e12719.

Renan Guarese, Fabio Zambetta, and Ron van Schyndel. 2023. Evaluating MicroGuidance Sonification Methods in Manual Tasks for Blind and Visually Impaired People. In Proceedings of the 34th Australian Conference on Human-Computer Interaction (Canberra, ACT, Australia) (OzCHI ’22). Association for Computing Machinery, New York, NY, USA, 260–271. DOI: 10.1145/3572921.3572929

Sandra G Hart. 2006. NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 50. Sage publications Sage CA: Los Angeles, CA, 904–908.

Mary Hegarty, Daniel R Montello, Anthony E Richardson, Toru Ishikawa, and Kristin Lovelace. 2006. Spatial abilities at different scales: Individual differences in aptitude-test performance and spatial-layout learning. Intelligence 34, 2 (2006), 151–176.

Karst MP Hoogsteen, Sarit Szpiro, Gabriel Kreiman, and Eli Peli. 2022. Beyond the cane: describing urban scenes to blind people for mobility tasks. ACM Transactions on Accessible Computing (TACCESS) 15, 3 (2022), 1–29.

Gesu India, Mohit Jain, Pallav Karya, Nirmalendu Diwakar, and Manohar Swaminathan. 2021. VStroll: An audio-based virtual exploration to encourage walking among people with vision impairments. In The 23rd International ACM SIGACCESS Conference on Computers and Accessibility. 1–13.

Tiger F. Ji, Brianna Cochran, and Yuhang Zhao. 2022. VRBubble: Enhancing Peripheral Awareness of Avatars for People with Visual Impairments in Social Virtual Reality. In Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (Athens, Greece) (ASSETS ’22). Association for Computing Machinery, New York, NY, USA, Article 3, 17 pages. DOI: 10.1145/3517428.3544821

Sukran Karaosmanoglu, Lucie Kruse, Sebastian Rings, and Frank Steinicke. 2022. Canoe vr: An immersive exergame to support cognitive and physical exercises of older adults. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1 – 7.

Shin Kim, Kun-pyo Lee, and Tek-Jin Nam. 2016. Sonic-Badminton: Audio-Augmented Badminton Game for Blind People. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA ’16). Association for Computing Machinery, New York, NY, USA, 1922–1929. DOI: 10.1145/2851581.2892510

Barbara Kitchenham, O Pearl Brereton, David Budgen, Mark Turner, John Bailey, and Stephen Linkman. 2009. Systematic literature reviews in software engineering–a systematic literature review. Information and software technology 51, 1 (2009), 7–15.

Robert M Kitchin and Ronald D Jacobson. 1997. Techniques to collect and analyze the cognitive map knowledge of persons with visual impairment or blindness: Issues of validity. Journal of Visual Impairment & Blindness 91, 4 (1997), 360–376.

Elena Kokkinara, Mel Slater, and Joan López-Moliner. 2015. The effects of visuomotor calibration to the perceived space and body, through embodiment in immersive virtual reality. ACM Transactions on Applied Perception (TAP) 13, 1 (2015), 1–22.

Julian Kreimeier and Timo Götzelmann. 2018. FeelVR: Haptic Exploration of Virtual Objects. In Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference (Corfu, Greece) (PETRA ’18). Association for Computing Machinery, New York, NY, USA, 122–125. DOI: 10.1145/3197768.3201526

Julian Kreimeier and Timo Götzelmann. 2020. Two Decades of Touchable and Walkable Virtual Reality for Blind and Visually Impaired People: A High-Level Taxonomy. Multimodal Technologies and Interaction 4, 4 (2020), 79.

Julian Kreimeier and Timo Götzelmann. 2020. Two Decades of Touchable and Walkable Virtual Reality for Blind and Visually Impaired People: A High-Level Taxonomy. Multimodal Technologies and Interaction 4, 4 (2020). DOI: 10.3390/mti4040079

Owlchemy Labs. [n. d.]. Owlchemy Labs Shares a First of It’s Kind Vision Accessibility Update for Cosmonious High. [link] Acessado: 25 August 2024.

Orly Lahav. 2022. Virtual reality systems as an orientation aid for people who are blind to acquire new spatial information. Sensors 22, 4 (2022), 1307.

Orly Lahav, David W. Schloerb, and Mandayam A. Srinivasan. 2012. Newly blind persons using virtual environment system in a traditional orientation and mobility rehabilitation program: a case study. Disability and Rehabilitation: Assistive Technology 7, 5 (2012), 420–435. arXiv: [link] PMID: 22112148. DOI: 10.3109/17483107.2011.635327

Orly Lahav, David W Schloerb, and Mandayam A Srinivasan. 2012. Newly blind persons using virtual environment system in a traditional orientation and mobility rehabilitation program: a case study. Disability and Rehabilitation: Assistive Technology 7, 5 (2012), 420–435.

Joseph J LaViola Jr. 2000. A discussion of cybersickness in virtual environments. ACM Sigchi Bulletin 32, 1 (2000), 47–56.

Jack M Loomis, Roberta L Klatzky, and Nicholas A Giudice. 2013. Representing 3D space in working memory: Spatial images from vision, hearing, touch, and language. Multisensory imagery (2013), 131–155.

Ricardo Martins Porto Lussac. 2022. Considerações psicomotoras sobre a lateralidade e respectivos apontamentos acerca da capoeira. CAMINHOS DA EDUCAÇÃO diálogos culturas e diversidades 4, 1 (2022), 01–13.

SYLAS FERNANDES Maciel. 2003. O “ir e vir” do deficiente visual ( princípios, técnicas e procedimentos). CMDV-Portal do Deficiente Visual (2003).

Keenan R. May, Brianna J. Tomlinson, Xiaomeng Ma, Phillip Roberts, and Bruce N. Walker. 2020. Spotlights and Soundscapes: On the Design of Mixed Reality Auditory Environments for Persons with Visual Impairment. ACM Trans. Access. Comput. 13, 2, Article 8 (apr 2020), 47 pages. DOI: 10.1145/3378576

Alberto Mendonça, Cristina Miguel, Graça Neves, Manuela Micaelo, and Vítor Reino. 2008. Alunos cegos e com baixa visão–Orientações curriculares. Lisboa: Dgidc (2008).

Noris Mohd Norowi, Habibunnajar Azman, and Nor Wahiza Abdul Wahat. 2021. Apple Swipe: A Mobile Game Apps for Visually Impaired Users Using Binaural Sounds. In Proceedings of the Asian CHI Symposium 2021 (Yokohama, Japan) ( Asian CHI ’21). Association for Computing Machinery, New York, NY, USA, 196–201. DOI: 10.1145/3429360.3468209

José M. L. Moraes, Phyllipe Do Carmo F., Maria da Conceição Carneiro Araújo, Bernardo Costa, Myrna Amorim, Agebson Rocha Façanha, Joel A. F. dos Santos, and Windson Viana. 2023. Dashboards to support rehabilitation in orientation and mobility for people who are blind. In Proceedings of the 29th Brazilian Symposium on Multimedia and the Web, WebMedia 2023, Ribeirão Preto, Brazil, October 23-27 , 2023. ACM, 6–10. DOI: 10.1145/3617023.3617027

Gayathri Narasimham, Haley Adams, John Rieser, and Bobby Bodenheimer. 2020. Encoding Height: Egocentric Spatial Memory of Adults and Teens in a Virtual Stairwell. In ACM Symposium on Applied Perception 2020. 1 – 8.

Tetsuya Oda, Hiroaki Shirai, Kyohei Toyoshima, Masaharu Hirota, Ryo Ozaki, and Kengo Katayama. 2020. VR Application for Supporting Object Recognition Considering Eye in Low Vision. In Proceedings of the 2020 8th International Conference on Information and Education Technology (Okayama, Japan) (ICIET 2020). Association for Computing Machinery, New York, NY, USA, 295–299. DOI: 10.1145/3395245.3396232

Sonja H Ofte. 2002. Right–left discrimination: Effects of handedness and educational background. Scandinavian Journal of Psychology 43, 3 (2002), 213–219.

World Health Organization. 2019. World report on vision. World Health Organization. 160 p. pages.

David W. Schloerb Orly Lahav and Mandayam A. Srinivasan. 2012. Newly blind persons using virtual environment system in a traditional orientation and mobility rehabilitation program: a case study. Disability and Rehabilitation: Assistive Technology 7, 5 (2012), 420–435. arXiv: [link] DOI: 10.3109/17483107.2011.635327

Christina Oumard, Julian Kreimeier, and Timo Goetzelmann. 2021. Preliminary analysis on interaction characteristics with auditive navigation in virtual environments. In The 14th PErvasive Technologies Related to Assistive Environments Conference. 514–520.

Renato Alexandre Ribeiro, Inês Gonçalves, Manuel Piçarra, Letícia Seixas Pereira, Carlos Duarte, André Rodrigues, and João Guerreiro. 2024. Investigating Virtual Reality Locomotion Techniques with Blind People. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1–17.

Regina Kátia Cerqueira Ribeiro. 2013. Orientação e mobilidade da pessoa com cegueira adquirida: os benefícios do meio aquático como facilitador da aprendizagem. Rev Benjamin Constant.[Internet] 19 (2013), 56.

Diogo Simões and Sofia Cavaco. 2014. An orientation game with 3D spatialized audio for visually impaired children. In Proceedings of the 11th Conference on Advances in Computer Entertainment Technology. 1 – 4.

Gabriel Souza, Daniel Silva, Matheus Delgado, Renato O. Rodrigues, Paulo Renato C. Mendes, Glauco Fiorott Amorim, Álan L. V. Guedes, and Joel A. F. dos Santos. 2020. Interactive 360-degree Videos in Ginga-NCL Using Head-Mounted-Displays as Second Screen Devices. In WebMedia ’20: Brazillian Symposium on Multimedia and the Web, São Luís, Brazil, November 30 - December 4, 2020, Carlos de Salles Soares Neto (Ed.). ACM, 289–296. DOI: 10.1145/3428658.3430972

Maximilian Speicher, Brian D. Hall, and Michael Nebeling. 2019. What is Mixed Reality?. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–15. DOI: 10.1145/3290605.3300767

Lauren Thevin, Carine Briant, and Anke M Brock. 2020. X-road: virtual reality glasses for orientation and mobility training of people with visual impairments. ACM Transactions on Accessible Computing (TACCESS) 13, 2 (2020), 1–47.

Catherine Thinus-Blanc and Florence Gaunet. 1997. Representation of space in blind persons: vision as a spatial sense? Psychological bulletin 121, 1 (1997), 20.

Brianna J. Tomlinson, Brittany E. Noah, and Bruce N. Walker. 2018. BUZZ:An Auditory Interface User Experience Scale. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA ’18). Association for Computing Machinery, New York, NY, USA, 1 – 6. DOI: 10.1145/3170427.3188659

Jaya Watemberg, Sharon Cermak, and Anne Henderson. 1986. Right-left discrimination in blind and sighted children. Physical & Occupational Therapy in Pediatrics 6, 1 (1986), 7–19.

Ryan Wedoff, Lindsay Ball, Amelia Wang, Yi Xuan Khoo, Lauren Lieberman, and Kyle Rector. 2019. Virtual showdown: An accessible virtual reality game with scaffolds for youth with visual impairments. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–15.

Michele A Williams, Caroline Galbraith, Shaun K Kane, and Amy Hurst. 2014. " just let the cane hit it" how the blind and sighted see navigation differently. In Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility. 217–224.

Claes Wohlin. 2014. Guidelines for snowballing in systematic literature studies and a replication in software engineering. In Proceedings of the 18th international conference on evaluation and assessment in software engineering. 1–10.

Claes Wohlin, Per Runeson, Martin Höst, Magnus C Ohlsson, Björn Regnell, and Anders Wesslén. 2012. Experimentation in software engineering. Springer Science & Business Media.

Ben C. B. Yip and David W. K. Man. 2009. Virtual reality (VR)-based community living skills training for people with acquired brain injury: A pilot study. Brain Injury 23, 13-14 (2009), 1017–1026. arXiv: [link] PMID: 19891532. DOI: 10.3109/02699050903379412

Yuhang Zhao, Cynthia L. Bennett, Hrvoje Benko, Edward Cutrell, Christian Holz, Meredith Ringel Morris, and Mike Sinclair. 2018. Demonstration of Enabling People with Visual Impairments to Navigate Virtual Reality with a Haptic and Auditory Cane Simulation. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI EA ’18). Association for Computing Machinery, New York, NY, USA, 1–4. DOI: 10.1145/3170427.3186485

Yuhang Zhao, Cynthia L Bennett, Hrvoje Benko, Edward Cutrell, Christian Holz, Meredith Ringel Morris, and Mike Sinclair. 2018. Enabling people with visual impairments to navigate virtual reality with a haptic and auditory cane simulation. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–14.
Publicado
14/10/2024
MORAES JÚNIOR, José Martônio Lopes de; VIANA, Windson; FAÇANHA, Agebson Rocha. Virtual Reality for People with Visual Impairments in the development of Left-Right Discrimination Skills: A Systematic Mapping Study. In: WORKSHOP DE REVISÕES SISTEMÁTICAS DE LITERATURA EM SISTEMAS MULTIMÍDIAS E WEB - SIMPÓSIO BRASILEIRO DE SISTEMAS MULTIMÍDIA E WEB (WEBMEDIA), 30. , 2024, Juiz de Fora/MG. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2024 . p. 185-197. ISSN 2596-1683. DOI: https://doi.org/10.5753/webmedia_estendido.2024.244084.