Augmenting the dark: Exploring assistive micro-guidance in sonified mixed reality
Resumo
Esta tese propõe uma série de avaliações de usuários de métodos de sonificação espacializados renderizados como Realidade Aumentada (RA) em cenários simulados e reais. São propostos métodos de micro-orientação para cenários de baixa visibilidade e deficiência visual (DV). Na navegação manual 2D, os resultados (N=47) destacaram que os métodos de espacialidade sonora tiveram o desempenho mais promissor no tempo gasto e na distância ao alvo. Ao avaliar a navegação manual vertical em uma tarefa 3D (N=19), os resultados indicaram uma acurácia significativamente maior para um novo método relacionando altura com tom. Finalmente, encontramos uma disparidade significativa entre pessoas com DV (N=20) e pessoas videntes (N=77) no que diz respeito à empatia das pessoas videntes com a comunidade com DV. Após uma experiência de incorporação da cegueira em RA, as respostas empáticas e simpáticas das pessoas videntes (N=15) em relação à referida comunidade aumentaram significativamente. Em suma, esta tese avalia como o áudio em RA pode ajudar usuários a ter desempenhos precisos e seguros em tarefas manuais do dia-a-dia.
Palavras-chave:
sonificação, micro-orientação, realidade aumentada, deficiência visual, empatia
Referências
Billinghurst, M. (2021). Empathic computing and human robot interaction. In Proceedings of the 2021 ACM/IEEE International Conference on Human-Robot Interaction, HRI ’21, page 5, New York, NY, USA. Association for Computing Machinery.
Coughlan, J. M., Biggs, B., Rivière, M.-A., and Shen, H. (2020). An audio-based 3d spatial guidance ar system for blind users. In Miesenberger, K., Manduchi, R., Covarrubias Rodriguez, M., and Peñáz, P., editors, Computers Helping People with Special Needs, pages 475–484, Cham. Springer International Publishing.
Durrant-Whyte, H. and Bailey, T. (2006). Simultaneous localization and mapping: part i. IEEE robotics & automation magazine, 13(2):99–110.
Escalas, J. E. and Stern, B. B. (2003). Sympathy and Empathy: Emotional Responses to Advertising Dramas. Journal of Consumer Research, 29(4):566–578.
Fritsche, P., Kueppers, S., Briese, G., and Wagner, B. (2016). Radar and lidar sensor fusion in low visibility environments. In Proceedings of the 13th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, pages 30–36. INSTICC, SciTePress.
Gacem, H., Bailly, G., Eagan, J., and Lecolinet, E. (2014). A design space of guidance techniques for large and dense physical environments. In Proceedings of the 26th Conference on l’Interaction Homme-Machine, IHM ’14, page 9–17, New York, NY, USA. Association for Computing Machinery.
Guarese, R., Pretty, E., Fayek, H., Zambetta, F., and van Schyndel, R. (2023). Evoking empathy with visually impaired people through an augmented reality embodiment experience. In 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR), pages 184–193.
Guarese, R., Pretty, E., Renata, A., Polson, D., and Zambetta, F. (2024). Exploring audio interfaces for vertical guidance in augmented reality via hand-based feedback. IEEE Transactions on Visualization and Computer Graphics.
Guarese, R., van Schyndel, R., and Zambetta, F. (2022). Evaluating micro-guidance sonification methods in manual tasks for blind and visually impaired people. In OzCHI ’22: Proceedings of the 34th Australian Conference on Human-Computer Interaction.
Guerreiro, J., Kim, Y., Nogueira, R., Chung, S., Rodrigues, A., and Oh, U. (2023). The design space of the auditory representation of objects and their behaviours in virtual reality for blind people. IEEE Transactions on Visualization and Computer Graphics, 29(5):2763–2773.
Hermann, T., Hunt, A., and Neuhoff, J. (2011). The Sonification Handbook. Logos Publishing House.
Hu, X., Song, A., Wei, Z., and Zeng, H. (2022). Stereopilot: A wearable target location system for blind and visually impaired using spatial audio rendering. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 30:1621–1630.
Jacobson, R. D. (1996). Talking tactile maps and environmental audio beacons: An orientation and mobility development tool for visually impaired people. Proceedings of the ICA Commission on maps and graphics for blind and visually impaired people, 96:1–22.
Khan, S., Nazir, S., and Khan, H. U. (2021). Analysis of navigation assistants for blind and visually impaired people: A systematic review. IEEE Access, 9:26712–26734.
Liu, Y., Stiles, N. R., and Meister, M. (2018). Augmented reality powers a cognitive assistant for the blind. eLife, 7
Marquardt, A., Kruijff, E., Trepkowski, C., Maiero, J., Schwandt, A., Hinkenjann, A., Stuerzlinger, W., and Schöning, J. (2018). Audio-tactile proximity feedback for enhancing 3d manipulation. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, VRST ’18, New York, NY, USA. Association for Computing Machinery.
Mascetti, S., Picinali, L., Gerino, A., Ahmetovic, D., and Bernareggi, C. (2016). Sonification of guidance data during road crossing for people with visual impairments or blindness. International Journal of Human-Computer Studies, 85:16–26. Data Sonification and Sound Design in Interactive Systems.
May, K. R., Sobel, B., Wilson, J., and Walker, B. N. (2019). Auditory displays to facilitate object targeting in 3d space. In Proceedings of the 2019 International Conference on Auditory display, pages 155–162. International Community for Auditory Display.
Myers, M. (2018). The empathy machine? virtual reality and the search for a solution to violence. In Griffith Review. Accessed: 2024-04-08.
Schrier, K. and Farber, M. (2021). A systematic literature review of ‘empathy’ and ‘games’. Journal of Gaming & Virtual Worlds, 13(2):195–214.
Coughlan, J. M., Biggs, B., Rivière, M.-A., and Shen, H. (2020). An audio-based 3d spatial guidance ar system for blind users. In Miesenberger, K., Manduchi, R., Covarrubias Rodriguez, M., and Peñáz, P., editors, Computers Helping People with Special Needs, pages 475–484, Cham. Springer International Publishing.
Durrant-Whyte, H. and Bailey, T. (2006). Simultaneous localization and mapping: part i. IEEE robotics & automation magazine, 13(2):99–110.
Escalas, J. E. and Stern, B. B. (2003). Sympathy and Empathy: Emotional Responses to Advertising Dramas. Journal of Consumer Research, 29(4):566–578.
Fritsche, P., Kueppers, S., Briese, G., and Wagner, B. (2016). Radar and lidar sensor fusion in low visibility environments. In Proceedings of the 13th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, pages 30–36. INSTICC, SciTePress.
Gacem, H., Bailly, G., Eagan, J., and Lecolinet, E. (2014). A design space of guidance techniques for large and dense physical environments. In Proceedings of the 26th Conference on l’Interaction Homme-Machine, IHM ’14, page 9–17, New York, NY, USA. Association for Computing Machinery.
Guarese, R., Pretty, E., Fayek, H., Zambetta, F., and van Schyndel, R. (2023). Evoking empathy with visually impaired people through an augmented reality embodiment experience. In 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR), pages 184–193.
Guarese, R., Pretty, E., Renata, A., Polson, D., and Zambetta, F. (2024). Exploring audio interfaces for vertical guidance in augmented reality via hand-based feedback. IEEE Transactions on Visualization and Computer Graphics.
Guarese, R., van Schyndel, R., and Zambetta, F. (2022). Evaluating micro-guidance sonification methods in manual tasks for blind and visually impaired people. In OzCHI ’22: Proceedings of the 34th Australian Conference on Human-Computer Interaction.
Guerreiro, J., Kim, Y., Nogueira, R., Chung, S., Rodrigues, A., and Oh, U. (2023). The design space of the auditory representation of objects and their behaviours in virtual reality for blind people. IEEE Transactions on Visualization and Computer Graphics, 29(5):2763–2773.
Hermann, T., Hunt, A., and Neuhoff, J. (2011). The Sonification Handbook. Logos Publishing House.
Hu, X., Song, A., Wei, Z., and Zeng, H. (2022). Stereopilot: A wearable target location system for blind and visually impaired using spatial audio rendering. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 30:1621–1630.
Jacobson, R. D. (1996). Talking tactile maps and environmental audio beacons: An orientation and mobility development tool for visually impaired people. Proceedings of the ICA Commission on maps and graphics for blind and visually impaired people, 96:1–22.
Khan, S., Nazir, S., and Khan, H. U. (2021). Analysis of navigation assistants for blind and visually impaired people: A systematic review. IEEE Access, 9:26712–26734.
Liu, Y., Stiles, N. R., and Meister, M. (2018). Augmented reality powers a cognitive assistant for the blind. eLife, 7
Marquardt, A., Kruijff, E., Trepkowski, C., Maiero, J., Schwandt, A., Hinkenjann, A., Stuerzlinger, W., and Schöning, J. (2018). Audio-tactile proximity feedback for enhancing 3d manipulation. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, VRST ’18, New York, NY, USA. Association for Computing Machinery.
Mascetti, S., Picinali, L., Gerino, A., Ahmetovic, D., and Bernareggi, C. (2016). Sonification of guidance data during road crossing for people with visual impairments or blindness. International Journal of Human-Computer Studies, 85:16–26. Data Sonification and Sound Design in Interactive Systems.
May, K. R., Sobel, B., Wilson, J., and Walker, B. N. (2019). Auditory displays to facilitate object targeting in 3d space. In Proceedings of the 2019 International Conference on Auditory display, pages 155–162. International Community for Auditory Display.
Myers, M. (2018). The empathy machine? virtual reality and the search for a solution to violence. In Griffith Review. Accessed: 2024-04-08.
Schrier, K. and Farber, M. (2021). A systematic literature review of ‘empathy’ and ‘games’. Journal of Gaming & Virtual Worlds, 13(2):195–214.
Publicado
30/09/2024
Como Citar
GUARESE, Renan; VAN SCHYNDEL, Ron; POLSON, Deb; ZAMBETTA, Fabio.
Augmenting the dark: Exploring assistive micro-guidance in sonified mixed reality. In: CONCURSO DE TESES E DISSERTAÇÕES - SIMPÓSIO DE REALIDADE VIRTUAL E AUMENTADA (SVR), 26. , 2024, Manaus/AM.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2024
.
p. 90-95.
DOI: https://doi.org/10.5753/svr_estendido.2024.243612.
