Development of a Vibrotactile Mockup for Immersive Soccer Tracking by the Visually Impaired: An HCI Experience Report

• Ana Grasielle Dionísio Corrêa Mauá Institute of Technology / Mackenzie Presbyterian University http://orcid.org/0000-0002-0393-8710
• Gabriel Belapetravicius Dias Mauá Institute of Technology https://orcid.org/0009-0001-1805-5849
• Raphael Gueleri Kalaes Mauá Institute of Technology https://orcid.org/0000-0001-6083-4638
• Bruno da Silva Rodrigues Mackenzie Presbyterian University https://orcid.org/0000-0001-9567-4910

DOI: https://doi.org/10.5753/ihc.2025.10903

Abstract

Introduction: Following soccer matches can be challenging for people with Visual Impairments (VI), requiring accessible resources to enhance the experience. Objective: This study aimed to develop and evaluate a vibrotactile model to represent the ball’s trajectory in goal plays. Methodology: A User-Centered Design approach was adopted, including interviews, Arduino prototyping, and tests with participants (two with VI and 12 without VI). The evaluation metrics were accuracy, satisfaction, and qualitative feedback. Results: High accuracy rates, overall positive satisfaction, and reports of ease of use and tactile understanding of the game indicate that the model is promising for sports inclusion and accessibility.

Keywords: Visual Impairment, Accessibility, Tactile Feedback, Football

References

Albert, B. and Tullis, T. (2022) Measuring the User Experience: Collecting, Analyzing, and Presenting UX Metrics. Morgan Kaufmann.

Asakawa, S., et al. (2021) “Challenges in Sports Accessibility for Visually Impaired People”, Journal of Assistive Technologies, 15(3), pp. 1–15.

Bavelier, D. and Neville, H. J. (2002) “Cross-Modal Plasticity: Where and How?”, Nature Reviews Neuroscience, 3(6), pp. 443–452.

Beneteau, E. (2020). Who are you asking?: Qualitative methods for involving AAC users as primary research participants. In proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (pp. 1-13).

Cardoso Filho, Raimundo José. (2017) Uma visão sobre avaliação de usabilidade e acessibilidade no IHC. Trabalho de Conclusão de Curso de Licenciatura em Ciência da Computação da Universidade Federal da Paraíba

Cooper, R., et al. (2022) “The Role of Tactile Models in Enhancing Spatial Understanding for Blind Individuals in Sports”, Disability and Rehabilitation: Assistive Technology, 17(2), pp. 189–198.

Franco Jr, H. Brasil, país do futebol?. Revista USP, n. 99, p. 45-56, 2013.

Hasani, L. M., Sensuse, D. I., & Suryono, R. R. (2020, September). User-centered design of e-learning user interfaces: A survey of the practices. In 2020 3rd International Conference on Computer and Informatics Engineering (IC2IE) (pp. 1-7). IEEE.

Honorato, A. (2013). Percepção de imagens através de frequências vibratórias captadas pelas mãos de pessoas cegas. Universidade Federal de Santa Catarina, Programa de Pós-Graduação em Design e Expressão Gráfica.

Ikeda, K., et al. (2018) “Development and Evaluation of Audio-Tactile Feedback Systems for Blind Athletes”, International Journal of Human-Computer Studies, 118, pp. 77–86.

Jain, A., et al. (2023a) “Technological Advancements in Sports Accessibility for Visually Impaired Individuals: A Review”, Assistive Technology, 35(1), pp. 3–12.

Jain, G., Hindi, B., Courtien, C., Wyrick, C., Xu, X. Y. T., Malcolm, M. C., & Smith, B. A. (2023b). Towards accessible sports broadcasts for blind and low-vision viewers. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA '23) (Article 287, pp. 1–7). Association for Computing Machinery.

Jones, L. A. and Lederman, S. J. (2006) “Tactile Sensing”, in Human Hand Function, pp. 44–74.

Khurana, P., et al. (2021) “A Systematic Review of Assistive Technologies for Sports Participation of Individuals with Visual Impairments”, British Journal of Visual Impairment, 39(4), pp. 456–475.

Lederman, S. J., & Klatzky, R. L. (1987). Hand movements: A window into haptic object recognition. Cognitive Psychology, 19(3), 342–368.

Liu, P. (2013). U.S. Hand-vision sensing device and hand-vision sensing glove. Patent Application No. 13/642,558.

Millar, S. (1994) Understanding and Representing Space: Theory and Evidence from Studies with Blind and Sighted Children. Oxford University Press.

Ning, Z., Wimer, B. L., Jiang, K., Chen, K., Ban, J., Tian, Y., ... & Li, T. J. J. (2024, May). SPICA: interactive video content exploration through augmented audio descriptions for blind or low-vision viewers. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (pp. 1-18).

Ohshima, H., Kobayashi, M., & Shimada, S. (2021, May). Development of blind football play-by-play system for visually impaired spectators: Tangible sports. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (pp. 1-6).

Pereira, R., Darin, T., & Silveira, M. S. (2024). GranDIHC-BR: Grand research challenges in human-computer interaction in Brazil for 2025–2035. In Proceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems (IHC 2024) (pp. 1–24). Sociedade Brasileira de Computação.

Santos, C. A. R. (2010) “A Narração Esportiva de Futebol: Análise Discursiva de um Fenômeno Midiático”, Dissertação (Mestrado em Língua Portuguesa e Linguística), Programa de Pós-Graduação em Letras, Pontifícia Universidade Católica de Minas Gerais.

Shneiderman, B., Plaisant, C., Cohen, M. and Elmqvist, N. (2016) Designing the User Interface: Strategies for Effective Human-Computer Interaction. 6th ed., Pearson.

Soares, A. C., et al. (2023) “Integração de Estratégias Sensoriais na Leitura de Jogo no Futebol para Cegos: Um Estudo Comparativo”, Revista de Trabalhos Acadêmicos – Universo Belo Horizonte, 1(9).

Tatham, A. F. (1991) “The Design of Tactile Maps: Theoretical and Practical Considerations”, Proceedings of International Cartographic Association: Mapping the Nations, pp. 157–166.

Villamarín, N., et al. (2021) “Design and Evaluation of Adapted Balls for Blind Football”, Applied Ergonomics, 95, 103456.

Yandun, N., et al. (2019) “Enhancing Ball Tracking for Visually Impaired Players Using Haptic and Auditory Feedback”, Sensors, 19(16), 3542.

Yu, W., Smith, A. and Jones, B. (2022) “Challenges in Conveying Dynamic Visual Information of Sports Events to Blind and Low Vision Individuals”, Journal of Accessibility and Design for All, 12(4), pp. 1–18.