Challenges and Lessons Learned to Improve the Deaf User Experience: Compliance with ABNT NBR 17060 Standard in Mobile Applications
Resumo
The VLibras Mobile Application is a translation tool from Brazilian Portuguese to Libras (Brazilian Sign Language) using an Avatar in 3D animation. The tool provides deaf people a means of accessing textual content based on animation in Libras. Furthermore, VLibras can be used as a communication tool between deaf people, Libras interpreters, and people in general (interested in learning Libras, for example). In this context, having access is not the same as being accessible. Thus, it is essential to improve the deaf user experience through the compliance of VLibras Mobile with ABNT NBR 17060 Standard. The assessment was conducted for all VLibras Mobile screens and features, covering the totality of criteria of the standard. Analogous to the WCAG standard, the NBR 17060 Standard also considers three accessibility levels (A: mandatory, AA: minimally accessible, and AAA: optional), as well as the four principles (Perceptible, Operable, Understandable, and Robust). It also included the standard categories: Perception and Comprehension, Control and Interaction, Media, and Coding. The goal was to compile a general overview of VLibras Mobile compliance with the standard to know this quality regarding accessibility. Also, the analysis allowed identifying an ensemble of non-compliance criteria, both located on a specific screen or across the application. These were transcribed as 12 issues with their respective severity level and reported to developers to improve VLibras Mobile accessibility. Also, the specific audience of VLibras, deaf people, led to classify a group of criteria as non-applicable. The results revealed that the most important features of VLibras, Traduction and Home, demonstrated higher compliance rates. However, the screen Customization showed significant non-compliance. Overall, the issues reported are of low severity, and their correction has a transversal impact on the application. This text is an experience report of the assessment conducted, its challenges, results, and lessons learned.
Referências
ABNT NBR 17060:2022 2022. Normas de Acessibilidade ABNT NBR 17060:2022.
Bruno Costa, Amarildo Melo, Tamila Nascimento, Sônia França, and Catarina Costa. 2023. Avaliação de aplicativos de apoio a comunicação das pessoas surdas na perspectiva de um surdo. In Anais do VIII Workshop sobre Aspectos Sociais, Humanos e Econômicos de Software (João Pessoa/PB). SBC, Porto Alegre, RS, Brasil, 81–90. DOI: 10.5753/washes.2023.229948
Erik Henrique Da Costa Nunes and Ingrid Teixeira Monteiro. 2024. Exploring the Accessibility Legal Landscape: Accessibility requirements in mobile applications according to ABNT NBR 17060. In Proceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems (conf-loc, cityMaceió/city, countryBrazil/country, /conf-loc) (IHC ’23). Association for Computing Machinery, New York, NY, USA, Article 18, 11 pages. DOI: 10.1145/3638067.3638121
Igor Farias De Oliveira, João Lucas Torres De Sousa, Larissa Cabral de Carvalho, Maria Durciane Oliveira Brito, Kátia Maria de Aguiar Freire, and Ana Christina de Sousa Damasceno. 2020. A Utilização do Aplicativo VLIBRAS Como Forma de Ensino e Aprendizagem para Alunos Surdos. Revista Psicologia amp; Saberes 9, 16 (mar. 2020), 22–30. [link]
eMAG 2014. eMAG Modelo de Acessibilidade em Governo Eletrônico. Retrieved Jun 05, 2024 from [link]
Lavínia Matoso Freitas, Thiago Hellen O. da Silva, and Marília Soares Mendes. 2016. Evaluation of Spotify: an evaluation textual experience using the Maltu methodology. In Proceedings of the 15th Brazilian Symposium on Human Factors in Computing Systems (São Paulo, Brazil) (IHC ’16). Association for Computing Machinery, New York, NY, USA, Article 50, 4 pages. DOI: 10.1145/3033701.3033752
GDAMA 2015. Guia para o Desenvolvimento de Aplicações Móveis Acessíveis. Retrieved Jun 05, 2024 from [link]
Marília Soares Mendes. 2015. MALTU um modelo para avaliação da interação em sistemas sociais a partir da linguagem textual do usuário. [link]
G.J. Myers, C. Sandler, and T. Badgett. 2011. The Art of Software Testing. Wiley. [link]
Jakob Nielsen. 1994. Usability engineering. Morgan Kaufmann.
Erik Da Costa Nunes, Guilherme Ribeiro, Ingrid Monteiro, and Enyo Gonçalves. 2023. Digital Accessibility at the Brazilian Symposium on Human Factors in Computing Systems (IHC): An Updated Systematic Literature Review. In Anais do XXII Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais (Maceió/AL). SBC, Porto Alegre, RS, Brasil. [link]
Francisco Aulísio dos Santos Paiva, José Mario De Martino, Plínio Almeida Barbosa, Ângelo Benetti, and Ivani Rodrigues Silva. 2016. UM SISTEMA DE TRANSCRIÇÃO PARA LÍNGUA DE SINAIS BRASILEIRA: O CASO DE UM AVATAR. Revista do GEL 13, 3 (dez. 2016), 12–48. DOI: 10.21165/gel.v13i3.1440
Luana Reis, Tiago Araujo, Yuska Aguiar, and Manuella Aschoff. 2020. A Methodology for Assessing Translation Quality Generated by Sign Language Machine Translators: A Case Study with VLibras. 132–146. DOI: 10.1007/978-3-030-49108-6_10
Luana Silva Reis, Tiago Maritan Ugulino de Araújo, Yuska Paola Costa Aguiar, and Manuella Aschoff Cavalcanti Brandão Lima. 2020. Evaluating machine translation systems for Brazilian sign language in the treatment of critical grammatical aspects. In Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems (Diamantina, Brazil) (IHC ’20). Association for Computing Machinery, New York, NY, USA, Article 46, 6 pages. DOI: 10.1145/3424953.3426536
Luana Silva Reis, Tiago Maritan U. de Araújo, Maria Dayane F. Cirino Lima, Angelina S. da Silva Sales, and Yuska Paola Costa Aguiar. 2017. Avaliação de Usabilidade do Aplicativo VLibras-Móvel com Usuários Surdos. In Anais Estendidos do XXIII Simpósio Brasileiro de Sistemas Multimídia e Web (Gramado). SBC, Porto Alegre, RS, Brasil, 123–126. [link]
Luana Silva Reis, Tiago Maritan Ugulino De Araujo, Yuska Paola Costa Aguiar, and Manuella Aschoff Cavalcanti Brandao Lima. 2024. A Multilevel Methodology to Assess the Quality of Machine Translators to Brazilian Sign Languages. In Proceedings of the XI Latin American Conference on Human Computer Interaction (Puebla, Mexico) (CLIHC ’23). Association for Computing Machinery, New York, NY, USA, Article 9, 8 pages. DOI: 10.1145/3630970.3631050
Ana Carolina Rodrigues Lima De Aguiar, Lucas Eduardo Melo Alves, Felipe Melo Feliciano De Sá, and Yuska Paola Costa Aguiar. 2024. What do Portuguese-Libras automatic translation application users care about? An analysis of user comments to improve application accessibility by the quality assurance team. In Proceedings of the XI Latin American Conference on Human Computer Interaction (Puebla, Mexico) (CLIHC ’23). Association for Computing Machinery, New York, NY, USA, Article 26, 4 pages. DOI: 10.1145/3630970.3631069
André Silva, Tatiane de Sá, Ruan Diniz, Simone Ferreira, Sean Siqueira, and Saulo Bourguignon. 2021. Quando só Ok, não é Ok Um Estudo Experimental por meio de Recortes Cronológicos Sequenciais, com Análises Prescritiva e Semântica na Tradução Dinâmica pelo Avatar VLibras. In Anais do XX Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais (Online). SBC, Porto Alegre, RS, Brasil. [link]
Clemer Silva, Lucas Oliveira, Matheus Silva, and Tiago Nogueira. 2023. Acessibilidade para Pessoas Cegas: Avaliação de Compatibilidade do TalkBack com a ABNT NBR 17060. In Anais do VIII Workshop sobre Aspectos Sociais, Humanos e Econômicos de Software (João Pessoa/PB). SBC, Porto Alegre, RS, Brasil, 61–70. DOI: 10.5753/washes.2023.229859
W3C-UAAG 2002. User Agent Accessibility Guidelines 1.0. Retrieved Jun 05, 2024 from [link]
WCAG 2.1 2018. Diretrizes de Acessibilidade para Conteúdo Web (WCAG) 2.1. Retrieved Jun 05, 2024 from [link]
Sherman Wilcox and Phyllis Perrin Wilcox. 1997. Learning To See: American Sign Language as a Second Language. Gallaudet University Press. [link]
