Are user reviews useful for identifying accessibility issues that autistic users face?: an exploratory study
Resumo
Google Play Store offers several user reviews that can provide data on aspects of user experience, usability, and accessibility. Several studies address the importance of user reviews and their contributions to the evolution of interactive systems. However, accessibility has been little discussed in this type of study, especially accessibility for users with Autism Spectrum Disorder (ASD). Considering the potential of user reviews, this paper presents a textual analysis of reviews extracted from eight educational applications for autistic children: ABC autismo, Aprendendo com biel e seus amigos, AutApp autismo, Autismo projeto integrar, Jade autism, Matraquinha, OTO (Olhar Tocar Ouvir) and Teacch.me. The analysis adopted the Guidelines for Accessible Interfaces for people with Autism (GAIA) to classify user reviews. An accessibility diagnostic was obtained for apps evaluated and demonstrated that they have recurring accessibility problems regarding responses to actions, visibility of the state of the system, and customization. When compared to studies that have adopted other methods to evaluate the accessibility of the same applications, we observed that the user reviews provided more evidence of accessibility problems.
Referências
Felwah Alqahtani and Rita Orji. 2019. Usability issues in mental health applications. In Adjunct Publication of the 27th Conference on User Modeling, Adaptation and Personalization. 343--348.
American Psychiatric Association et al. 2014. DSM-5: Manual diagnóstico e estatístico de transtornos mentais. Artmed Editora.
Karina da Silva Castelo Branco, Valéria Maria da S Pinheiro, Adriana Lopes Damian, and Anna Beatriz Marques. 2020. Investigating the first user experience and accessibility of educational applications for autistic children. In Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems. 1--10.
Talita Cristina Pagani Britto and Ednaldo Brigante Pizzolato. 2018. GAIA: uma proposta de um guia de recomendações de acessibilidade de interfaces Web com foco em aspectos do Autismo. Revista Brasileira de Informática na Educação 26, 02 (2018), 102.
Thiago Hellen O Da Silva, Lavínia Matoso Freitas, Marília Soares Mendes, and Elizabeth Sucupira Furtado. 2019. Textual evaluation vs. User testing: a comparative analysis. In Anais do X Workshop sobre Aspectos da Interação Humano-Computador para a Web Social. SBC, 21--30.
Marcelo Medeiros Eler, Leandro Orlandin, and Alberto Dumont Alves Oliveira. 2019. Do Android app users care about accessibility? an analysis of user reviews on the Google play store. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems. 1--11.
Lavínia Matoso Freitas, Thiago Hellen O da Silva, and Marília Soares Mendes. 2016. Evaluation of spotify: an evaluation textual experience using the maltu methodology. In Proceedings of the 15th Brazilian Symposium on Human Factors in Computing Systems. 1--4.
Necmiye Genc-Nayebi and Alain Abran. 2017. A systematic literature review: Opinion mining studies from mobile app store user reviews. Journal of Systems and Software 125 (2017), 207--219.
Sanjay J Koyani, Robert W Bailey, Janice R Nall, Susan. Allison, Conrad. Mulligan, Kent. Bailey, and Mark. Tolson. 2004. based web design & usability guidelines. Computer Psychology Washington, DC.
Heloise Cristini Magaton and Silvia Amélia Bim. 2017. The Use of Educational Applications by Children with Autistic Spectrum Disorder: A Case of Study. In Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems. 1--10.
Anna Beatriz Marques and Leandro da Silva Monte. 2021. How are software technologies being evaluated with autistic users? A systematic mapping. Universal Access in the Information Society (2021), 1--11.
Anna Beatriz Marques, Gabriel Aires Melo, Victoria Gabriella Rebouças Pereira, and Patrícia Freitas Campos de Vasconcelos. 2021. Criação e Avaliação de Personas para Sistemas com foco em pessoas com Transtorno do Espectro Autista: Um Relato de Experiência sobre o uso de Netnografia. iSys-Brazilian Journal of Information Systems 14, 3 (2021), 68--97.
Aurea Melo, Jonathas Santos, Luis Rivero, and Raimundo Barreto. 2017. Searching for Preferences of Autistic Children to Support the Design of User Interfaces. In Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems. 1--10.
Phong Minh Vu, Tam The Nguyen, Hung Viet Pham, and Tung Thanh Nguyen. 2015. Mining user opinions in mobile app reviews: A keyword-based approach. arXiv preprint arXiv:1505.04657 (2015).
