Early accessibility testing – an automated kit for Android developers
Resumo
Accessibility in mobile applications enables people with disabilities to carry out daily tasks like other users. There are many sets of guidelines and tools for accessibility tests. However, developers continue to face barriers to meet accessibility requirements while developing mobile applications, resulting in most popular apps having accessibility violations. Based on the literature, we can highlight the most used interface components and where most accessibility violations occur. We argue that by adopting practices familiar to developers and integrating accessibility testing early in coding, we can empower developers to build more accessible applications. This work presents an automated accessibility testing kit for Android apps based on recommendations from literature to overcome accessibility problems faced by visually impaired people. The Automated Accessibility Testing Kit for Android Apps (AATK) is an Android Library to assist developers in creating accessibility tests that can be run within the JVM in seconds. The main goal is to promote more developers’ involvement in integrating accessibility into mobile applications from the coding stage. The kit initially contains five tests for recurring accessibility issues that impact how visually impaired users utilize native apps. The initial usability evaluations of AATK were carried out with undergraduate students enrolled in Software Testing courses. The results indicate greater acceptance among students in the final semesters.
Palavras-chave:
Accessibility, Mobile Development. Automated Tests
Referências
ISO 9241-171. 2008. Ergonomics of human -system interaction- Part 171 : Guidance on software accessibility. Technical Report. ISO - Intl Organization for Standardization. https://doi.org/10.1109/IEEESTD.2007.4288250
Patricia Acosta-Vargas, L. Salvador-Ullauri, J. Jadán-Guerrero, C. Guevara, S. Sanchez-Gordon, T. Calle-Jimenez, P. Lara-Alvarez, A. Medina, and I. L. Nunes. 2020. Accessibility assessment in mobile applications for Android. Advances in Intelligent Systems and Computing 959 (2020), 279–288. https://doi.org/10.1007/978-3-030-20040-4_25
A. Alshayban, I. Ahmed, and S. Malek. 2020. Accessibility Issues in Android Apps: State of Affairs, Sentiments, and Ways Forward. In Proc of the 42nd Intl Conf on Software Engineering (Seoul, South Korea) (ICSE ’20). ACM, New York, NY, USA, 1323–1334. https://doi.org/10.1145/3377811.3380392
M Aniche. 2014. Real World Test-Driven Development. Casa do Código, São Paulo
M. Ballantyne, A. Jha, A. Jacobsen, J. S. Hawker, and Y. N. El-Glaly. 2018. Study of Accessibility Guidelines of Mobile Applications. In Proc of the 17th Intl Conf on Mobile and Ubiquitous Multimedia (Cairo, Egypt) (MUM 2018). ACM, New York, NY, USA, 305–315. https://doi.org/10.1145/3282894.3282921
BBC. 2022. Accessibility - BBC. [link]
T. Bi, X. Xia, D. Lo, J. Grundy, T. Zimmermann, and D. Ford. 2022. Accessibility in Software Practice: A Practitioner’s Perspective. Trans. on Software Engineering and Methodology 31 (10 2022), 1–26. Issue 4. https://doi.org/10.1145/3503508
M. C. N. Carvalho, F. S. Dias, A. G. S. Reis, and A. P. Freire. 2018. Accessibility and Usability Problems Encountered on Websites and Applications in Mobile Devices by Blind and Normal-vision Users. In Proc of the 33rd Annual Symposium on Applied Computing (Pau, France). ACM, New York, NY, USA, 2022–2029. https://doi.org/10.1145/3167132.3167349
Lisa Crispin and Janet Gregory. 2009. Agile testing: A practical guide for testers and agile teams. Pearson Education, Boston, MA
R. J. P. Damaceno, J. C. Braga, and J. P. Mena-Chalco. 2018. Mobile device accessibility for the visually impaired: problems mapping and recommendations. Universal Access in the Information Society 17 (2018), 421–435. https://doi.org/10.1007/s10209-017-0540-1
Arthur Floriano Barbosa Andrade de Oliveira and Lucia Vilela Leite Filgueiras. 2019. AccessibiLint: A Tool for Early Accessibility Verification for Android Native Applications. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems (Vitória, Espírito Santo, Brazil) (IHC ’19). Association for Computing Machinery, New York, NY, USA, Article 61, 4 pages. https://doi.org/10.1145/3357155.3360474
Márcio Eduardo Delamaro, José Carlos Maldonado, and Mário Jino. 2016. Introdução ao teste de software. Elsevier, Rio de Janeiro
F. Dias, L. Duarte, and R. Fortes. 2021. AccessMDD: An MDD approach for generating accessible mobile applications. Proc of the 39th ACM Intl Conf on the Design of Communication - SIGDOC 2021 11 (2021), 85–95. https://doi.org/10.1145/3472714.3473904
M. M. Eler, J. M. Rojas, Yan Ge, and G. Fraser. 2018. Automated Accessibility Testing of Mobile Apps. In 2018 IEEE 11th Intl Conf on Software Testing, Verification and Validation (ICST). IEEE Inc., Västerås, Sweden, 116–126. https://doi.org/10.1109/ICST.2018.00021
Google. 2023. Developer Guides. [link]
Google. 2023. Roboletric. [link]
M. V. Rodrigues Leite, L. P. Scatalon, A. P. Freire, and M. M. Eler. 2021. Accessibility in the mobile development industry in Brazil: Awareness, knowledge, adoption, motivations and barriers. Journal of Systems and Software 177 (7 2021), 110942. https://doi.org/10.1016/J.JSS.2021.110942
Alberto Dumont Alves Oliveira, Paulo Sérgio Henrique Dos Santos, Wilson Estécio Marcílio Júnior, Wajdi M Aljedaani, Danilo Medeiros Eler, and Marcelo Medeiros Eler. 2023. Analyzing Accessibility Reviews Associated with Visual Disabilities or Eye Conditions. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 37, 14 pages. https://doi.org/10.1145/3544548.3581315
Eunju Park, Sungjun Han, Hogon Bae, Raekyung Kim, Seungjae Lee, Daejune Lim, and Hankyu Lim. 2019. Development of Automatic Evaluation Tool for Mobile Accessibility for Android Application. In 2019 International Conference on Systems of Collaboration Big Data, Internet of Things & Security (SysCoBIoTS). IEEE, Jeju, Korea, 1–6. https://doi.org/10.1109/SysCoBIoTS48768.2019.9028034.
Navid Salehnamadi, Abdulaziz Alshayban, Jun-Wei Lin, Iftekhar Ahmed, Stacy Branham, and Sam Malek. 2021. Latte: Use-Case and Assistive-Service Driven Automated Accessibility Testing Framework for Android. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 274, 11 pages. https://doi.org/10.1145/3411764.3445455
Clauirton Siebra, Walter Correia, Marcelo Penha, Jefté Macêdo, Jonysberg Quintino, Marcelo Anjos, Fabiana Florentin, Fabio Q. B. Silva, and Andre L M Santos. 2018. Guidelines for Accessibility: ensuring the usability of mobile applications for visually impaired users. In Anais Estendidos do XVII Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais (Belém). SBC, Porto Alegre, RS, Brasil. https://doi.org/10.5753/ihc.2018.4194
David Swallow, Helen Petrie, and Christopher Power. 2016. Understanding and supporting web developers: Design and evaluation of a web accessibility information resource (WebAIR). Studies in Health Technology and Informatics 229 (2016), 482–491. https://doi.org/10.3233/978-1-61499-684-2-482
Aaron R. Vontell. 2019. Bility : Automated Accessibility Testing for Mobile Applications by. Ph. D. Dissertation. Massachusetts Institute of Technology. [link]
W3C. 2022. World Wide Web Consortium. [link]
S. Yan and P. G. Ramachandran. 2019. The current status of accessibility in mobile apps. ACM Transactions on Accessible Computing 12, 1 (2 2019), 31 pages. https://doi.org/10.1145/3300176
Patricia Acosta-Vargas, L. Salvador-Ullauri, J. Jadán-Guerrero, C. Guevara, S. Sanchez-Gordon, T. Calle-Jimenez, P. Lara-Alvarez, A. Medina, and I. L. Nunes. 2020. Accessibility assessment in mobile applications for Android. Advances in Intelligent Systems and Computing 959 (2020), 279–288. https://doi.org/10.1007/978-3-030-20040-4_25
A. Alshayban, I. Ahmed, and S. Malek. 2020. Accessibility Issues in Android Apps: State of Affairs, Sentiments, and Ways Forward. In Proc of the 42nd Intl Conf on Software Engineering (Seoul, South Korea) (ICSE ’20). ACM, New York, NY, USA, 1323–1334. https://doi.org/10.1145/3377811.3380392
M Aniche. 2014. Real World Test-Driven Development. Casa do Código, São Paulo
M. Ballantyne, A. Jha, A. Jacobsen, J. S. Hawker, and Y. N. El-Glaly. 2018. Study of Accessibility Guidelines of Mobile Applications. In Proc of the 17th Intl Conf on Mobile and Ubiquitous Multimedia (Cairo, Egypt) (MUM 2018). ACM, New York, NY, USA, 305–315. https://doi.org/10.1145/3282894.3282921
BBC. 2022. Accessibility - BBC. [link]
T. Bi, X. Xia, D. Lo, J. Grundy, T. Zimmermann, and D. Ford. 2022. Accessibility in Software Practice: A Practitioner’s Perspective. Trans. on Software Engineering and Methodology 31 (10 2022), 1–26. Issue 4. https://doi.org/10.1145/3503508
M. C. N. Carvalho, F. S. Dias, A. G. S. Reis, and A. P. Freire. 2018. Accessibility and Usability Problems Encountered on Websites and Applications in Mobile Devices by Blind and Normal-vision Users. In Proc of the 33rd Annual Symposium on Applied Computing (Pau, France). ACM, New York, NY, USA, 2022–2029. https://doi.org/10.1145/3167132.3167349
Lisa Crispin and Janet Gregory. 2009. Agile testing: A practical guide for testers and agile teams. Pearson Education, Boston, MA
R. J. P. Damaceno, J. C. Braga, and J. P. Mena-Chalco. 2018. Mobile device accessibility for the visually impaired: problems mapping and recommendations. Universal Access in the Information Society 17 (2018), 421–435. https://doi.org/10.1007/s10209-017-0540-1
Arthur Floriano Barbosa Andrade de Oliveira and Lucia Vilela Leite Filgueiras. 2019. AccessibiLint: A Tool for Early Accessibility Verification for Android Native Applications. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems (Vitória, Espírito Santo, Brazil) (IHC ’19). Association for Computing Machinery, New York, NY, USA, Article 61, 4 pages. https://doi.org/10.1145/3357155.3360474
Márcio Eduardo Delamaro, José Carlos Maldonado, and Mário Jino. 2016. Introdução ao teste de software. Elsevier, Rio de Janeiro
F. Dias, L. Duarte, and R. Fortes. 2021. AccessMDD: An MDD approach for generating accessible mobile applications. Proc of the 39th ACM Intl Conf on the Design of Communication - SIGDOC 2021 11 (2021), 85–95. https://doi.org/10.1145/3472714.3473904
M. M. Eler, J. M. Rojas, Yan Ge, and G. Fraser. 2018. Automated Accessibility Testing of Mobile Apps. In 2018 IEEE 11th Intl Conf on Software Testing, Verification and Validation (ICST). IEEE Inc., Västerås, Sweden, 116–126. https://doi.org/10.1109/ICST.2018.00021
Google. 2023. Developer Guides. [link]
Google. 2023. Roboletric. [link]
M. V. Rodrigues Leite, L. P. Scatalon, A. P. Freire, and M. M. Eler. 2021. Accessibility in the mobile development industry in Brazil: Awareness, knowledge, adoption, motivations and barriers. Journal of Systems and Software 177 (7 2021), 110942. https://doi.org/10.1016/J.JSS.2021.110942
Alberto Dumont Alves Oliveira, Paulo Sérgio Henrique Dos Santos, Wilson Estécio Marcílio Júnior, Wajdi M Aljedaani, Danilo Medeiros Eler, and Marcelo Medeiros Eler. 2023. Analyzing Accessibility Reviews Associated with Visual Disabilities or Eye Conditions. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 37, 14 pages. https://doi.org/10.1145/3544548.3581315
Eunju Park, Sungjun Han, Hogon Bae, Raekyung Kim, Seungjae Lee, Daejune Lim, and Hankyu Lim. 2019. Development of Automatic Evaluation Tool for Mobile Accessibility for Android Application. In 2019 International Conference on Systems of Collaboration Big Data, Internet of Things & Security (SysCoBIoTS). IEEE, Jeju, Korea, 1–6. https://doi.org/10.1109/SysCoBIoTS48768.2019.9028034.
Navid Salehnamadi, Abdulaziz Alshayban, Jun-Wei Lin, Iftekhar Ahmed, Stacy Branham, and Sam Malek. 2021. Latte: Use-Case and Assistive-Service Driven Automated Accessibility Testing Framework for Android. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 274, 11 pages. https://doi.org/10.1145/3411764.3445455
Clauirton Siebra, Walter Correia, Marcelo Penha, Jefté Macêdo, Jonysberg Quintino, Marcelo Anjos, Fabiana Florentin, Fabio Q. B. Silva, and Andre L M Santos. 2018. Guidelines for Accessibility: ensuring the usability of mobile applications for visually impaired users. In Anais Estendidos do XVII Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais (Belém). SBC, Porto Alegre, RS, Brasil. https://doi.org/10.5753/ihc.2018.4194
David Swallow, Helen Petrie, and Christopher Power. 2016. Understanding and supporting web developers: Design and evaluation of a web accessibility information resource (WebAIR). Studies in Health Technology and Informatics 229 (2016), 482–491. https://doi.org/10.3233/978-1-61499-684-2-482
Aaron R. Vontell. 2019. Bility : Automated Accessibility Testing for Mobile Applications by. Ph. D. Dissertation. Massachusetts Institute of Technology. [link]
W3C. 2022. World Wide Web Consortium. [link]
S. Yan and P. G. Ramachandran. 2019. The current status of accessibility in mobile apps. ACM Transactions on Accessible Computing 12, 1 (2 2019), 31 pages. https://doi.org/10.1145/3300176
Publicado
23/10/2023
Como Citar
GARCIA, Anderson Canale; DE LARA, Silvana Maria Affonso; DUARTE, Lianna Mara Castro; DE MATTOS FORTES, Renata Pontin; RODRIGUES, Kamila Rios Da Hora.
Early accessibility testing – an automated kit for Android developers. In: SIMPÓSIO BRASILEIRO DE SISTEMAS MULTIMÍDIA E WEB (WEBMEDIA), 29. , 2023, Ribeirão Preto/SP.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2023
.
p. 11–15.
