Optimizing manual web accessibility evaluation through a specialized tool
Resumo
Although the most widely used and studied web accessibility assessment methods involve only automated testing, this type of testing has limitations and does not provide completely reliable results. A complete assessment can only be achieved through a manual review that involves specialists and people with disabilities. However, performing manual accessibility testing as a team might be challenging regarding reporting errors, combining results, and managing the process. This paper details the usage of a tool designed to support the manual web accessibility evaluation process, highlighting its specifications and functionalities, as well as presenting the testimonies of team members - testers with disabilities and specialists. The results show that both testers and specialists had an overall positive experience using the tool, indicating it helps increase confidence in reporting, facilitates the workflow, and makes the process more efficient. Although the results indicate that the tool effectively supports the evaluation process, other features can be implemented to make some tasks less time-consuming, and more tests need to be performed to identify other possible improvements and verify the tools’ potential in different contexts.
Palavras-chave:
Accessibility, manual evaluation, support tool
Referências
Iyad Abu Doush, Khalid Sultan, Mohammed Al-Betar, Zainab Almeraj, Zaid Alyasseri, and Mohammed Awadallah. 2023. Web accessibility automatic evaluation tools: to what extent can they be automated? CCF Transactions on Pervasive Computing and Interaction 5 (03 2023). DOI: 10.1007/s42486023001278
Patricia Acosta-Vargas, Luis Antonio Salvador-Ullauri, and Sergio Luján-Mora. 2019. A Heuristic Method to Evaluate Web Accessibility for Users With Low Vision. IEEE Access 7 (2019), 125634–125648. DOI: 10.1109/ACCESS.2019.2939068
Obead Alhadreti. 2023. Investigating the accessibility of banking websites in Saudi Arabia. Universal Access in the Information Society (2023). DOI: 10.1007/s10209023010088
Jinat Ara, Cecilia Sik-Lanyi, and Arpad Kelemen. 2023. Accessibility engineering in web evaluation process: a systematic literature review. Univers Access Inf Soc (Jan 2023), 1–34. DOI: 10.1007/s10209-023-00967-2
A. Burkard, G. Zimmermann, and B. Schwarzer. 2021. Monitoring Systems for Checking Websites on Accessibility. Frontiers in Computer Science 3, 628770 (2021).
Milton Campoverde-Molina, Sergio Luján-Mora, and Llorenç Valverde García. 2020. Empirical Studies on Web Accessibility of Educational Websites: A Systematic Literature Review. IEEE Access 8 (2020), 91676–91700. DOI: 10.1109/ACCESS.2020.2994288
Bruno Cartaxo, Gustavo Pinto, Sergio Soares. 2020. Rapid Reviews in Software Engineering. Springer International Publishing, Cham, 357–384. DOI: 10.1007/9783030324896_13
Katrina Fernandes, Sarika Paramananthan, Lynn Cockburn, Julius Nganji. 2023. Readily available but how accessible? : An analysis of the web accessibility of healthcare-related resources. Journal of Accessibility and Design for All 13, 2 (Nov.2023),188–215. DOI: 10.17411/jacces.v13i2.421
Milda Galkute, Luis A. Rojas P., and Victor A. Sagal M. 2020. Improving the Web Accessibility of a University Library for People with Visual Disabilities Through a Mixed Evaluation Approach. In Social Computing and Social Media. Design, Ethics, User Behavior, and Social Network Analysis: 12th International Conference, SCSM 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July 19–24, 2020, Proceedings, Part I (Copenhagen, Denmark). Springer-Verlag, Berlin, Heidelberg, 56–71. DOI: 10.1007/9783030495701_5
Ramiro Moreira Gonçalves, Tânia Rocha, José Martins, Frederico Branco, and Manuel Au-Yong Oliveira. 2017. Evaluation of e-commerce websites accessibility and usability: an e-commerce platform analysis with the inclusion of blind users. Universal Access in the Information Society 17 (2017), 567 – 583. [link]
Francisco Iniesto and Covadonga Rodrigo. 2024.The use of WCAG and automatic tools by computer science students: a case study evaluating MOOC accessibility. Journal of Universal Computer Science 30, 1 (2024), 85–105.
Peter Johnson and Mariana Lilley. 2022. Software Prototype for the Ensemble of Automated Accessibility Evaluation Tools. In HCI International 2022 Posters, Constantine Stephanidis, Margherita Antona, and Stavroula Ntoa (Eds.). Springer International Publishing, Cham, 532–539.
Luis Felipe Londoño-Rojas, Valentina Tabares-Morales, and Néstor DuqueMéndez. 2023. AET tool for hybrid accessibility evaluation. Universal Access in the Information Society 22, 2 (2023), 655–661. DOI: 10.1007/s10209021008468
Sonia Mariño and Verónica Pagnoni. 2020. Accesibilidad Web en Dispositivos móviles. Evaluación de un portal educativo de alcance nacional. IJERI: International Journal of Educational Research and Innovation (02 2020), 177–194. DOI: 10.46661/ijeri.4606
José Martins, Ramiro Moreira Gonçalves, and Frederico Branco. 2017. A full scope web accessibility evaluation procedure proposal based on Iberian eHealth accessibilitycompliance.Comput.Hum.Behav.73(2017),676–684. [link]
S. Meenakshi and Anshu Singla. 2023. A novel heuristic method for quantitative assessment of web accessibility for colorblind. Universal Access in the Information Society (2023). DOI: 10.1007/s10209-023-01006-w
Lourdes Moreno, Rodrigo Alarcon, and Paloma Martínez. 2023. Accessibility and readability compliance in Spanish public hospital websites. In Proceedings of the 10th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-Exclusion (Lisbon, Portugal) (DSAI ’22). Association for Computing Machinery, New York, NY, USA, 185–194. DOI: 10.1145/3563137.3563143
Almendra Nuñez, Arturo Moquillaza, and Freddy Paz. 2019. Web Accessibility Evaluation Methods:: A Systematic Review. In Design, User Experience, and Usability. Practice and Case Studies 8th International Conference, DUXU 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)), Aaron Marcus and Wentao Wang (Eds.). Springer Verlag, Germany, 226–237. DOI: 10.1007/978-3-030-23535-2_17 Publisher Copyright: © 2019, Springer Nature Switzerland AG.; 8th International Conference on Design, User Experience, and Usability, DUXU 2019, held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019 ; Conference date: 26-07-2019 Through 31-07-2019.
Mukesh Pant and Abhirup Sinha. 2020. Evaluating State of Web Accessibility Standards in Top Airline Websites. In 2020 IEEE International IOT, Electronics and Mechatronics Conference (IEMTRONICS). 1–5. DOI: 10.1109/IEMTRONICS51293.2020.9216424
W3C. 2023. Web Accessibility Initiative. Retrieved May, 2024 from [link]
Patricia Acosta-Vargas, Luis Antonio Salvador-Ullauri, and Sergio Luján-Mora. 2019. A Heuristic Method to Evaluate Web Accessibility for Users With Low Vision. IEEE Access 7 (2019), 125634–125648. DOI: 10.1109/ACCESS.2019.2939068
Obead Alhadreti. 2023. Investigating the accessibility of banking websites in Saudi Arabia. Universal Access in the Information Society (2023). DOI: 10.1007/s10209023010088
Jinat Ara, Cecilia Sik-Lanyi, and Arpad Kelemen. 2023. Accessibility engineering in web evaluation process: a systematic literature review. Univers Access Inf Soc (Jan 2023), 1–34. DOI: 10.1007/s10209-023-00967-2
A. Burkard, G. Zimmermann, and B. Schwarzer. 2021. Monitoring Systems for Checking Websites on Accessibility. Frontiers in Computer Science 3, 628770 (2021).
Milton Campoverde-Molina, Sergio Luján-Mora, and Llorenç Valverde García. 2020. Empirical Studies on Web Accessibility of Educational Websites: A Systematic Literature Review. IEEE Access 8 (2020), 91676–91700. DOI: 10.1109/ACCESS.2020.2994288
Bruno Cartaxo, Gustavo Pinto, Sergio Soares. 2020. Rapid Reviews in Software Engineering. Springer International Publishing, Cham, 357–384. DOI: 10.1007/9783030324896_13
Katrina Fernandes, Sarika Paramananthan, Lynn Cockburn, Julius Nganji. 2023. Readily available but how accessible? : An analysis of the web accessibility of healthcare-related resources. Journal of Accessibility and Design for All 13, 2 (Nov.2023),188–215. DOI: 10.17411/jacces.v13i2.421
Milda Galkute, Luis A. Rojas P., and Victor A. Sagal M. 2020. Improving the Web Accessibility of a University Library for People with Visual Disabilities Through a Mixed Evaluation Approach. In Social Computing and Social Media. Design, Ethics, User Behavior, and Social Network Analysis: 12th International Conference, SCSM 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July 19–24, 2020, Proceedings, Part I (Copenhagen, Denmark). Springer-Verlag, Berlin, Heidelberg, 56–71. DOI: 10.1007/9783030495701_5
Ramiro Moreira Gonçalves, Tânia Rocha, José Martins, Frederico Branco, and Manuel Au-Yong Oliveira. 2017. Evaluation of e-commerce websites accessibility and usability: an e-commerce platform analysis with the inclusion of blind users. Universal Access in the Information Society 17 (2017), 567 – 583. [link]
Francisco Iniesto and Covadonga Rodrigo. 2024.The use of WCAG and automatic tools by computer science students: a case study evaluating MOOC accessibility. Journal of Universal Computer Science 30, 1 (2024), 85–105.
Peter Johnson and Mariana Lilley. 2022. Software Prototype for the Ensemble of Automated Accessibility Evaluation Tools. In HCI International 2022 Posters, Constantine Stephanidis, Margherita Antona, and Stavroula Ntoa (Eds.). Springer International Publishing, Cham, 532–539.
Luis Felipe Londoño-Rojas, Valentina Tabares-Morales, and Néstor DuqueMéndez. 2023. AET tool for hybrid accessibility evaluation. Universal Access in the Information Society 22, 2 (2023), 655–661. DOI: 10.1007/s10209021008468
Sonia Mariño and Verónica Pagnoni. 2020. Accesibilidad Web en Dispositivos móviles. Evaluación de un portal educativo de alcance nacional. IJERI: International Journal of Educational Research and Innovation (02 2020), 177–194. DOI: 10.46661/ijeri.4606
José Martins, Ramiro Moreira Gonçalves, and Frederico Branco. 2017. A full scope web accessibility evaluation procedure proposal based on Iberian eHealth accessibilitycompliance.Comput.Hum.Behav.73(2017),676–684. [link]
S. Meenakshi and Anshu Singla. 2023. A novel heuristic method for quantitative assessment of web accessibility for colorblind. Universal Access in the Information Society (2023). DOI: 10.1007/s10209-023-01006-w
Lourdes Moreno, Rodrigo Alarcon, and Paloma Martínez. 2023. Accessibility and readability compliance in Spanish public hospital websites. In Proceedings of the 10th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-Exclusion (Lisbon, Portugal) (DSAI ’22). Association for Computing Machinery, New York, NY, USA, 185–194. DOI: 10.1145/3563137.3563143
Almendra Nuñez, Arturo Moquillaza, and Freddy Paz. 2019. Web Accessibility Evaluation Methods:: A Systematic Review. In Design, User Experience, and Usability. Practice and Case Studies 8th International Conference, DUXU 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)), Aaron Marcus and Wentao Wang (Eds.). Springer Verlag, Germany, 226–237. DOI: 10.1007/978-3-030-23535-2_17 Publisher Copyright: © 2019, Springer Nature Switzerland AG.; 8th International Conference on Design, User Experience, and Usability, DUXU 2019, held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019 ; Conference date: 26-07-2019 Through 31-07-2019.
Mukesh Pant and Abhirup Sinha. 2020. Evaluating State of Web Accessibility Standards in Top Airline Websites. In 2020 IEEE International IOT, Electronics and Mechatronics Conference (IEMTRONICS). 1–5. DOI: 10.1109/IEMTRONICS51293.2020.9216424
W3C. 2023. Web Accessibility Initiative. Retrieved May, 2024 from [link]
Publicado
07/11/2024
Como Citar
SALTON, Bruna Poletto; DALL AGNOL, Anderson; NERVIS, Lael; DA SILVA, Tiago Silva; SILVEIRA, Milene Selbach.
Optimizing manual web accessibility evaluation through a specialized tool. In: SIMPÓSIO BRASILEIRO SOBRE FATORES HUMANOS EM SISTEMAS COMPUTACIONAIS (IHC), 23. , 2024, Brasília/DF.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2024
.
p. 134-145.
