Accessibility Evaluation of Web Systems for People with Visual Impairments: Findings from a Literature Survey
Resumo
Accessibility evaluation is essential to determine how accessible a Web system is so that any user can access its content regardless of their limitations. In this context, this work presents a literature survey focused on the accessibility of Web systems, targeting users with visual impairments, emphasizing the importance of including accessibility from the initial phases to the completion of system development. Based on systematic procedures, we seek to provide a current view of the resources available in the technical literature for evaluating Web accessibility, with the primary goal of identifying and bringing together a variety of attributes, methods, metrics, and tools for accessibility improvement of Web systems. We analyzed 1245 papers in the literature; among them, 52 studies demonstrated available resources for evaluating systems by developers. We found that manual evaluation, evaluation with expert users, evaluation with end-users, and heuristic evaluation are the most recurrent accessibility evaluation types. We also cataloged 22 automatic tools, 16 attributes, 15 manual or automatic approaches, and seven heuristics for evaluating accessibility in Web systems. From our findings, it is possible to observe which resources have been used to maintain compliance with accessibility standards, helping professionals to include accessibility in their projects.
Palavras-chave:
web accessibility, evaluation of web systems, visual impairment
Referências
Patricia Acosta-Vargas, Luis Antonio Salvador-Ullauri, and Sergio Luján-Mora. 2019. A heuristic method to evaluate web accessibility for users with low vision. IEEE Access 7 (2019), 125634–125648.
Funmi Adebesin, Paula Kotzé, and Helene Gelderblom. 2010. The complementary role of two evaluation methods in the usability and accessibility evaluation of a non-standard system. In Proceedings of the 2010 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists. 1–11.
Georgios Akritidis and Christos Katsanos. 2021. Effect of Potential Issues Flagged by Automated Tools on Web Accessibility Evaluation Results: A Case Study on University Department Websites. In Proceedings of the 25th Pan-Hellenic Conference on Informatics. 113–117.
Nancy Alajarmeh. 2021. The extent of mobile accessibility coverage in WCAG 2.1: Sufficiency of success criteria and appropriateness of relevant conformance levels pertaining to accessibility problems encountered by users who are visually impaired. Universal Access in the Information Society (2021), 1–26.
Zainab AlMeraj, Fatima Boujarwah, Dari Alhuwail, and Rumana Qadri. 2021. Evaluating the accessibility of higher education institution websites in the State of Kuwait: empirical evidence. Universal Access in the Information Society 20, 1 (2021), 121–138.
Kewalin Angkananon, Mike Wald, and Piyabud Ploadaksorn. 2017. Developing and evaluating a Thai website accessibility checker. In HCI International 2017– Posters’ Extended Abstracts: 19th International Conference, HCI International 2017, Vancouver, BC, Canada, July 9–14, 2017, Proceedings, Part I 19. Springer, 3–10.
Aboubakr Aqle, Kamran Khowaja, and Dena Al-Thani. 2020. Preliminary evaluation of interactive search engine interface for visually impaired users. IEEE Access 8 (2020), 45061–45070.
Jinat Ara, Cecilia Sik-Lanyi, and Arpad Kelemen. 2023. Accessibility engineering in web evaluation process: a systematic literature review. Universal Access in the Information Society (2023), 1–34.
Cecilia Avila, Silvia Baldiris, Ramon Fabregat, and Juan Carlos Guevara. 2012. Accessibility evaluation improvement using case based reasoning. In 2012 Frontiers in Education Conference Proceedings. IEEE, 1–6.
Christopher Bailey and Elaine Pearson. 2011. Development and trial of an educational tool to support the accessibility evaluation process. In Proceedings of the International Cross-Disciplinary Conference on Web Accessibility. 1–10.
Raghuram Balaga. 2020. Accessibility Issues in Indonesian E-Commerce Portals: Issues and Recommendations for Business Improvement and Growth. In Reimagining Diffusion and Adoption of Information Technology and Systems: A Continuing Conversation: IFIP WG 8.6 International Conference on Transfer and Diffusion of IT, TDIT 2020, Tiruchirappalli, India, December 18–19, 2020, Proceedings, Part II. Springer, 581–591.
Simone Diniz Junqueira Barbosa, Bruno Santana da Silva, Milene Selbach Silveira, Isabela Gasparini, Ticianne Darin, and Gabriel Diniz Junqueira Barbosa. 2021. Interação Humano-Computador e Experiência do Usuário. Autopublicação.
Fanny Dolores Benites Alfaro and Claudia María Del Pilar Zapata Del Río. 2018. Peruvian public universities and the accessibility of their websites. In Design, User Experience, and Usability: Users, Contexts and Case Studies: 7th International Conference, DUXU 2018, Held as Part of HCI International 2018, Las Vegas, NV, USA, July 15–20, 2018, Proceedings, Part III 7. Springer, 589–607.
Tingting Bi, Xin Xia, David Lo, John Grundy, Thomas Zimmermann, and Denae Ford. 2022. Accessibility in Software Practice: A Practitioner’s Perspective. ACM Trans. Softw. Eng. Methodol. 31, 4, Article 66 (jul 2022), 26 pages. DOI: 10.1145/3503508
Jeffrey P Bigham, Jeremy T Brudvik, and Bernie Zhang. 2010. Accessibility by demonstration: enabling end users to guide developers to web accessibility solutions. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility. 35–42.
Brasil. 2014. eMAG Modelo de Acessibilidade em Governo Eletrônico. Portal do Governo Brasileiro (2014). [link]
Brasil. 2016. Resolução nº 510, de 07 de abril de 2016. Diário Oficial da República Federativa do Brasil (2016). Retrieved August 16, 2024 from [link] Dispõe sobre as normas aplicáveis a pesquisas em Ciências Humanas e Sociais cujos procedimentos metodológicos envolvam a utilização de dados diretamente obtidos com os participantes ou de informações identificáveis ou que possam acarretar riscos maiores do que os existentes na vida cotidiana. (In Portuguese).
Rocío Calvo, Ana Iglesias, and Lourdes Moreno. 2012. Is Moodle accessible for visually impaired people?. In Web Information Systems and Technologies: 7th International Conference, WEBIST 2011, Noordwijkerhout, The Netherlands, May 6-9, 2011, Revised Selected Papers 7. Springer, 207–220.
Milton Campoverde-Molina, Sergio Luján-Mora, and Llorenç Valverde. 2023. Accessibility of university websites worldwide: a systematic literature review. Universal Access in the Information Society 22, 1 (2023), 133–168.
Casa Civil. 2015. Lei Nº 13.146, de 6 de julho 2015. Institui a lei brasileira de inclusão da pessoa com deficiência (estatuto da pessoa com deficiência). Brasília (2015).
Sonia Colas, Nicolas Monmarché, and Mohamed Slimane. 2009. Assistive Tools to Reach European Accessibility Web Standards. In Universal Access in Human-Computer Interaction. Applications and Services: 5th International Conference, UAHCI 2009, Held as Part of HCI International 2009, San Diego, CA, USA, July 19-24, 2009. Proceedings, Part III 5. Springer, 654–663.
World Wide Web Consortium et al. 2008. Web content accessibility guidelines (WCAG) 2.0. (2008).
Daniel Costa, Luís Carriço, and Carlos Duarte. 2015. The differences in accessibility of tv and desktop web applications from the perspective of automated evaluation. Procedia Computer Science 67 (2015), 388–396.
Douglas Costa, Heitor Costa, and Paulo A Parreira. 2016. Heuristic evaluation of the visual accessibility of the Moodle Virtual Learning Environment. In 2016 XLII Latin American Computing Conference (CLEI). IEEE, 1–9.
Balázs Csontos and István Heckl. 2021. Accessibility, usability, and security evaluation of Hungarian government websites. Universal Access in the Information Society 20 (2021), 139–156.
Balázs Csontos and István Heckl. 2022. Improving accessibility of CMS-based websites using automated methods. Universal Access in the Information Society 21, 2 (2022), 491–505.
Isabel Maria de Souza, Cristiano Maciel, and Claudia Cappelli. 2016. The model of accessibility to electronic government: applicability in dataprev. In Proceedings of the 17th International Digital Government Research Conference on Digital Government Research. 287–292.
Nádia Fernandes, Daniel Costa, Carlos Duarte, and Luís Carriço. 2012. Evaluating the accessibility of web applications. Procedia Computer Science 14 (2012), 28–35.
José Luis Fuertes Castro, Ricardo González, Emmanuelle Gutiérrez, and Loïc Martínez Normand. 2009. Hera-FFX: a Firefox add-on for semi-automatic web accessibility evaluation. (2009).
Renan Soares Germano, Tereza A Nobre de Sousa, and Maria Amelia Eliseo. 2021. Refining the Acceasy Framework from an accessibility assessment. In 2021 16th Iberian Conference on Information Systems and Technologies (CISTI). IEEE, 1–6.
Teresa D Gilbertson and Colin HC Machin. 2012. Guidelines, icons and marketable skills: an accessibility evaluation of 100 web development company homepages. In Proceedings of the international cross-disciplinary conference on web accessibility. 1–4.
Behzad Joze Hashemian. 2011. Analyzing web accessibility in Finnish higher education. ACM Sigaccess Accessibility and Computing 101 (2011), 8–16.
IBGE IBGE. 2010. Censo demográfico 2010. IBGE: Insituto Brasileiro de Geografia e (2010), 34–35.
Yavuz Inal, Deepti Mishra, and Anne Britt Torkildsby. 2022. An Analysis of Web Content Accessibility of Municipality Websites for People with Disabilities in Norway: Web Accessibility of Norwegian Municipality Websites. In Nordic Human-Computer Interaction Conference. 1–12.
Erkut İ İşeri, Kaan Uyar, and Ümit İlhan. 2017. The accessibility of Cyprus Islands’ higher education institution websites. Procedia computer science 120 (2017), 967–974.
Abid Ismail and KS Kuppusamy. 2022. Web accessibility investigation and identification of major issues of higher education websites with statistical measures: A case study of college websites. Journal of King Saud University-Computer and Information Sciences 34, 3 (2022), 901–911.
Staffs Keele et al. 2007. Guidelines for performing systematic literature reviews in software engineering. Technical Report. Technical report, ver. 2.3 ebse technical report. ebse.
Barbara Kitchenham and Stuart Charters. 2007. Guidelines for performing systematic literature reviews in software engineering. (2007).
Serhat Kurt. 2017. Accessibility of Turkish university Web sites. Universal Access in the Information Society 16 (2017), 505–515.
Merja Laamanen, Tarja Ladonlahti, Hannu Puupponen, and Tommi Kärkkäinen. 2022. Does the law matter? An empirical study on the accessibility of Finnish higher education institutions’ web pages. Universal Access in the Information Society (2022), 1–17.
Zui Young Lim, Jia Min Chua, Kaiting Yang, Wei Shin Tan, and Yinn Chai. 2020. Web accessibility testing for singapore government e-services. In Proceedings of the 17th International Web for All Conference. 1–5.
Gabriel EF Lima, Natália N Vieira, Renato Campos Mauro, Fábio Paschoal Júnior, and Rafael Castaneda Ribeiro. 2020. Web Navegate Visual Comfort: Inclusival and Egalitarian Opportunities for Visual Impairment Users. In 2020 15th Iberian Conference on Information Systems and Technologies (CISTI). IEEE, 1–6.
Xingyu Liu, Patrick Carrington, Xiang ‘Anthony’ Chen, and Amy Pavel. 2021. What makes videos accessible to blind and visually impaired people?. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–14.
Yan Quan Liu, Arlene Bielefield, and Peter McKay. 2019. Are urban public libraries websites accessible to Americans with disabilities? Universal Access in the Information Society 18 (2019), 191–206.
Beatriz Martins and Carlos Duarte. 2023. A large-scale web accessibility analysis considering technology adoption. Universal Access in the Information Society (2023), 1–16.
Shane May and Qi Zhu. 2010. A web accessibility assessment on the Texas public school system. Universal Access in the Information Society 9 (2010), 87–96.
Jonathas Leontino Medina, Maria Istela Cagnin, and Débora Maria Barroso Paiva. 2015. Investigating accessibility on web-based maps. ACM SIGAPP Applied Computing Review 15, 2 (2015), 17–26.
Sonia Montagud, Silvia Abrahão, and Emilio Insfran. 2012. A systematic review of quality attributes and measures for software product lines. Software Quality Journal 20 (2012), 425–486.
Telcia Niom and Frank Lin. 2022. Accessibility of COVID-19 Websites of Asian Countries: An Evaluation Using Automated Tools. SN Computer Science 3, 6 (2022), 498.
Alberto Dumont Alves Oliveira, Andre Pimenta Freire, and Marcelo Medeiros Eler. 2020. Web accessibility evolution in the Brazilian government. In XVI Brazilian Symposium on Information Systems. 1–8.
Débora Maria Barroso Paiva, André Pimenta Freire, and Renata Pontin de Mattos Fortes. 2021. Accessibility and Software Engineering Processes: A Systematic Literature Review. Journal of Systems and Software 171 (2021), 110819. DOI: 10.1016/j.jss.2020.110819
Christopher Power, André Freire, Helen Petrie, and David Swallow. 2012. Guidelines are only half of the story: accessibility problems encountered by blind users on the web. In Proceedings of the SIGCHI conference on human factors in computing systems. 433–442.
Roger S Pressman and Bruce R Maxim. 2021. Engenharia de software-9. McGraw Hill Brasil.
João Ricardo dos S. Rosa and Natasha Malveira C. Valentim. 2020. Accessibility, usability and user experience design for visually impaired people: a systematic mapping study. In Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems (Diamantina, Brazil) (IHC ’20). Association for Computing Machinery, New York, NY, USA, Article 5, 10 pages. DOI: 10.1145/3424953.3426626
Bruno Gomes da Silva and Kamila Rios H Rodrigues. 2018. Accessibility challenges in web systems implementation. In Anais do IX Workshop sobre Aspectos da Interação Humano-Computador para a Web Social. SBC, 105–116.
Carlos Alberto Silva, Arthur FBA de Oliveira, Delvani Antônio Mateus, Heitor Augustus Xavier Costa, and André Pimenta Freire. 2019. Types of problems encountered by automated tool accessibility assessments, expert inspections and user testing: a systematic literature mapping. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems. 1–11.
Barbara Cristina A Silveira, Thiago Silva-de Souza, and Ana Regina C da Rocha. 2018. Software Accessibility for Visually Impaired People: a systematic mapping study. In Proceedings of the XVII Brazilian Symposium on Software Quality. 190– 199.
Shuyi Song, Jiajun Bu, Andreas Artmeier, Keyue Shi, Ye Wang, Zhi Yu, and Can Wang. 2018. Crowdsourcing-based Web accessibility evaluation with golden maximum likelihood inference. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 1–21.
Shuyi Song, Can Wang, Liangcheng Li, Zhi Yu, Xiao Lin, and Jiajun Bu. 2017. WAEM: a web accessibility evaluation metric based on partial user experience order. In Proceedings of the 14th International Web for All Conference. 1–4.
Markel Vigo and Giorgio Brajnik. 2011. Automatic web accessibility metrics: Where we are and where we can go. Interacting with computers 23, 2 (2011), 137–155.
Markel Vigo, Justin Brown, and Vivienne Conway. 2013. Benchmarking web accessibility evaluation tools: measuring the harm of sole reliance on automated tests. In Proceedings of the 10th international cross-disciplinary conference on web accessibility. 1–10.
Beat Vollenwyder, Serge Petralito, Glena H Iten, Florian Brühlmann, Klaus Opwis, and Elisa D Mekler. 2023. How compliance with web accessibility standards shapes the experiences of users with and without disabilities. International Journal of Human-Computer Studies 170 (2023), 102956.
WAI. 2022. WCAG 2 Overview. Retrieved June 08, 2022 from [link]
WAI. 2023. WCAG 2.1 at a Glance. Retrieved Nov 20, 2023 from [link]
Willian Massami Watanabe, Renata PM Fortes, and Ana Luiza Dias. 2012. Using acceptance tests to validate accessibility requirements in ria. In Proceedings of the International Cross-Disciplinary Conference on Web Accessibility. 1–10.
Michael Whitney and Stephen Dannelly. 2022. Web accessibility: an evaluation of CCSC central plains participants’ university home pages. Journal of Computing Sciences in Colleges 37, 6 (2022), 46–53.
Gian Wild. 2016. Social media and accessibility. In HCI in Business, Government, and Organizations: eCommerce and Innovation: Third International Conference, HCIBGO 2016, Held as Part of HCI International 2016, Toronto, Canada, July 17-22, 2016, Proceedings, Part I 3. Springer, 129–140.
World Health Organization. 2023. HTML: Disability. Retrieved Nov 10, 2023 from [link]
Yong Jeong Yi. 2020. Web accessibility of healthcare Web sites of Korean government and public agencies: a user test for persons with visual impairment. Universal Access in the Information Society 19, 1 (2020), 41–56.
Norman E Youngblood, Muhammet Fehmi Capanoglu, and Richard Sesek. 2021. The accessibility of state occupational safety and health consultation websites. Universal Access in the Information Society 20 (2021), 85–92.
Mengni Zhang, Can Wang, Zhi Yu, Chao Shen, and Jiajun Bu. 2017. Active learning for web accessibility evaluation. In Proceedings of the 14th International Web for All Conference. 1–9.
Funmi Adebesin, Paula Kotzé, and Helene Gelderblom. 2010. The complementary role of two evaluation methods in the usability and accessibility evaluation of a non-standard system. In Proceedings of the 2010 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists. 1–11.
Georgios Akritidis and Christos Katsanos. 2021. Effect of Potential Issues Flagged by Automated Tools on Web Accessibility Evaluation Results: A Case Study on University Department Websites. In Proceedings of the 25th Pan-Hellenic Conference on Informatics. 113–117.
Nancy Alajarmeh. 2021. The extent of mobile accessibility coverage in WCAG 2.1: Sufficiency of success criteria and appropriateness of relevant conformance levels pertaining to accessibility problems encountered by users who are visually impaired. Universal Access in the Information Society (2021), 1–26.
Zainab AlMeraj, Fatima Boujarwah, Dari Alhuwail, and Rumana Qadri. 2021. Evaluating the accessibility of higher education institution websites in the State of Kuwait: empirical evidence. Universal Access in the Information Society 20, 1 (2021), 121–138.
Kewalin Angkananon, Mike Wald, and Piyabud Ploadaksorn. 2017. Developing and evaluating a Thai website accessibility checker. In HCI International 2017– Posters’ Extended Abstracts: 19th International Conference, HCI International 2017, Vancouver, BC, Canada, July 9–14, 2017, Proceedings, Part I 19. Springer, 3–10.
Aboubakr Aqle, Kamran Khowaja, and Dena Al-Thani. 2020. Preliminary evaluation of interactive search engine interface for visually impaired users. IEEE Access 8 (2020), 45061–45070.
Jinat Ara, Cecilia Sik-Lanyi, and Arpad Kelemen. 2023. Accessibility engineering in web evaluation process: a systematic literature review. Universal Access in the Information Society (2023), 1–34.
Cecilia Avila, Silvia Baldiris, Ramon Fabregat, and Juan Carlos Guevara. 2012. Accessibility evaluation improvement using case based reasoning. In 2012 Frontiers in Education Conference Proceedings. IEEE, 1–6.
Christopher Bailey and Elaine Pearson. 2011. Development and trial of an educational tool to support the accessibility evaluation process. In Proceedings of the International Cross-Disciplinary Conference on Web Accessibility. 1–10.
Raghuram Balaga. 2020. Accessibility Issues in Indonesian E-Commerce Portals: Issues and Recommendations for Business Improvement and Growth. In Reimagining Diffusion and Adoption of Information Technology and Systems: A Continuing Conversation: IFIP WG 8.6 International Conference on Transfer and Diffusion of IT, TDIT 2020, Tiruchirappalli, India, December 18–19, 2020, Proceedings, Part II. Springer, 581–591.
Simone Diniz Junqueira Barbosa, Bruno Santana da Silva, Milene Selbach Silveira, Isabela Gasparini, Ticianne Darin, and Gabriel Diniz Junqueira Barbosa. 2021. Interação Humano-Computador e Experiência do Usuário. Autopublicação.
Fanny Dolores Benites Alfaro and Claudia María Del Pilar Zapata Del Río. 2018. Peruvian public universities and the accessibility of their websites. In Design, User Experience, and Usability: Users, Contexts and Case Studies: 7th International Conference, DUXU 2018, Held as Part of HCI International 2018, Las Vegas, NV, USA, July 15–20, 2018, Proceedings, Part III 7. Springer, 589–607.
Tingting Bi, Xin Xia, David Lo, John Grundy, Thomas Zimmermann, and Denae Ford. 2022. Accessibility in Software Practice: A Practitioner’s Perspective. ACM Trans. Softw. Eng. Methodol. 31, 4, Article 66 (jul 2022), 26 pages. DOI: 10.1145/3503508
Jeffrey P Bigham, Jeremy T Brudvik, and Bernie Zhang. 2010. Accessibility by demonstration: enabling end users to guide developers to web accessibility solutions. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility. 35–42.
Brasil. 2014. eMAG Modelo de Acessibilidade em Governo Eletrônico. Portal do Governo Brasileiro (2014). [link]
Brasil. 2016. Resolução nº 510, de 07 de abril de 2016. Diário Oficial da República Federativa do Brasil (2016). Retrieved August 16, 2024 from [link] Dispõe sobre as normas aplicáveis a pesquisas em Ciências Humanas e Sociais cujos procedimentos metodológicos envolvam a utilização de dados diretamente obtidos com os participantes ou de informações identificáveis ou que possam acarretar riscos maiores do que os existentes na vida cotidiana. (In Portuguese).
Rocío Calvo, Ana Iglesias, and Lourdes Moreno. 2012. Is Moodle accessible for visually impaired people?. In Web Information Systems and Technologies: 7th International Conference, WEBIST 2011, Noordwijkerhout, The Netherlands, May 6-9, 2011, Revised Selected Papers 7. Springer, 207–220.
Milton Campoverde-Molina, Sergio Luján-Mora, and Llorenç Valverde. 2023. Accessibility of university websites worldwide: a systematic literature review. Universal Access in the Information Society 22, 1 (2023), 133–168.
Casa Civil. 2015. Lei Nº 13.146, de 6 de julho 2015. Institui a lei brasileira de inclusão da pessoa com deficiência (estatuto da pessoa com deficiência). Brasília (2015).
Sonia Colas, Nicolas Monmarché, and Mohamed Slimane. 2009. Assistive Tools to Reach European Accessibility Web Standards. In Universal Access in Human-Computer Interaction. Applications and Services: 5th International Conference, UAHCI 2009, Held as Part of HCI International 2009, San Diego, CA, USA, July 19-24, 2009. Proceedings, Part III 5. Springer, 654–663.
World Wide Web Consortium et al. 2008. Web content accessibility guidelines (WCAG) 2.0. (2008).
Daniel Costa, Luís Carriço, and Carlos Duarte. 2015. The differences in accessibility of tv and desktop web applications from the perspective of automated evaluation. Procedia Computer Science 67 (2015), 388–396.
Douglas Costa, Heitor Costa, and Paulo A Parreira. 2016. Heuristic evaluation of the visual accessibility of the Moodle Virtual Learning Environment. In 2016 XLII Latin American Computing Conference (CLEI). IEEE, 1–9.
Balázs Csontos and István Heckl. 2021. Accessibility, usability, and security evaluation of Hungarian government websites. Universal Access in the Information Society 20 (2021), 139–156.
Balázs Csontos and István Heckl. 2022. Improving accessibility of CMS-based websites using automated methods. Universal Access in the Information Society 21, 2 (2022), 491–505.
Isabel Maria de Souza, Cristiano Maciel, and Claudia Cappelli. 2016. The model of accessibility to electronic government: applicability in dataprev. In Proceedings of the 17th International Digital Government Research Conference on Digital Government Research. 287–292.
Nádia Fernandes, Daniel Costa, Carlos Duarte, and Luís Carriço. 2012. Evaluating the accessibility of web applications. Procedia Computer Science 14 (2012), 28–35.
José Luis Fuertes Castro, Ricardo González, Emmanuelle Gutiérrez, and Loïc Martínez Normand. 2009. Hera-FFX: a Firefox add-on for semi-automatic web accessibility evaluation. (2009).
Renan Soares Germano, Tereza A Nobre de Sousa, and Maria Amelia Eliseo. 2021. Refining the Acceasy Framework from an accessibility assessment. In 2021 16th Iberian Conference on Information Systems and Technologies (CISTI). IEEE, 1–6.
Teresa D Gilbertson and Colin HC Machin. 2012. Guidelines, icons and marketable skills: an accessibility evaluation of 100 web development company homepages. In Proceedings of the international cross-disciplinary conference on web accessibility. 1–4.
Behzad Joze Hashemian. 2011. Analyzing web accessibility in Finnish higher education. ACM Sigaccess Accessibility and Computing 101 (2011), 8–16.
IBGE IBGE. 2010. Censo demográfico 2010. IBGE: Insituto Brasileiro de Geografia e (2010), 34–35.
Yavuz Inal, Deepti Mishra, and Anne Britt Torkildsby. 2022. An Analysis of Web Content Accessibility of Municipality Websites for People with Disabilities in Norway: Web Accessibility of Norwegian Municipality Websites. In Nordic Human-Computer Interaction Conference. 1–12.
Erkut İ İşeri, Kaan Uyar, and Ümit İlhan. 2017. The accessibility of Cyprus Islands’ higher education institution websites. Procedia computer science 120 (2017), 967–974.
Abid Ismail and KS Kuppusamy. 2022. Web accessibility investigation and identification of major issues of higher education websites with statistical measures: A case study of college websites. Journal of King Saud University-Computer and Information Sciences 34, 3 (2022), 901–911.
Staffs Keele et al. 2007. Guidelines for performing systematic literature reviews in software engineering. Technical Report. Technical report, ver. 2.3 ebse technical report. ebse.
Barbara Kitchenham and Stuart Charters. 2007. Guidelines for performing systematic literature reviews in software engineering. (2007).
Serhat Kurt. 2017. Accessibility of Turkish university Web sites. Universal Access in the Information Society 16 (2017), 505–515.
Merja Laamanen, Tarja Ladonlahti, Hannu Puupponen, and Tommi Kärkkäinen. 2022. Does the law matter? An empirical study on the accessibility of Finnish higher education institutions’ web pages. Universal Access in the Information Society (2022), 1–17.
Zui Young Lim, Jia Min Chua, Kaiting Yang, Wei Shin Tan, and Yinn Chai. 2020. Web accessibility testing for singapore government e-services. In Proceedings of the 17th International Web for All Conference. 1–5.
Gabriel EF Lima, Natália N Vieira, Renato Campos Mauro, Fábio Paschoal Júnior, and Rafael Castaneda Ribeiro. 2020. Web Navegate Visual Comfort: Inclusival and Egalitarian Opportunities for Visual Impairment Users. In 2020 15th Iberian Conference on Information Systems and Technologies (CISTI). IEEE, 1–6.
Xingyu Liu, Patrick Carrington, Xiang ‘Anthony’ Chen, and Amy Pavel. 2021. What makes videos accessible to blind and visually impaired people?. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–14.
Yan Quan Liu, Arlene Bielefield, and Peter McKay. 2019. Are urban public libraries websites accessible to Americans with disabilities? Universal Access in the Information Society 18 (2019), 191–206.
Beatriz Martins and Carlos Duarte. 2023. A large-scale web accessibility analysis considering technology adoption. Universal Access in the Information Society (2023), 1–16.
Shane May and Qi Zhu. 2010. A web accessibility assessment on the Texas public school system. Universal Access in the Information Society 9 (2010), 87–96.
Jonathas Leontino Medina, Maria Istela Cagnin, and Débora Maria Barroso Paiva. 2015. Investigating accessibility on web-based maps. ACM SIGAPP Applied Computing Review 15, 2 (2015), 17–26.
Sonia Montagud, Silvia Abrahão, and Emilio Insfran. 2012. A systematic review of quality attributes and measures for software product lines. Software Quality Journal 20 (2012), 425–486.
Telcia Niom and Frank Lin. 2022. Accessibility of COVID-19 Websites of Asian Countries: An Evaluation Using Automated Tools. SN Computer Science 3, 6 (2022), 498.
Alberto Dumont Alves Oliveira, Andre Pimenta Freire, and Marcelo Medeiros Eler. 2020. Web accessibility evolution in the Brazilian government. In XVI Brazilian Symposium on Information Systems. 1–8.
Débora Maria Barroso Paiva, André Pimenta Freire, and Renata Pontin de Mattos Fortes. 2021. Accessibility and Software Engineering Processes: A Systematic Literature Review. Journal of Systems and Software 171 (2021), 110819. DOI: 10.1016/j.jss.2020.110819
Christopher Power, André Freire, Helen Petrie, and David Swallow. 2012. Guidelines are only half of the story: accessibility problems encountered by blind users on the web. In Proceedings of the SIGCHI conference on human factors in computing systems. 433–442.
Roger S Pressman and Bruce R Maxim. 2021. Engenharia de software-9. McGraw Hill Brasil.
João Ricardo dos S. Rosa and Natasha Malveira C. Valentim. 2020. Accessibility, usability and user experience design for visually impaired people: a systematic mapping study. In Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems (Diamantina, Brazil) (IHC ’20). Association for Computing Machinery, New York, NY, USA, Article 5, 10 pages. DOI: 10.1145/3424953.3426626
Bruno Gomes da Silva and Kamila Rios H Rodrigues. 2018. Accessibility challenges in web systems implementation. In Anais do IX Workshop sobre Aspectos da Interação Humano-Computador para a Web Social. SBC, 105–116.
Carlos Alberto Silva, Arthur FBA de Oliveira, Delvani Antônio Mateus, Heitor Augustus Xavier Costa, and André Pimenta Freire. 2019. Types of problems encountered by automated tool accessibility assessments, expert inspections and user testing: a systematic literature mapping. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems. 1–11.
Barbara Cristina A Silveira, Thiago Silva-de Souza, and Ana Regina C da Rocha. 2018. Software Accessibility for Visually Impaired People: a systematic mapping study. In Proceedings of the XVII Brazilian Symposium on Software Quality. 190– 199.
Shuyi Song, Jiajun Bu, Andreas Artmeier, Keyue Shi, Ye Wang, Zhi Yu, and Can Wang. 2018. Crowdsourcing-based Web accessibility evaluation with golden maximum likelihood inference. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 1–21.
Shuyi Song, Can Wang, Liangcheng Li, Zhi Yu, Xiao Lin, and Jiajun Bu. 2017. WAEM: a web accessibility evaluation metric based on partial user experience order. In Proceedings of the 14th International Web for All Conference. 1–4.
Markel Vigo and Giorgio Brajnik. 2011. Automatic web accessibility metrics: Where we are and where we can go. Interacting with computers 23, 2 (2011), 137–155.
Markel Vigo, Justin Brown, and Vivienne Conway. 2013. Benchmarking web accessibility evaluation tools: measuring the harm of sole reliance on automated tests. In Proceedings of the 10th international cross-disciplinary conference on web accessibility. 1–10.
Beat Vollenwyder, Serge Petralito, Glena H Iten, Florian Brühlmann, Klaus Opwis, and Elisa D Mekler. 2023. How compliance with web accessibility standards shapes the experiences of users with and without disabilities. International Journal of Human-Computer Studies 170 (2023), 102956.
WAI. 2022. WCAG 2 Overview. Retrieved June 08, 2022 from [link]
WAI. 2023. WCAG 2.1 at a Glance. Retrieved Nov 20, 2023 from [link]
Willian Massami Watanabe, Renata PM Fortes, and Ana Luiza Dias. 2012. Using acceptance tests to validate accessibility requirements in ria. In Proceedings of the International Cross-Disciplinary Conference on Web Accessibility. 1–10.
Michael Whitney and Stephen Dannelly. 2022. Web accessibility: an evaluation of CCSC central plains participants’ university home pages. Journal of Computing Sciences in Colleges 37, 6 (2022), 46–53.
Gian Wild. 2016. Social media and accessibility. In HCI in Business, Government, and Organizations: eCommerce and Innovation: Third International Conference, HCIBGO 2016, Held as Part of HCI International 2016, Toronto, Canada, July 17-22, 2016, Proceedings, Part I 3. Springer, 129–140.
World Health Organization. 2023. HTML: Disability. Retrieved Nov 10, 2023 from [link]
Yong Jeong Yi. 2020. Web accessibility of healthcare Web sites of Korean government and public agencies: a user test for persons with visual impairment. Universal Access in the Information Society 19, 1 (2020), 41–56.
Norman E Youngblood, Muhammet Fehmi Capanoglu, and Richard Sesek. 2021. The accessibility of state occupational safety and health consultation websites. Universal Access in the Information Society 20 (2021), 85–92.
Mengni Zhang, Can Wang, Zhi Yu, Chao Shen, and Jiajun Bu. 2017. Active learning for web accessibility evaluation. In Proceedings of the 14th International Web for All Conference. 1–9.
Publicado
07/11/2024
Como Citar
SOUZA, Aline; DE SOUZA FILHO, José Cezar; BEZERRA, Carla; ALVES, Victor Anthony; LIMA, Lara; MARQUES, Anna Beatriz; TEIXEIRA MONTEIRO, Ingrid.
Accessibility Evaluation of Web Systems for People with Visual Impairments: Findings from a Literature Survey. In: SIMPÓSIO BRASILEIRO SOBRE FATORES HUMANOS EM SISTEMAS COMPUTACIONAIS (IHC), 23. , 2024, Brasília/DF.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2024
.
p. 581-593.
