Assistive Technology to Assist the Visually Impaired in the Use of ICTs: A Systematic Literature Review


CONTEXT: Assistive Technology refers to a set of resources and services designed to help people with disabilities, providing or expanding their skills, enabling they to carry out activities with comfort and autonomy. PROBLEM: For visually impaired, the AT can guarantee access to ICTs, as resources such as screen and mouse may not be useful. In world, an estimated 285 million people are visually impaired, 39 million being blind. METHODOLOGY: This work describes a Systematic Literature Review, seeking to identify, analyze and interpret works related to AT developed to help visually impaired in the use of systems. INFORMATION SYSTEMS THEORY: Was based on Theory of Interactive Media Effects, who argues that the characteristics of the media, as well as the source and content of the messages, affect the engagement and interaction of individuals involved in communication. SUMMARY OF RESULTS: 108 articles related to AT developed for visually impaired during an interaction with ICTs were obtained. Reading these works, select 12 articles related to learning computer programming and the use of software development tools by visually impaired. It was found that most of the TA resources developed focus only on the extension of the visual interface. CONTRIBUTIONS: The main limitations of the TA to access the resources available in systems for visually impaired, based on RSL, are considered. IMPACT ON SI AREA: Works related to the learning of concepts related to computer programming and software development tools for the visually impaired are analyzed, as well as the contributions, opportunities and challenges related to the development of AT to promote accessibility of these users in Information Systems.
Palavras-chave: Human-Computer Interaction, Assistive Technology, Accessibility, Visual Impairment


NBR ISO/IEC 9126-1. 2003. Engenharia de Software: Qualidade de produto. Parte 1: Modelo de Qualidade. 

Stênio Abreu, Jorge Sassaki Resende Silva, Graciela Pires dos Anjos, Hérlon Manollo Cândido Guedes, Soraia Silva Prietch, Paula Christina Figueira Cardoso, and André Pimenta Freire. 2019. Usability evaluation of a resource to read mathematical formulae in a screen reader for people with visual disabilities. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems. 1–11. 

Khaled Albusays, Stephanie Ludi, and Matt Huenerfauth. 2017. Interviews and observation of blind software developers at work to understand code navigation challenges. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility. 91–100. 

Erick Antonio Alves, Paula Christina Figueira Cardoso, and André Pimenta Freire. 2018. Automatically Generated Summaries as In-Page Web Navigation Accelerators for Blind Users. In Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems. 1–8. 

Vassilios Argyropoulos, Afroditi Paveli, and Magda Nikolaraizi. 2019. The role of DAISY digital talking books in the education of individuals with blindness: A pilot study. Education and Information Technologies 24, 1 (2019), 693–709. 

Ali Selman Aydin, Shirin Feiz, Vikas Ashok, and IV Ramakrishnan. 2020. Sail: Saliency-driven injection of aria landmarks. In Proceedings of the 25th International Conference on Intelligent User Interfaces. 111–115. 

Simone Barbosa and Bruno Silva. 2010. Interação humano-computador. Elsevier Brasil. 

David B Boardman, Geoffrey Greene, Vivek Khandelwal, and Aditya P Mathur. 1995. Listen: A tool to investigate the use of sound for the analysis of program behavior. In Proceedings Nineteenth Annual International Computer Software and Applications Conference (COMPSAC’95). IEEE, 184–189. 

Microsoft Research Cambridge. 2015. Project Torino - Microsoft Research.

Casa Civil. 2015. Lei Nº 13.146, de 6 de julho 2015. Institui a lei brasileira de inclusão da pessoa com deficiência (estatuto da pessoa com deficiência). Brasília (2015). 

CodeJumper. 2021. American Printing House.

Comitê de Ajudas Técnicas. 2009. Tecnologia assistiva. Brasília: Corde(2009). 

Sinopse do Censo Demográfico. 2010. IBGE. Rio de Janeiro (2010). 

Câmara dos Deputados. 2004. DECRETO Nº 5.296, DE 2 DE DEZEMBRO DE 2004. Define Diretrizes Curriculares Nacionais para a Educação Profissional Técnica de Nível Médio. Portal do MEC, Brasília, DF (2004). 

Sandra Fabbri, Cleiton Silva, Elis Hernandes, Fábio Octaviano, André Di Thommazo, and Anderson Belgamo. 2016. Improvements in the StArt tool to better support the systematic review process. In Proceedings of the 20th international conference on evaluation and assessment in software engineering. 1–5. 

Rafael José Geraldo. 2016. Um auxílio à navegação acessível na web para usuários cegos. Ph.D. Dissertation. São Carlos (SP): Teses de Doutorado em Ciências da Computação e Matemática Computacional da Universidade de São Paulo. 

Ítalo José Bastos Guimarãeset al. 2016. Acessibilidade em websites de comércio eletrônico: avaliação através da interação com usuários cegos.(2016). 

Alex Hadwen-Bennett, Sue Sentance, and Cecily Morrison. 2018. Making programming accessible to learners with visual impairments: A literature review. International Journal of Computer Science Education in Schools 2, 2(2018), 3–13. 

Gesu India, Geetha Ramakrishna, Joyojeet Pal, and Manohar Swaminathan. 2020. Conceptual Learning through Accessible Play: Project Torino and Computational Thinking for Blind Children in India. In Proceedings of the 2020 International Conference on Information and Communication Technologies and Development. 1–11. 

Abhishek Jariwala, Daniela Marghitu, and Richard Chapman. 2020. MyA+ Math: Teaching Math to Students with Vision Impairment. In International Conference on Human-Computer Interaction. Springer, 200–211. 

Akif Khan and Shah Khusro. 2019. Blind-friendly user interfaces–a pilot study on improving the accessibility of touchscreen interfaces. Multimedia Tools and Applications 78, 13 (2019), 17495–17519. 

Akif Khan, Shah Khusro, Badam Niazi, Jamil Ahmad, Iftikhar Alam, and Inayat Khan. 2020. TetraMail: a usable email client for blind people. Universal Access in the Information Society 19, 1 (2020), 113–132. 

Rushil Khurana, Duncan McIsaac, Elliot Lockerman, and Jennifer Mankoff. 2018. Nonvisual interaction techniques at the keyboard surface. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–12. 

Sebastian Lieb, Benjamin Rosenmeier, Thorsten Thormählen, and Knut Buettner. 2020. Haptic and Auditive Mesh Inspection for Blind 3D Modelers. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility. 1–10. 

Claudia Loitsch, Karin Müller, Stephan Seifermann, Jörg Henß, Sebastian Krach, Gerhard Jaworek, and Rainer Stiefelhagen. 2018. UML4ALL syntax–a textual notation for UML diagrams. In International Conference on Computers Helping People with Special Needs. Springer, 598–605. 

Elke Mattheiss, Georg Regal, David Sellitsch, and Manfred Tscheligi. 2017. User-centred design with visually impaired pupils: A case study of a game editor for orientation and mobility training. International Journal of Child-Computer Interaction 11 (2017), 12–18. 

Lauren R Milne and Richard E Ladner. 2018. Blocks4All: overcoming accessibility barriers to blocks programming for children with visual impairments. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–10. 

Gourav Modanwal and Kishor Sarawadekar. 2016. Development of a new dactylology and writing support system especially for blinds. In 2016 13th Conference on Computer and Robot Vision (CRV). IEEE, 362–369. 

Gourav Modanwal and Kishor Sarawadekar. 2017. A new dactylology and interactive system development for blind–computer interaction. IEEE Transactions on Human-Machine Systems 48, 2 (2017), 207–212. 

Manoranjitham Muniandy and Suziah Sulaiman. 2017. Touch sensation as part of multimedia design elements to improve computer accessibility for the blind users. In 2017 International Conference on Research and Innovation in Information Systems (ICRIIS). IEEE, 1–6. 

Elisa Yumi Nakagawa, Kátia Romero Felizardo Scannavino, Sandra Camargo Pinto Ferraz Fabbri, and Fabiano Cutigi Ferrari. 2017. Revisão sistemática da literatura em engenharia de software: teoria e prática. (2017). 

Juliana Damasio Oliveira, Márcia de Borba Campos, and Vanessa Stangherlin Machado Paixão-Cortes. 2020. Usable and Accessible Robot Programming System for People Who Are Visually Impaired. In International Conference on Human-Computer Interaction. Springer, 445–464. 

World Health Organization et al. 2011. World report on disability 2011. World Health Organization. 

Donatella Pascolini and Silvio Paolo Mariotti. 2012. Global estimates of visual impairment: 2010. British Journal of Ophthalmology 96, 5 (2012), 614–618. 

Ana Cristina Pires, Filipa Rocha, Antonio José de Barros Neto, Hugo Simão, Hugo Nicolau, and Tiago Guerreiro. 2020. Exploring accessible programming with educators and visually impaired children. In Proceedings of the Interaction Design and Children Conference. 148–160. 

Venkatesh Potluri, Priyan Vaithilingam, Suresh Iyengar, Y Vidya, Manohar Swaminathan, and Gopal Srinivasa. 2018. Codetalk: Improving programming environment accessibility for visually impaired developers. In Proceedings of the 2018 chi conference on human factors in computing systems. 1–11. 

Zhiyi Rong, Ngo Fung Chan, Taizhou Chen, and Kening Zhu. 2020. CodeRhythm: A Tangible Programming Toolkit for Visually Impaired Students. In The eighth International Workshop of Chinese CHI. 57–60. 

Uday Sagale, Ganesh Bhutkar, Mahadev Karad, and Nikhil Jathar. 2018. An Eye-Free Android application for visually impaired users. In Ergonomics in Caring for People. Springer, 291–297. 

Jaime Sánchez and Fernando Aguayo. 2006. APL: Audio programming language for blind learners. In International Conference on Computers for Handicapped Persons. Springer, 1334–1341. 

Alexa F Siu, Son Kim, Joshua A Miele, and Sean Follmer. 2019. shapeCAD: An accessible 3D modelling workflow for the blind and visually-impaired via 2.5 D shape displays. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility. 342–354. 

Andreas M Stefik, Christopher Hundhausen, and Derrick Smith. 2011. On the design of an educational infrastructure for the blind and visually impaired in computer science. In Proceedings of the 42nd ACM technical symposium on Computer science education. 571–576. 

Anja Thieme, Cecily Morrison, Nicolas Villar, Martin Grayson, and Siân Lindley. 2017. Enabling collaboration in learning computer programing inclusive of children with vision impairments. In Proceedings of the 2017 Conference on Designing Interactive Systems. 739–752. 

Emmanuel Utreras and Enrico Pontelli. 2020. Design of a Tangible Programming Tool for Students with Visual Impairments and Low Vision. In International Conference on Human-Computer Interaction. Springer, 304–314. 

Rishi Vanukuru. 2020. Accessible Spatial Audio Interfaces: A Pilot Study into Screen Readers with Concurrent Speech. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–6. 

Ramiro Velázquez, Claudia N Sánchez, and Edwige E Pissaloux. 2016. Visual impairment simulator based on the Hadamard product. Electronic Notes in Theoretical Computer Science 329 (2016), 169–179.
ZEN, Eliana; SIEDLER, Marcelo da Silveira; DA COSTA, Vinicius Kruger; TAVARES, Tatiana Aires. Assistive Technology to Assist the Visually Impaired in the Use of ICTs: A Systematic Literature Review. In: SIMPÓSIO BRASILEIRO DE SISTEMAS DE INFORMAÇÃO (SBSI), 18. , 2022, Curitiba. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2022 .