Assistive Technology to help the interaction between visually impaired and computer systems: A Systematic Literature Mapping

Authors

  • Eliana Zen Universidade Federal de Pelotas (UFPEL) / Instituto Federal Farroupilha (IFFar)
  • Marcelo da Silveira Siedler Universidade Federal de Pelotas (UFPEL) / Instituto Federal Sul-riograndense (IFSul)
  • Vinicius Kruger da Costa Universidade Federal de Pelotas (UFPEL) / Instituto Federal Sul-riograndense (IFSul)
  • Tatiana Aires Tavares Universidade Federal de Pelotas (UFPEL)

DOI:

https://doi.org/10.5753/isys.2023.2890

Keywords:

Human-Computer Interaction, Assistive Technology, Accessibility, Visual Impairment

Abstract

Assistive Technology (AT) refers to a set of resources and services designed to help people with disabilities, providing or expanding their skills, enabling they to carry out activities with comfort and autonomy. For visually impaired, the Assistive Technology (AT) can guarantee access to ICTs, as resources such as screen and mouse may not be useful. Thus, this work describes a Systematic Literature Mapping, seeking to identify works related to AT developed to help visually impaired in the use of digital systems. As a result, 108 AT-related articles developed for the visually impaired during an interaction with ICTs were obtained. Reading these works, select 12 articles related to learning computer programming and the use of software development tools by visually impaired. It was found that most of the TA resources developed focus only on the extension of the visual interface.

Downloads

Download data is not yet available.

References

AAO.org (2022). American academy of ophthalmology. [link]. (Accessed on 06/19/2022).

Abreu, S., Silva, J. S. R., Anjos, G. P. d., Guedes, H. M. C., Prietch, S. S., Cardoso, P. C. F., and Freire, A. P. (2019). Usability evaluation of a resource to read mathematical formulae in a screen reader for people with visual disabilities. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems, pages 1–11.

Albusays, K., Ludi, S., and Huenerfauth, M. (2017). Interviews and observation of blind software developers at work to understand code navigation challenges. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility, pages 91–100.

Alves, E. A., Cardoso, P. C. F., and Freire, A. P. (2018). Automatically generated summaries as in-page web navigation accelerators for blind users. In Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems, pages 1–8.

Argyropoulos, V., Paveli, A., and Nikolaraizi, M. (2019). The role of daisy digital talking books in the education of individuals with blindness: A pilot study. Education and Information Technologies, 24(1):693–709.

Ashraf, M. M., Hasan, N., Lewis, L., Hasan, M. R., and Ray, P. (2016). A systematic literature review of the application of information communication technology for visually impaired people. International Journal of Disability Management, 11.

Aydin, A. S., Feiz, S., Ashok, V., and Ramakrishnan, I. (2020). Sail: Saliency-driven injection of aria landmarks. In Proceedings of the 25th International Conference on Intelligent User Interfaces, pages 111–115.

Barbosa, S. and Silva, B. (2010). Interação humano-computador. Elsevier Brasil.

Bardin, L. (2015). Análise de Conteúdo. Edições 70.

Bersch, R. (2008). Introdução à tecnologia assistiva. Porto Alegre: CEDI, 21.

Bhowmick, A. and Hazarika, S. M. (2017). An insight into assistive technology for the visually impaired and blind people: state-of-the-art and future trends. Journal on Multimodal User Interfaces, 11(2):149–172.

Brasil (2004). Decreto nº 5.296, de 2 de dezembro de 2004. Diretrizes Curriculares Nacionais para a Educação Profissional e Técnica de Nível Médio. Ministério da Educação, Brasília, DF.

Brasil (2006). Saberes e práticas da inclusão: desenvolvendo competências para o atendimento às necessidades educacionais especiais de alunos cegos e de alunos com baixa visão.

Cambridge, M. R. (2015). Project torino - Microsoft Research. [link].

CAT (2009). Tecnologia assistiva. Brasília: Secretaria Especial dos Direitos Humanos da Presidência da República, Comitê de Ajudas Técnicas.

Civil, C. (2015). Lei nº 13.146, de 6 de julho 2015. Institui a lei brasileira de inclusão da pessoa com deficiência (estatuto da pessoa com deficiência). Brasília.

CodeJumper (2021). American printing house. [link]

da Silva, C. F., Ferreira, S. B. L., and Ramos, J. F. M. (2016). Whatsapp accessibility from the perspective of visually impaired people. In Proceedings of the 15th Brazilian Symposium on Human Factors in Computing Systems, pages 1–10.

Dias, J. d. L. and Dias, M. d. L. O. (2019). Os leitores de tela como ferramenta de acessibilidade e inclusão da pessoa com deficiência visual. Brazilian Journal of Development, 5(12):28869–28878.

Fabbri, S., Silva, C., Hernandes, E., Octaviano, F., Di Thommazo, A., and Belgamo, A. (2016). Improvements in the start tool to better support the systematic review process. In Proceedings of the 20th international conference on evaluation and assessment in software engineering, pages 1–5.

Geraldo, R. J. (2016). Um auxílio à navegação acessível na web para usuários cegos. PhD thesis, São Carlos (SP): Teses de Doutorado em Ciências da Computação e Matemática Computacional da Universidade de São Paulo.

Guimarães, Í. J. B. et al. (2016). Acessibilidade em websites de comércio eletrônico: avaliação através da interação com usuários cegos.

Hadwen-Bennett, A., Sentance, S., and Morrison, C. (2018). Making programming accessible to learners with visual impairments: A literature review. International Journal of Computer Science Education in Schools, 2(2):3–13.

Hakobyan, L., Lumsden, J., O’Sullivan, D., and Bartlett, H. (2013). Mobile assistive technologies for the visually impaired. Survey of ophthalmology, 58(6):513–528.

IBGE (2010). Sinopse do censo demográfico. Rio de Janeiro.

India, G., Ramakrishna, G., Pal, J., and Swaminathan, M. (2020). Conceptual learning through accessible play: Project torino and computational thinking for blind children in india. In Proceedings of the 2020 International Conference on Information and Communication Technologies and Development, pages 1–11.

Ismaili, J. et al. (2017). Mobile learning as alternative to assistive technology devices for special needs students. Education and Information Technologies, 22(3):883–899.

ISO/IEC (2018). ISO/IEC 9241. Ergonomia da interação humano-sistema. Parte 171: Orientações sobre acessibilidade de software. ISO/IEC.

Jariwala, A., Marghitu, D., and Chapman, R. (2020). Mya+ math: Teaching math to students with vision impairment. In International Conference on Human-Computer Interaction, pages 200–211. Springer.

Khan, A. and Khusro, S. (2019a). Blind-friendly user interfaces–a pilot study on improving the accessibility of touchscreen interfaces. Multimedia Tools and Applications, 78(13):17495–17519.

Khan, A. and Khusro, S. (2019b). Blind-friendly user interfaces–a pilot study on improving the accessibility of touchscreen interfaces. Multimedia Tools and Applications, 78(13):17495–17519.

Khan, A., Khusro, S., Niazi, B., Ahmad, J., Alam, I., and Khan, I. (2020). Tetramail: a usable email client for blind people. Universal Access in the Information Society, 19(1):113–132.

Khan, M. N. H., Arovi, M. A. H., Mahmud, H., Hasan, M. K., and Rubaiyeat, H. A. (2015). Speech based text correction tool for the visually impaired. In 2015 18th International Conference on Computer and Information Technology (ICCIT), pages 150-155.

Khurana, R., McIsaac, D., Lockerman, E., and Mankoff, J. (2018). Nonvisual interaction techniques at the keyboard surface. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pages 1–12.

LDA (2022). All for play, play for all — Ludic design for accessibility. [link]. (Accessed on 09/09/2022).

Leporini, B. and Patern`o, F. (2004). Increasing usability when interacting through screen readers. Universal access in the information society, 3(1):57–70.

Leporini, B. and Paternò, F. (2008). Applying web usability criteria for vision-impaired users: does it really improve task performance? Intl. Journal of Human–Computer Interaction, 24(1):17–47.

Lieb, S., Rosenmeier, B., Thormählen, T., and Buettner, K. (2020). Haptic and auditive mesh inspection for blind 3d modelers. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility, pages 1–10.

Loitsch, C., M ̈uller, K., Seifermann, S., Henß, J., Krach, S., Jaworek, G., and Stiefelhagen, R. (2018). Uml4all syntax–a textual notation for uml diagrams. In International Conference on Computers Helping People with Special Needs, pages 598–605. Springer.

Mattheiss, E., Regal, G., Sellitsch, D., and Tscheligi, M. (2017). User-centred design with visually impaired pupils: A case study of a game editor for orientation and mobility training. International Journal of Child-Computer Interaction, 11:12–18.

Mendonça, A., Miguel, C., Neves, G., Micaelo, M., and Reino, V. (2008). Alunos cegos e com baixa visão. Orientações curriculares. DGIDC/DSEEASE.

Milne, L. R. and Ladner, R. E. (2018). Blocks4all: overcoming accessibility barriers to blocks programming for children with visual impairments. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pages 1–10.

Modanwal, G. and Sarawadekar, K. (2016). Development of a new dactylology and writing support system especially for blinds. In 2016 13th Conference on Computer and Robot Vision (CRV), pages 362–369. IEEE.

Modanwal, G. and Sarawadekar, K. (2017). A new dactylology and interactive system development for blind–computer interaction. IEEE Transactions on Human-Machine Systems, 48(2):207–212.

Moher, D., Stewart, L., and Shekelle, P. (2015). All in the family: systematic reviews, rapid reviews, scoping reviews, realist reviews, and more. Systematic reviews, 4(1):1– 2.

Muniandy, M. and Sulaiman, S. (2017). Touch sensation as part of multimedia design elements to improve computer accessibility for the blind users. In 2017 InternationaConference on Research and Innovation in Information Systems (ICRIIS), pages 1–6. IEEE.

Nakagawa, E. Y., Scannavino, K. R. F., Fabbri, S. C. P. F., and Ferrari, F. C. (2017). Revisão sistemática da literatura em engenharia de software: teoria e prática.

Nielsen, J. (1994). Usability engineering. Morgan Kaufmann.

Oliveira, J. D., de Borba Campos, M., and Paixão-Cortes, V. S. M. (2020). Usable and accessible robot programming system for people who are visually impaired. In International Conference on Human-Computer Interaction, pages 445–464. Springer.

Paciello, M. (2000). Web accessibility for people with disabilities. Crc Press.

Pascolini, D. and Mariotti, S. P. (2012). Global estimates of visual impairment: 2010. British Journal of Ophthalmology, 96(5):614–618.

Pires, A. C., Rocha, F., de Barros Neto, A. J., Simão, H., Nicolau, H., and Guerreiro, T. (2020). Exploring accessible programming with educators and visually impaired children. In Proceedings of the Interaction Design and Children Conference, pages 148–160.

Potluri, V., Vaithilingam, P., Iyengar, S., Vidya, Y., Swaminathan, M., and Srinivasa, G. (2018). Codetalk: Improving programming environment accessibility for visually impaired developers. In Proceedings of the 2018 chi conference on human factors in computing systems, pages 1–11.

Rong, Z., Chan, N. F., Chen, T., and Zhu, K. (2020). Coderhythm: A tangible programming toolkit for visually impaired students. In The eighth International Workshop of Chinese CHI, pages 57–60.

Sagale, U., Bhutkar, G., Karad, M., and Jathar, N. (2018). An eye-free android application for visually impaired users. In Ergonomics in Caring for People, pages 291–297. Springer.

Sánchez, J. and Aguayo, F. (2006). Apl: Audio programming language for blind learners. In International Conference on Computers for Handicapped Persons, pages 1334–1341. Springer.

Siedler, M., Zen, E., Cardoso, R., and Tavares, T. (2022). Assistive technology as an aid to individuals with autism spectrum disorder: A systematic literature mapping. In Proceedings of the Brazilian Symposium on Multimedia and the Web, pages 244–252.

Siu, A. F., Kim, S., Miele, J. A., and Follmer, S. (2019). shapecad: An accessible 3d modelling workflow for the blind and visually-impaired via 2.5 d shape displays. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility, pages 342–354.

TheorizeIt.org (2022). Is theory. [link]. (Accessed on 02/27/2023).

Thieme, A., Morrison, C., Villar, N., Grayson, M., and Lindley, S. (2017). Enabling collaboration in learning computer programing inclusive of children with vision impairments. In Proceedings of the 2017 Conference on Designing Interactive Systems, pages 739–752.

Torres, J. P., COSTA, C. S. L. d., and LOURENÇO, G. F. (2016). Substituição sensorial visuo-tatil e visuo-auditiva em pessoas com deficiência visual: uma revisão sistemática. Revista Brasileira de Educação Especial, 22:605–618

Utreras, E. and Pontelli, E. (2020). Design of a tangible programming tool for students with visual impairments and low vision. In International Conference on Human-Computer Interaction, pages 304–314. Springer.

Vanukuru, R. (2020). Accessible spatial audio interfaces: A pilot study into screen readers with concurrent speech. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, pages 1–6.

Velázquez, R., Sánchez, C. N., and Pissaloux, E. E. (2016). Visual impairment simulator based on the hadamard product. Electronic Notes in Theoretical Computer Science, 329:169–179.

W3C (1998). Web accessibility initiative (wai). [link]. (Accessed on 05/30/2022).

WAI/W3C (2009). Accessible rich internet applications (wai-aria). [link]. (Accessed on 05/26/2022).

WAI/W3C (2018). Diretrizes de acessibilidade para conteúdo web (wcag) 2.1 - português. [link]. (Accessed on 05/26/2022).

Zen, E., Siedler, M. d. S., da Costa, V. K., and Tavares, T. A. (2022). Assistive technology to assist the visually impaired in the use of icts: A systematic literature review. In XVIII Brazilian Symposium on Information Systems, pages 1–8.

Zubrow, D. (2004). Software quality requirements and evaluation, the iso 25000 series. Software Engineering Institute, Carnegie Mellon.

Published

2023-05-27

How to Cite

Zen, E., da Silveira Siedler, M., Kruger da Costa, V., & Aires Tavares, T. (2023). Assistive Technology to help the interaction between visually impaired and computer systems: A Systematic Literature Mapping. ISys - Brazilian Journal of Information Systems, 16(1), 6:1–6:27. https://doi.org/10.5753/isys.2023.2890

Issue

Section

Extended versions of selected articles