Head-Mounted Displays e IA para Acessibilidade: Ferramentas de Inclusão Sensorial
Resumo
Este artigo explora o uso de Head-Mounted Displays, com e sem integração de inteligência artificial, para melhorar a acessibilidade de pessoas com deficiências sensoriais. São analisadas três aplicações principais: ampliação da percepção cromática para daltônicos, audiodescrição para deficientes visuais e tradução em tempo real para deficientes auditivos. A discussão inclui os desafios e oportunidades na implementação dessas soluções, destacando o potencial de tecnologias open-source e a colaboração entre desenvolvedores e a comunidade científica.
Palavras-chave:
Dispositivos Montados na Cabeça, Tecnologia Assistiva, Acessibilidade Sensorial, Soluções Assistivas de Código Aberto, Tecnologia Vestível para Acessibilidade
Referências
B. Sae-jia, R. L. Paderon, and T. Srimuninnimit, “A head-mountedassistive device for visually impaired people with warning system fromobject detection and depth estimation,” in Journal of Physics: ConferenceSeries, vol. 2550, no. 1. IOP Publishing, 2023, p. 012034.
C. Mauricio, G. Domingues, I. Padua, F. Peres, and J. Teixeira, “Whatif hmds could generate audio descriptions of real scenes for visuallyimpaired people?” in Proceedings of the 26th Symposium on Virtual andAugmented Reality, 2024, pp. 203–212.
J. P. Rolland and H. Hua, “Head-mounted display systems,” Encyclopediaof optical engineering, vol. 2, pp. 1–14, 2005.
P. Xu, A. Song, and K. Wang, “Intelligent head-mounted obstacleavoidance wearable for the blind and visually impaired,” Sensors, vol. 23,no. 23, p. 9598, 2023.
J. Carmigniani, B. Furht, M. Anisetti, P. Ceravolo, E. Damiani, andM. Ivkovic, “Augmented reality technologies, systems and applications,”Multimedia tools and applications, vol. 51, pp. 341–377, 2011.
D. A. Gusev, D. M. Whittinghill, and J. Yong, “A simulator to study theeffects of color and color blindness on motion sickness in virtual realityusing head-mounted displays,” in Mobile and Wireless Technologies 2016,K. J. Kim, N. Wattanapongsakorn, and N. Joukov, Eds. Singapore:Springer Singapore, 2016, pp. 197–204.
D. Jain, R. Franz, L. Findlater, J. Cannon, R. Kushalnagar, andJ. Froehlich, “Towards accessible conversations in a mobile contextfor people who are deaf and hard of hearing,” in Proceedings of the20th International ACM SIGACCESS Conference on Computers andAccessibility, 2018, pp. 81–92.
S. Feuerriegel, J. Hartmann, C. Janiesch, and P. Zschech, “Generative ai,”Business & Information Systems Engineering, vol. 66, no. 1, pp. 111–126,2024.
T. Liu, P. Fazli, and H. Jeong, “Artificial intelligence in virtual realityfor blind and low vision individuals: Literature review,” in Proceedingsof the Human Factors and Ergonomics Society Annual Meeting. SAGEPublications Sage CA: Los Angeles, CA, 2024, p. 10711813241266832
M. R. Morris, “Ai and accessibility,” Communications of the ACM,vol. 63, no. 6, pp. 35–37, 2020.
D. G. Melo, J. E. V. Galon, and B. J. B. Fontanella, “Os ”daltonicos” ˆe suas dificuldades: condic¸ao negligenciada no brasil?” ˜ Physis: Revistade Saude Coletiva ´ , vol. 24, no. 4, p. 1229–1253, Oct 2014. [Online].Available: DOI: 10.1590/S0103-73312014000400011
E. Tanuwidjaja, D. Huynh, K. Koa, C. Nguyen, C. Shao, P. Torbett,C. Emmenegger, and N. Weibel, “Chroma: a wearable augmentedreality solution for color blindness,” in Proceedings of the 2014ACM International Joint Conference on Pervasive and UbiquitousComputing, ser. UbiComp ’14. New York, NY, USA: Associationfor Computing Machinery, 2014, p. 799–810. [Online]. Available: DOI: 10.1145/2632048.2632091
Z. Wang, H. Liu, Y. Pan, and C. Mousas, “Color blindness bartender:An embodied vr game experience,” in 2020 IEEE Conference on VirtualReality and 3D User Interfaces Abstracts and Workshops (VRW), 2020,pp. 519–520.
F. Amore, V. Silvestri, M. Guidobaldi, M. Sulfaro, P. Piscopo, S. Turco,F. De Rossi, E. Rellini, S. Fortini, S. Rizzo et al., “Efficacy and patients’satisfaction with the orcam myeye device among visually impairedpeople: a multicenter study,” Journal of Medical Systems, vol. 47, no. 1,p. 11, 2023.
E. Waisberg, J. Ong, M. Masalkhi, N. Zaman, P. Sarker, A. G. Lee,and A. Tavakkoli, “Meta smart glasses—large language models and thefuture for assistive glasses for individuals with vision impairments,” Eye,vol. 38, no. 6, pp. 1036–1038, 2024.
M. Goyal and G. Basavarajappa, “A wearable iot based assistive deviceto aid communication with hearing impaired,” in 2023 IEEE Microwaves,Antennas, and Propagation Conference (MAPCON), 2023, pp. 1–4.
E. C. de Menezes and M. V. Lamar, “Haptic system as an accessibilitymechanic for hard of hearing and deaf people on video games,” inAnais Estendidos do XXII Simposio Brasileiro de Jogos e Entretenimento ´Digital. SBC, 2023, pp. 276–281.
S. Ozarkar, R. Chetwani, S. Devare, S. Haryani, and N. Giri, “Aifor accessibility: Virtual assistant for hearing impaired,” in 2020 11thInternational Conference on Computing, Communication and NetworkingTechnologies (ICCCNT). IEEE, 2020, pp. 1–7
T. Fathima, A. Alam, A. Gangwar, D. K. Khetan, and K. Ramya,“Real-time sign language recognition and translation using deep learningtechniques,” International Research Journal on Advanced EngineeringHub (IRJAEH), vol. 2, no. 02, pp. 93–97, 2024.
H. K. Mistry, C. Mavani, A. Goswami, and R. Patel, “The impact of cloudcomputing and ai on industry dynamics and competition,” EducationalAdministration: Theory and Practice, vol. 30, no. 7, pp. 797–804, 2024.
C. Mauricio, G. Domingues, I. Padua, F. Peres, and J. Teixeira, “Whatif hmds could generate audio descriptions of real scenes for visuallyimpaired people?” in Proceedings of the 26th Symposium on Virtual andAugmented Reality, 2024, pp. 203–212.
J. P. Rolland and H. Hua, “Head-mounted display systems,” Encyclopediaof optical engineering, vol. 2, pp. 1–14, 2005.
P. Xu, A. Song, and K. Wang, “Intelligent head-mounted obstacleavoidance wearable for the blind and visually impaired,” Sensors, vol. 23,no. 23, p. 9598, 2023.
J. Carmigniani, B. Furht, M. Anisetti, P. Ceravolo, E. Damiani, andM. Ivkovic, “Augmented reality technologies, systems and applications,”Multimedia tools and applications, vol. 51, pp. 341–377, 2011.
D. A. Gusev, D. M. Whittinghill, and J. Yong, “A simulator to study theeffects of color and color blindness on motion sickness in virtual realityusing head-mounted displays,” in Mobile and Wireless Technologies 2016,K. J. Kim, N. Wattanapongsakorn, and N. Joukov, Eds. Singapore:Springer Singapore, 2016, pp. 197–204.
D. Jain, R. Franz, L. Findlater, J. Cannon, R. Kushalnagar, andJ. Froehlich, “Towards accessible conversations in a mobile contextfor people who are deaf and hard of hearing,” in Proceedings of the20th International ACM SIGACCESS Conference on Computers andAccessibility, 2018, pp. 81–92.
S. Feuerriegel, J. Hartmann, C. Janiesch, and P. Zschech, “Generative ai,”Business & Information Systems Engineering, vol. 66, no. 1, pp. 111–126,2024.
T. Liu, P. Fazli, and H. Jeong, “Artificial intelligence in virtual realityfor blind and low vision individuals: Literature review,” in Proceedingsof the Human Factors and Ergonomics Society Annual Meeting. SAGEPublications Sage CA: Los Angeles, CA, 2024, p. 10711813241266832
M. R. Morris, “Ai and accessibility,” Communications of the ACM,vol. 63, no. 6, pp. 35–37, 2020.
D. G. Melo, J. E. V. Galon, and B. J. B. Fontanella, “Os ”daltonicos” ˆe suas dificuldades: condic¸ao negligenciada no brasil?” ˜ Physis: Revistade Saude Coletiva ´ , vol. 24, no. 4, p. 1229–1253, Oct 2014. [Online].Available: DOI: 10.1590/S0103-73312014000400011
E. Tanuwidjaja, D. Huynh, K. Koa, C. Nguyen, C. Shao, P. Torbett,C. Emmenegger, and N. Weibel, “Chroma: a wearable augmentedreality solution for color blindness,” in Proceedings of the 2014ACM International Joint Conference on Pervasive and UbiquitousComputing, ser. UbiComp ’14. New York, NY, USA: Associationfor Computing Machinery, 2014, p. 799–810. [Online]. Available: DOI: 10.1145/2632048.2632091
Z. Wang, H. Liu, Y. Pan, and C. Mousas, “Color blindness bartender:An embodied vr game experience,” in 2020 IEEE Conference on VirtualReality and 3D User Interfaces Abstracts and Workshops (VRW), 2020,pp. 519–520.
F. Amore, V. Silvestri, M. Guidobaldi, M. Sulfaro, P. Piscopo, S. Turco,F. De Rossi, E. Rellini, S. Fortini, S. Rizzo et al., “Efficacy and patients’satisfaction with the orcam myeye device among visually impairedpeople: a multicenter study,” Journal of Medical Systems, vol. 47, no. 1,p. 11, 2023.
E. Waisberg, J. Ong, M. Masalkhi, N. Zaman, P. Sarker, A. G. Lee,and A. Tavakkoli, “Meta smart glasses—large language models and thefuture for assistive glasses for individuals with vision impairments,” Eye,vol. 38, no. 6, pp. 1036–1038, 2024.
M. Goyal and G. Basavarajappa, “A wearable iot based assistive deviceto aid communication with hearing impaired,” in 2023 IEEE Microwaves,Antennas, and Propagation Conference (MAPCON), 2023, pp. 1–4.
E. C. de Menezes and M. V. Lamar, “Haptic system as an accessibilitymechanic for hard of hearing and deaf people on video games,” inAnais Estendidos do XXII Simposio Brasileiro de Jogos e Entretenimento ´Digital. SBC, 2023, pp. 276–281.
S. Ozarkar, R. Chetwani, S. Devare, S. Haryani, and N. Giri, “Aifor accessibility: Virtual assistant for hearing impaired,” in 2020 11thInternational Conference on Computing, Communication and NetworkingTechnologies (ICCCNT). IEEE, 2020, pp. 1–7
T. Fathima, A. Alam, A. Gangwar, D. K. Khetan, and K. Ramya,“Real-time sign language recognition and translation using deep learningtechniques,” International Research Journal on Advanced EngineeringHub (IRJAEH), vol. 2, no. 02, pp. 93–97, 2024.
H. K. Mistry, C. Mavani, A. Goswami, and R. Patel, “The impact of cloudcomputing and ai on industry dynamics and competition,” EducationalAdministration: Theory and Practice, vol. 30, no. 7, pp. 797–804, 2024.
Publicado
27/11/2024
Como Citar
YOSHIDA, Leina; DOMINGUES, Gustavo Camargo; PERES, Fabiana Frata Furlan; MAURICIO, Claudio Roberto Marquetto.
Head-Mounted Displays e IA para Acessibilidade: Ferramentas de Inclusão Sensorial. In: CONGRESSO LATINO-AMERICANO DE SOFTWARE LIVRE E TECNOLOGIAS ABERTAS (LATINOWARE), 21. , 2024, Foz do Iguaçu/PR.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2024
.
p. 145-151.
DOI: https://doi.org/10.5753/latinoware.2024.245766.
