ListeningTV: Accessible Video using Interactive Audio Descriptions
People with visual impairments suffer from the incapacity to understand contextual information in videos, such as the place where characters are, or any other non-spoken actions in general. Some content creators address this issue by providing a secondary audio to describe such information, called Audio Descriptions (ADs). How- ever, some works in the literature have highlighted that people with visual impairment are usually not able to completely understand scene changes based only on characters’ voices or traditional ADs. Moreover, traditional ADs do not completely describe some of the important visual information, such as the background scenery (e.g. colors, furniture) and characters’ details (e.g. blond woman using a red dress). In this work, we propose incrementing the traditional AD techniques with the usage of interactive video features present in TV systems. More precisely, the proposed interactivity enables users to access specialized AD for different visual information (e.g., scene, scenario, character). To support the development of such interactive content, we present an application template, which helps to create the final interactive-enhanced video application. Asa proof of concept for our approach, we created an interactive AD for an independent video mainly composed of visual information, with only a few talks.
Cosette Castro. 2014. Televisão digital e as possibilidades de acessibilidade audiovisual no Brasil. 0, 5 (2014). https://doi.org/10.19174/esf.v0i5.5692 Number:5.
Thacyla de Sousa Lima, Roberto Gerson de Albuquerque Azevedo, and Carlos de Salles Soares Neto. 2019. Increasing Reuse in Learning Objects Authoring: A Case Study with the Cacuriá Tool. In Proceedings of the 25th Brazilian Symposium on Multimedia and the Web (Rio de Janeiro, Brazil) (WebMedia ’19). Association for Computing Machinery, New York, NY, USA, 193–200. https://doi.org/10.1145/3323503.3349555
Leonardo A. Domingues, Virgínia P. Campos, Tiago M.U. Araújo, and Guido L. de S. Filho. 2016. Accessibility in Digital Cinema: A Proposal for Generation and Distribution of Audio Description. In Proceedings of the 22nd Brazilian Symposium on Multimedia and the Web (Teresina, Piauí State, Brazil) (Webmedia ’16). Association for Computing Machinery, New York, NY, USA, 119–126.https://doi.org/10.1145/2976796.2976867
Marília Matos Gonçalves, Giorgio Gilwan Silva, and Robson Freire. 2015. Acessibilidade da TV digital interativa para deficientes visuais. Human Factors in Design4, 8 (2015), 152–173.
ITU. 2014. Recommendation H.761: Nested Context Language (NCL) and Ginga-NCL for IPTV Services. ITU. https://www.itu.int/rec/T-REC-H.761
Rita Oliveira, Jorge Ferraz De Abreu, and Ana Margarida Almeida. 2016. Audio Description in Interactive Television (iTV): proposal of a collaborative and voluntary approach. Procedia Computer Science 100 (2016), 935–940.
Alex de Souza Vieira and Derek Oliveira Correia. 2016. Um Olhar Sobre Produção e Consumo de Conteúdos Audiovisuais Tradicionais Com Foco Nas Pessoas Com Deficiência Visual. In 7º Congresso Brasileiro De Educação Especial. UFScar.