ListeningTV: Accessible Video using Interactive Audio Descriptions

  • Alex de Souza Vieira UNIFESSPA
  • Álan Lívio V. Guedes PUC-Rio
  • Daniel de Sousa Moraes PUC-Rio
  • Lucas Ribeiro Madeira UFMA
  • Sérgio Colcher PUC-Rio
  • Carlos de S. Soares Neto UFMA


People with visual impairments suffer from the incapacity to understand contextual information in videos, such as the place where characters are, or any other non-spoken actions in general. Some content creators address this issue by providing a secondary audio to describe such information, called Audio Descriptions (ADs). How- ever, some works in the literature have highlighted that people with visual impairment are usually not able to completely understand scene changes based only on characters’ voices or traditional ADs. Moreover, traditional ADs do not completely describe some of the important visual information, such as the background scenery (e.g. colors, furniture) and characters’ details (e.g. blond woman using a red dress). In this work, we propose incrementing the traditional AD techniques with the usage of interactive video features present in TV systems. More precisely, the proposed interactivity enables users to access specialized AD for different visual information (e.g., scene, scenario, character). To support the development of such interactive content, we present an application template, which helps to create the final interactive-enhanced video application. Asa proof of concept for our approach, we created an interactive AD for an independent video mainly composed of visual information, with only a few talks.


V. P. Campos, L. M. G. Goncalves, and T. M. U. de Araujo. 2017. Applying audiodescription for context understanding of surveillance videos by people with visual impairments. In 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS). 1–5.

Cosette Castro. 2014. Televisão digital e as possibilidades de acessibilidade audiovisual no Brasil. 0, 5 (2014). Number:5.

Thacyla de Sousa Lima, Roberto Gerson de Albuquerque Azevedo, and Carlos de Salles Soares Neto. 2019. Increasing Reuse in Learning Objects Authoring: A Case Study with the Cacuriá Tool. In Proceedings of the 25th Brazilian Symposium on Multimedia and the Web (Rio de Janeiro, Brazil) (WebMedia ’19). Association for Computing Machinery, New York, NY, USA, 193–200.

Leonardo A. Domingues, Virgínia P. Campos, Tiago M.U. Araújo, and Guido L. de S. Filho. 2016. Accessibility in Digital Cinema: A Proposal for Generation and Distribution of Audio Description. In Proceedings of the 22nd Brazilian Symposium on Multimedia and the Web (Teresina, Piauí State, Brazil) (Webmedia ’16). Association for Computing Machinery, New York, NY, USA, 119–126.

Marília Matos Gonçalves, Giorgio Gilwan Silva, and Robson Freire. 2015. Acessibilidade da TV digital interativa para deficientes visuais. Human Factors in Design4, 8 (2015), 152–173.

ITU. 2014. Recommendation H.761: Nested Context Language (NCL) and Ginga-NCL for IPTV Services. ITU.

Rita Oliveira, Jorge Ferraz De Abreu, and Ana Margarida Almeida. 2016. Audio Description in Interactive Television (iTV): proposal of a collaborative and voluntary approach. Procedia Computer Science 100 (2016), 935–940.

Alex de Souza Vieira and Derek Oliveira Correia. 2016. Um Olhar Sobre Produção e Consumo de Conteúdos Audiovisuais Tradicionais Com Foco Nas Pessoas Com Deficiência Visual. In 7º Congresso Brasileiro De Educação Especial. UFScar.
Como Citar

Selecione um Formato
VIEIRA, Alex de Souza; GUEDES, Álan Lívio V. ; MORAES, Daniel de Sousa ; MADEIRA, Lucas Ribeiro ; COLCHER, Sérgio ; SOARES NETO, Carlos de S.. ListeningTV: Accessible Video using Interactive Audio Descriptions. In: WORKSHOP DE FERRAMENTAS E APLICAÇÕES - SIMPÓSIO BRASILEIRO DE SISTEMAS MULTIMÍDIA E WEB (WEBMEDIA), 26. , 2020, São Luís. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2020 . p. 71-74. ISSN 2596-1683. DOI: