TV 3.0: Integração e Controle de Renderizadores de Efeitos Sensoriais

• Marina Ivanov UFF
• Rômulo Vieira UFF
• Joel A. F. dos Santos CEFET/RJ
• Débora C. Muchaluat-Saade UFF

DOI: https://doi.org/10.5753/webmedia_estendido.2024.244585

Resumo

Advancements in the Brazilian television sector have been consistently intertwined with the technological innovations of each era. From its inception, supporting only live broadcasts, through the integration of recorded content on magnetic tapes, to the adoption of a color standard, television broadcasts have always been driven by the pursuit of higher quality. Currently, the Brazilian Digital Terrestrial Television System Forum (SBTVD) is working on a new national standard, referred to as TV 3.0, which, among various guidelines, aims to incorporate multiple secondary devices, such as sensory effect actuators, to enhance immersion and provide viewers with a richer content experience. In this context, the present paper proposes architectural changes to the TV receiver, a communication protocol, and an Application Programming Interface (API) to control various functions in sensory effect display devices, such as activation, deactivation, and adjustments in renderings. Additionally, a use case is presented to validate these concepts and demonstrate how they may find full applicability in the next generation of digital terrestrial television in Brazil.

Palavras-chave: Efeitos sensoriais, Midleware Ginga, NCL, HTML5, TV Imersiva

Referências

Fábio Barreto, Raphael Abreu, Marina Josué, Eyre Montevecchi, Pedro Valentim, and Débora Muchaluat-Saade. 2023. Providing multimodal and multi-user interactions for digital tv applications. Multimedia Tools and Applications 82 (2023) , 4821–4846. DOI: 10.1007/s11042-021-11847-3

Gheorghita Ghinea, Christian Timmerer, Weisi Lin, and Stephen R Gulliver. 2014. Mulsemedia: State of the art, perspectives, and challenges. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 11, 1s (2014) , 1–23.

Y. Y. Goland, T. Cai, P. Leach, and Y. Gu. 1999. Simple service discovery protocol/1.0 operating without on arbiter. IETF INTERNET-DRAFT draft-cai-ssdp-v1-03. txt (1999). [link]

Álan Lívio Vasconcelos Guedes, Roberto Gerson de Albuquerque Azevedo, and Simone Diniz Junqueira Barbosa. 2017. Extending multimedia languages to support multimodal user interactions. Multimedia tools and applications 76 (2017), 5691–5720.

Lana Jalal, Matteo Anedda, Vlad Popescu, and Maurizio Murroni. 2018. Internet of Things for enabling multi sensorial TV in smart home. In 2018 IEEE Broadcast Symposium (BTS). IEEE, 1 – 5.

Lana Jalal, Matteo Anedda, Vlad Popescu, and Maurizio Murroni. 2018. Qoe assessment for broadcasting multi sensorial media in smart home scenario. In 2018 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting ( BMSB ) . IEEE, 1–5.

Lana Jalal, Matteo Anedda, Vlad Popescu, and Maurizio Murroni. 2018. QoE assessment for IoT-based multi sensorial media broadcasting. IEEE Transactions on Broadcasting 64, 2 (2018), 552–560.

Marina Josué, Raphael Abreu, Fábio Barreto, Douglas Mattos, Glauco Amorim, Joel dos Santos, and Débora Muchaluat-Saade. 2018. Modeling sensory effects as first-class entities in multimedia applications. In Proceedings of the 9th ACM Multimedia Systems Conference. 225–236.

Marina Josué, Marcelo F. Moreno, and Débora Muchaluat-Saade. 2024. Automatic Preparation of Sensory Effects. In Proceedings of MMSys ’24: ACM Multimedia Systems Conference 2024 (Bari). 35–40.

ABNT NBR. 2023. ABNT NBR 15606-1, Codificação de dados e especificações de transmissão para radiodifusão digital, Parte 1: Codificação de dados. ABNT (2023).

ABNT NBR. 2023. ABNT NBR 15606-2. Televisão digital terrestre–Codificação de dados e especificações de transmissão para radiodifusão digital–Parte 2: GingaNCL para receptores fixos e móveis–Linguagem de aplicação XML para codificação de aplicações. ABNT (2023).

Benjamin Rainer, Markus Waltl, Eva Cheng, Muawiyath Shujau, Christian Timmerer, Stephen Davis, Ian Burnett, Christian Ritz, and Hermann Hellwagner. 2012. Investigating the impact of sensory effects on the quality of experience and emotional response in web videos. In 2012 Fourth International Workshop on Quality of multimedia experience. IEEE, 278–283.

ITU-T Recommendation. 2014. Nested Context Language (NCL) and Ginga-NCL. (2014). [link]

Renato O Rodrigues, Marina IP Josué, Raphael S Abreu, Glauco F Amorim, Débora C Muchaluat-Saade, and Joel AF dos Santos. 2019. A proposal for supporting sensory effect rendering in ginga-ncl. In Proceedings of the 25th Brazillian Symposium on Multimedia and the Web. 273–280.

Estêvão Bissoli Saleme, Celso AS Santos, and Gheorghita Ghinea. 2019. A mulsemedia framework for delivering sensory effects to heterogeneous systems. Multimedia Systems 25 (2019), 421–447.

Joel Santos, Rômulo Vieira, , Marina Josué, Karen Oliveira, and Débora C. Muchaluat-Saade. 2024. Multidevice Support in the Next Generation of the Brazilian Terrestrial TV System. In Proceedings of the 2024 ACM International Conference on Interactive Media Experiences (Stockholm, Sweden) ( IMX’24). Association for Computing Machinery, New York, NY, USA, 1–9. DOI: 10.1145/3639701.3656304

Luiz Fernando Gomes Soares, Marcio Ferreira Moreno, Carlos de Salles Soares Neto, and Marcelo Ferreira Moreno. 2010. Ginga-NCL: Declarative middleware for multimedia IPTV services. IEEE Communications Magazine 48, 6 (2010) , 74–81.

Markus Waltl, Benjamin Rainer, Christian Timmerer, and Hermann Hellwagner. 2011. Sensory Experience for Videos on the Web. In 2011 Workshop on Multimedia on the Web. 49–51. DOI: 10.1109/MMWeb.2011.12

Markus Waltl, Christian Timmerer, and Hermann Hellwagner. 2010. Increasing the user experience of multimedia presentations with sensory effects. In 11 th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS 10. IEEE, 1 – 4.