A Proposal for Supporting Sensory Effect Rendering in Ginga-NCL

• Renato O. Rodrigues CEFET/RJ
• Marina I. P. Josué UFF
• Raphael S. Abreu UFF
• Glauco F. Amorim CEFET/RJ
• Débora C. Muchaluat-Saade UFF
• Joel A. F. dos Santos CEFET/RJ

Abstract

Mulsemedia applications incorporate sensory effects in interactive applications to increase user immersion and deliver a rich and multisensorial experience. The MPEG-V standard defines an architecture and an information representation for mulsemedia applications. It specifies the interoperability between the virtual world - representing the application itself - and the real world - representing the environment where the application is executed and sensorial stimuli are presented to the user. However, it is important to notice that the standard does not define how to specify the application behavior itself. The author is responsible for specifying how to perform the presentation of audiovisual content, its synchronization, and the capture of user interaction. In order to fill in this gap, this work proposes an extension to middleware Ginga-NCL as a way to provide a declarative approach for the creation of interactive mulsemedia applications. It enables the author to create mulsemedia applications in NCL, defining sensory effects as media objects. Therefore, one is able to reuse all the language support for content synchronization, user interaction, context adaptation, etc.

Keywords: Multisensory Content, Mulsemedia, NCL, Ginga-NCL