AMUSEVR: A Virtual Reality Authoring Environment for Immersive Mulsemedia Applications
Abstract
To meet the demand for mulsemedia (multiple sensorial media) content production, numerous tools exist, among which many present the currently typical approach providing 2D content organized in timelines. However, when it comes to 360° content where 3D spatial positioning is necessary, neither consensus on authoring methodology nor widely-adopted approaches to design exist. In order to fulfll this gap, we propose AMUSEVR, a virtual-reality environment for mulsemedia application development. In addition to supporting various media and sensory effect types, AMUSEVR allows authors to create and visualize content dynamically using VR technology. We evaluated AMUSEVR with an authoring experiment with users, using UEQ questionnaires, and obtained promising results.
Keywords:
360° authoring, VR environment, mulsemedia, event-based relations
References
H Coelho, M Melo, L Barbosa, J Martins, M S Teixeira, and M Bessa. 2019. Authoring tools for creating 360 multisensory videos-Evaluation of different interfaces. Expert Systems (2019). https://doi.org/10.1111/exsy.12418
D P de Mattos, D C Muchaluat-Saade, and G Ghinea. 2020. An Approach for Authoring Mulsemedia Documents Based on Events. In 2020 International Conference on Computing, Networking and Communications (ICNC). IEEE, 273–277.
Hannes Fassold and Barnabas Takacs. 2019. Towards Automatic Cinematography and Annotation for 360° Video. In Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video. 157–166.
Robin Horst, Savina Diez, and Ralf Dörner. 2019. Highlighting Techniques for 360° Video Virtual Reality and Their Immersive Authoring. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artifcial Intelligence and Lecture Notes in Bioinformatics), Vol. 11844 LNCS. Springer, 515–526. https://doi.org/10.1007/978-3-030-33720-9_40
Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and Evaluation of a User Experience Questionnaire. HCI and Usability for Education and Work, 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society 5298 (2008), 63–76. https://doi.org/10.1007/978-3-540-89350-9_6
Paulo R C Mendes, Álan L V Guedes, Daniel De S Moraes, Roberto G A Azevedo, and Sérgio Colcher. 2020. An Authoring Model for Interactive 360 Videos. 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) (2020).
Mel Slater and Maria V. Sanchez-Vives. 2016. Enhancing our lives with immersive virtual reality. Frontiers Robotics AI 3, DEC (dec 2016), 74. https://doi.org/10.3389/frobt.2016.00074
D P de Mattos, D C Muchaluat-Saade, and G Ghinea. 2020. An Approach for Authoring Mulsemedia Documents Based on Events. In 2020 International Conference on Computing, Networking and Communications (ICNC). IEEE, 273–277.
Hannes Fassold and Barnabas Takacs. 2019. Towards Automatic Cinematography and Annotation for 360° Video. In Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video. 157–166.
Robin Horst, Savina Diez, and Ralf Dörner. 2019. Highlighting Techniques for 360° Video Virtual Reality and Their Immersive Authoring. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artifcial Intelligence and Lecture Notes in Bioinformatics), Vol. 11844 LNCS. Springer, 515–526. https://doi.org/10.1007/978-3-030-33720-9_40
Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and Evaluation of a User Experience Questionnaire. HCI and Usability for Education and Work, 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society 5298 (2008), 63–76. https://doi.org/10.1007/978-3-540-89350-9_6
Paulo R C Mendes, Álan L V Guedes, Daniel De S Moraes, Roberto G A Azevedo, and Sérgio Colcher. 2020. An Authoring Model for Interactive 360 Videos. 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) (2020).
Mel Slater and Maria V. Sanchez-Vives. 2016. Enhancing our lives with immersive virtual reality. Frontiers Robotics AI 3, DEC (dec 2016), 74. https://doi.org/10.3389/frobt.2016.00074
Published
2021-06-21
How to Cite
DE FARIAS, Flavio Miranda; DE MATTOS, Douglas Paulo; MUCHALUAT-SAADE, Débora C..
AMUSEVR: A Virtual Reality Authoring Environment for Immersive Mulsemedia Applications . In: WORKSHOP ON MULTISENSORY EXPERIENCES (SENSORYX), 1. , 2021, New York.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2021
.
DOI: https://doi.org/10.5753/sensoryx.2021.15687.
