A Conceptual Architecture and a Framework for Dealing with Variability in Mulsemedia Systems
Resumo
The thesis is within the emerging topic of mulsemedia systems, which encompass audiovisual content associated with multisensory effects, users' quality of experience, and human-computer interaction. It presents a conceptual architecture and a framework that take into account the challenges and requirements for mulsemedia delivery systems identified from the gaps and shortcomings in related work. Furthermore, the work's outcome brings multiple and valuable contributions relying on a complex and solid experimental setup, which have been shared and published in relevant journals and conferences.
Palavras-chave:
Mulsemedia systems, Multimedia applications, Variability, Conceptual architecture, Software integration, Frameworks
Referências
Comsa, I.-S., Saleme, E. B., Covaci, A., Mesfin, G., Trestian, R., Santos, C. A. S., and Ghinea, G. (2020). Do I Smell Coffee? The Tale of a 360◦ Mulsemedia Experience. IEEE MultiMedia, 27(1):27-36.
Covaci, A., Saleme, E. B., Mesfin, G., Comsa, I.-S., Trestian, R., Santos, C. A. S., and Ghinea, G. (2020a). Multisensory 360◦ Videos Mediate Presence. IEEE Transactions on Visualization and Computer Graphics, pages 1-9. Submitted.
Covaci, A., Saleme, E. B., Mesfin, G. A., Hussain, N., Kani-Zabihi, E., and Ghinea, G. (2020b). How do we experience crossmodal correspondent mulsemedia content? IEEE Transactions on Multimedia, 22(5):1249-1258.
Covaci, A., Trestian, R., Saleme, E. B., Comsa, I.-S., Mesfin, G., Santos, C. A. S., and Ghinea, G. (2019). 360◦ Mulsemedia: A Way to Improve Subjective QoE in 360◦ Videos. In Proc. of the 27th ACM Int. Conf. on Multimedia, pages 2378-2386. ACM.
de Amorim, M. N., Saleme, E. B., de Assis Neto, F. R., Santos, C. A. S., and Ghinea, G. (2019). Crowdsourcing authoring of sensory effects on videos. Multimedia Tools and Applications, 78(14):19201-19227.
Jalal, L., Anedda, M., Popescu, V., and Murroni, M. (2018a). Qoe assessment for broadcasting multi sensorial media in smart home scenario. In 2018 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), pages 1-5.
Jalal, L., Anedda, M., Popescu, V., and Murroni, M. (2018b). QoE Assessment for IoT-Based Multi Sensorial Media Broadcasting. IEEE Trans. Broadcast., 64(2):552-560.
Jalal, L. and Murroni, M. (2019). The impact of multi-sensorial media in smart home scenario on user experience and emotions. In 2019 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), pages 1-6.
Mesfin, G., Saleme, E. B., Ademoye, O., Kani-Zabihi, E., Santos, C. A. S., and Ghinea, G. (2020a). Less is (Just as Good as) More-an Investigation of Olfactory Intensity and Hedonic Valence in Mulsemedia QoE using Heart Rate and Eye Tracking. IEEE Transactions on Multimedia.
Mesfin, G. A., Hussain, N., Kani-Zabihi, E., Covaci, A., Saleme, E. B., and Ghinea, G. (2020b). QoE of Cross-modally Mapped Mulsemedia: an Assessment Using Eye Gaze and Heart Rate. Multimedia Tools and Applications.
Saleme, E. B., Celestrini, J. R., and Santos, C. A. S. (2017). Time Evaluation for the Integration of a Gestural Interactive Application with a Distributed Mulsemedia Platform. In Proc. of the 8th ACM on Multimedia Systems Conference, pages 308-314. ACM.
Saleme, E. B., Covaci, A., Assres, G., Comsa, I.-S., Trestian, R., Santos, C. A. S., and Ghinea, G. (2020). The Influence of Human Factors on 360◦ Mulsemedia QoE. International Journal of Human-Computer Studies, pages 1-39. Submitted.
Saleme, E. B., Covaci, A., Mesfin, G., Santos, C. A. S., and Ghinea, G. (2019a). Mulsemedia DIY: A Survey of Devices and a Tutorial for Building Your Own Mulsemedia
Environment. ACM Computing Surveys, 52(3):58:1-58:29. Saleme, E. B., Covaci, A., Mesfin, G., Santos, C. A. S., and Ghinea, G. (2019b). Sumarizac ̧ao de dispositivos de efeitos multissensoriais para interações humano-computador. In Extended Proceedings of IHC’19: XVIII Brazilian Symposium on Human Factors in Computing Systems, IHC’19. SBC.
Saleme, E. B., Santos, C. A. S., Falbo, R. A., Ghinea, G., and Andres, F. (2018a). Towards a reference ontology on mulsemedia systems. In Proceedings of the 10th International Conference on Management of Digital EcoSystems, MEDES’18, pages 23-30. ACM.
Saleme, E. B., Santos, C. A. S., Falbo, R. A., Ghinea, G., and Andres, F. (2019c). MulseOnto: a Reference Ontology to Support the Design of Mulsemedia Systems. Journal of Universal Computer Science, 25(13).
Saleme, E. B., Santos, C. A. S., and Ghinea, G. (2018b). Improving response time interval in networked event-based mulsemedia systems. In Proceedings of the 9th ACM Multimedia Systems Conference, MMSys’18, pages 216-224. ACM.
Saleme, E. B., Santos, C. A. S., and Ghinea, G. (2019d). Coping With the Challenges of Delivering Multiple Sensorial Media. IEEE MultiMedia, 26(2):66-75.
Saleme, E. B., Santos, C. A. S., and Ghinea, G. (2019e). A mulsemedia framework for delivering sensory effects to heterogeneous systems. Multimedia Systems, 25(4):421-447.
Covaci, A., Saleme, E. B., Mesfin, G., Comsa, I.-S., Trestian, R., Santos, C. A. S., and Ghinea, G. (2020a). Multisensory 360◦ Videos Mediate Presence. IEEE Transactions on Visualization and Computer Graphics, pages 1-9. Submitted.
Covaci, A., Saleme, E. B., Mesfin, G. A., Hussain, N., Kani-Zabihi, E., and Ghinea, G. (2020b). How do we experience crossmodal correspondent mulsemedia content? IEEE Transactions on Multimedia, 22(5):1249-1258.
Covaci, A., Trestian, R., Saleme, E. B., Comsa, I.-S., Mesfin, G., Santos, C. A. S., and Ghinea, G. (2019). 360◦ Mulsemedia: A Way to Improve Subjective QoE in 360◦ Videos. In Proc. of the 27th ACM Int. Conf. on Multimedia, pages 2378-2386. ACM.
de Amorim, M. N., Saleme, E. B., de Assis Neto, F. R., Santos, C. A. S., and Ghinea, G. (2019). Crowdsourcing authoring of sensory effects on videos. Multimedia Tools and Applications, 78(14):19201-19227.
Jalal, L., Anedda, M., Popescu, V., and Murroni, M. (2018a). Qoe assessment for broadcasting multi sensorial media in smart home scenario. In 2018 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), pages 1-5.
Jalal, L., Anedda, M., Popescu, V., and Murroni, M. (2018b). QoE Assessment for IoT-Based Multi Sensorial Media Broadcasting. IEEE Trans. Broadcast., 64(2):552-560.
Jalal, L. and Murroni, M. (2019). The impact of multi-sensorial media in smart home scenario on user experience and emotions. In 2019 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), pages 1-6.
Mesfin, G., Saleme, E. B., Ademoye, O., Kani-Zabihi, E., Santos, C. A. S., and Ghinea, G. (2020a). Less is (Just as Good as) More-an Investigation of Olfactory Intensity and Hedonic Valence in Mulsemedia QoE using Heart Rate and Eye Tracking. IEEE Transactions on Multimedia.
Mesfin, G. A., Hussain, N., Kani-Zabihi, E., Covaci, A., Saleme, E. B., and Ghinea, G. (2020b). QoE of Cross-modally Mapped Mulsemedia: an Assessment Using Eye Gaze and Heart Rate. Multimedia Tools and Applications.
Saleme, E. B., Celestrini, J. R., and Santos, C. A. S. (2017). Time Evaluation for the Integration of a Gestural Interactive Application with a Distributed Mulsemedia Platform. In Proc. of the 8th ACM on Multimedia Systems Conference, pages 308-314. ACM.
Saleme, E. B., Covaci, A., Assres, G., Comsa, I.-S., Trestian, R., Santos, C. A. S., and Ghinea, G. (2020). The Influence of Human Factors on 360◦ Mulsemedia QoE. International Journal of Human-Computer Studies, pages 1-39. Submitted.
Saleme, E. B., Covaci, A., Mesfin, G., Santos, C. A. S., and Ghinea, G. (2019a). Mulsemedia DIY: A Survey of Devices and a Tutorial for Building Your Own Mulsemedia
Environment. ACM Computing Surveys, 52(3):58:1-58:29. Saleme, E. B., Covaci, A., Mesfin, G., Santos, C. A. S., and Ghinea, G. (2019b). Sumarizac ̧ao de dispositivos de efeitos multissensoriais para interações humano-computador. In Extended Proceedings of IHC’19: XVIII Brazilian Symposium on Human Factors in Computing Systems, IHC’19. SBC.
Saleme, E. B., Santos, C. A. S., Falbo, R. A., Ghinea, G., and Andres, F. (2018a). Towards a reference ontology on mulsemedia systems. In Proceedings of the 10th International Conference on Management of Digital EcoSystems, MEDES’18, pages 23-30. ACM.
Saleme, E. B., Santos, C. A. S., Falbo, R. A., Ghinea, G., and Andres, F. (2019c). MulseOnto: a Reference Ontology to Support the Design of Mulsemedia Systems. Journal of Universal Computer Science, 25(13).
Saleme, E. B., Santos, C. A. S., and Ghinea, G. (2018b). Improving response time interval in networked event-based mulsemedia systems. In Proceedings of the 9th ACM Multimedia Systems Conference, MMSys’18, pages 216-224. ACM.
Saleme, E. B., Santos, C. A. S., and Ghinea, G. (2019d). Coping With the Challenges of Delivering Multiple Sensorial Media. IEEE MultiMedia, 26(2):66-75.
Saleme, E. B., Santos, C. A. S., and Ghinea, G. (2019e). A mulsemedia framework for delivering sensory effects to heterogeneous systems. Multimedia Systems, 25(4):421-447.
Publicado
30/06/2020
Como Citar
SALEME, Estêvão Bissoli; SANTOS, Celso Alberto Saibel; GHINEA, George.
A Conceptual Architecture and a Framework for Dealing with Variability in Mulsemedia Systems. In: CONCURSO DE TESES E DISSERTAÇÕES (CTD), 33. , 2020, Cuiabá.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2020
.
p. 13-18.
ISSN 2763-8820.
DOI: https://doi.org/10.5753/ctd.2020.11362.
