A Conceptual Architecture and a Framework for Dealing with Variability in Mulsemedia Systems
Resumo
The candidate’s thesis is within the emerging topic of mulsemedia systems, which encompass audiovisual content associated with multisensory effects, users’ quality of experience, and human-computer interaction. It presents a conceptual architecture and a framework that take into account the challenges and requirements for mulsemedia delivery systems identified from the gaps and shortcomings in related work. Furthermore, the work’s outcome brings multiple and valuable contributions relying on a complex and solid experimental setup, which have been shared and published in relevant journals and conferences.
Referências
I-S Comsa, E. B. Saleme, A. Covaci, G. Mesfi n, R. Trestian, C. A. S. Santos, and G. Ghinea. 2020. Do I Smell Coffee? The Tale of a 360° Mulsemedia Experience.IEEE MultiMedia 27, 1 (2020), 27–36.
A. Covaci, E. B. Saleme, G. Mesfi n, I-S. Comsa, R. Trestian, C. A. S. Santos, and G.Ghinea. 2020. Multisensory 360° Videos Mediate Presence. IEEE Transactions on Visualization and Computer Graphics (2020), 1–9. Submitted.
A. Covaci, E. B. Saleme, G. A. Mesfi n, N. Hussain, E. Kani-Zabihi, and G. Ghinea.2020. How Do We Experience Crossmodal Correspondent Mulsemedia Content? IEEE Transactions on Multimedia 22, 5 (2020), 1249–1258.
A. Covaci, R. Trestian, E. B. Saleme, I-S Comsa, G. Mesfi n, C. A. S. Santos, andG. Ghinea. 2019. 360◦ Mulsemedia: A Way to Improve Subjective QoE in 360◦Videos. In Proc. of the 27th ACM Int. Conf. on Multimedia (Nice, France). ACM, 2378–2386. https://doi.org/10.1145/3343031.3350954
M. N. de Amorim, E. B. Saleme, F. R. de Assis Neto, C. A. S. Santos, and G. Ghinea.2019. Crowdsourcing authoring of sensory effects on videos. Multimedia Tools and Applications 78, 14 (01 Jul 2019), 19201–19227. https://doi.org/10.1007/s11042-019-7312-2
L. Jalal, M. Anedda, V. Popescu, and M. Murroni. 2018. QoE Assessment for Broadcasting Multi Sensorial Media in Smart Home Scenario. In 2018 IEEE Inter-national Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).1–5. https://doi.org/10.1109/BMSB.2018.8436875
L. Jalal, M. Anedda, V. Popescu, and M. Murroni. 2018. QoE Assessment for IoT-Based Multi Sensorial Media Broadcasting. IEEE Trans. Broadcast. 64, 2 (June2018), 552–560. https://doi.org/10.1109/TBC.2018.2823914
L. Jalal and M. Murroni. 2019. The Impact of Multi-Sensorial Media in Smart Home Scenario on User Experience and Emotions. In 2019 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB). 1–6.https://doi.org/10.1109/BMSB47279.2019.8971922
G. Mesfi n, E. B. Saleme, O. Ademoye, E. Kani-Zabihi, C. A. S. Santos, and G.Ghinea. 2020. Less is (Just as Good as) More - an Investigation of Olfactory Intensity and Hedonic Valence in Mulsemedia QoE using Heart Rate and Eye Tracking. IEEE Transactions on Multimedia (2020), 11.
G. A. Mesfi n, N. Hussain, E. Kani-Zabihi, A. Covaci, E. B. Saleme, and G. Ghinea.2020. QoE of Cross-modally Mapped Mulsemedia: an Assessment Using Eye Gaze and Heart Rate. Multimedia Tools and Applications (2020), 21.
E. B. Saleme. 2019. A Conceptual Architecture and a Framework for Dealing with Variability in Mulsemedia Systems. Ph.D. Dissertation. Federal University of Espírito Santo. Online; Accessed on 03/09/2020. Available at http://informatica.ufes.br/pt-br/pos-graduacao/PPGI/detalhes-da-tese?id=13927.
E. B. Saleme, J. R. Celestrini, and C. A. S. Santos. 2017. Time Evaluation for the Integration of a Gestural Interactive Application with a Distributed Mulsemedia Platform. In Proc. of the 8th ACM on Multimedia Systems Conference. ACM, 308–314. https://doi.org/10.1145/3083187.3084013
E. B. Saleme, A. Covaci, G. Assres, I-S. Comsa, R. Trestian, C. A.S. Santos, and G. Ghinea. 2021. The Infl uence of Human Factors on 360 ◦ Mulsemedia QoE. International Journal of Human-Computer Studies 146 (2021), 102550. https://doi.org/10.1016/j.ijhcs.2020.102550
E. B. Saleme, A. Covaci, G. Mesfi n, C. A. S. Santos, and G. Ghinea. 2019. Mulsemedia DIY: A Survey of Devices and a Tutorial for Building Your Own Mulsemedia Environment. Comput. Surveys 52, 3, Article 58 (June 2019), 29 pages.
E. B. Saleme, A. Covaci, G. Mesfi n, C. A. S. Santos, and G. Ghinea. 2019. Sumarização de Dispositivos de Efeitos Multissensoriais para Interações Humano-Computador. In Extended Proceedings of IHC ’19: XVIII Brazilian Symposium on Human Factors in Computing Systems (IHC ’19). SBC, 2.
E. B. Saleme, C. A. S. Santos, R. A. Falbo, G. Ghinea, and F. Andres. 2018. To-wards a Reference Ontology on Mulsemedia Systems. In Proceedings of the 10thInternational Conference on Management of Digital EcoSystems (Tokyo, Japan)(MEDES ’18). ACM, 23–30. https://doi.org/10.1145/3281375.3281378
E. B. Saleme, C. A. S. Santos, R. A. Falbo, G. Ghinea, and F. Andres. 2019.MulseOnto: a Reference Ontology to Support the Design of Mulsemedia Systems Journal of Universal Computer Science 25, 13 (2019), 26.
E. B. Saleme, C. A. S. Santos, and G. Ghinea. 2018. Improving Response Time Interval in Networked Event-based Mulsemedia Systems. In Proceedings of the9th ACM Multimedia Systems Conference (Amsterdam, Netherlands) (MMSys ’18).ACM, 216–224. https://doi.org/10.1145/3204949.3204965
E. B. Saleme, C. A. S. Santos, and G. Ghinea. 2019. Coping With the Challenges of Delivering Multiple Sensorial Media. IEEE MultiMedia 26, 2 (April 2019), 66-75. https://doi.org/10.1109/MMUL.2018.2873565
E. B. Saleme, C. A. S. Santos, and G. Ghinea. 2019. A mulsemedia framework for delivering sensory effects to heterogeneous systems. Multimedia Systems 25, 4(01 Aug 2019), 421–447. https://doi.org/10.1007/s00530-019-00618-8
A. Covaci, E. B. Saleme, G. Mesfi n, I-S. Comsa, R. Trestian, C. A. S. Santos, and G.Ghinea. 2020. Multisensory 360° Videos Mediate Presence. IEEE Transactions on Visualization and Computer Graphics (2020), 1–9. Submitted.
A. Covaci, E. B. Saleme, G. A. Mesfi n, N. Hussain, E. Kani-Zabihi, and G. Ghinea.2020. How Do We Experience Crossmodal Correspondent Mulsemedia Content? IEEE Transactions on Multimedia 22, 5 (2020), 1249–1258.
A. Covaci, R. Trestian, E. B. Saleme, I-S Comsa, G. Mesfi n, C. A. S. Santos, andG. Ghinea. 2019. 360◦ Mulsemedia: A Way to Improve Subjective QoE in 360◦Videos. In Proc. of the 27th ACM Int. Conf. on Multimedia (Nice, France). ACM, 2378–2386. https://doi.org/10.1145/3343031.3350954
M. N. de Amorim, E. B. Saleme, F. R. de Assis Neto, C. A. S. Santos, and G. Ghinea.2019. Crowdsourcing authoring of sensory effects on videos. Multimedia Tools and Applications 78, 14 (01 Jul 2019), 19201–19227. https://doi.org/10.1007/s11042-019-7312-2
L. Jalal, M. Anedda, V. Popescu, and M. Murroni. 2018. QoE Assessment for Broadcasting Multi Sensorial Media in Smart Home Scenario. In 2018 IEEE Inter-national Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).1–5. https://doi.org/10.1109/BMSB.2018.8436875
L. Jalal, M. Anedda, V. Popescu, and M. Murroni. 2018. QoE Assessment for IoT-Based Multi Sensorial Media Broadcasting. IEEE Trans. Broadcast. 64, 2 (June2018), 552–560. https://doi.org/10.1109/TBC.2018.2823914
L. Jalal and M. Murroni. 2019. The Impact of Multi-Sensorial Media in Smart Home Scenario on User Experience and Emotions. In 2019 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB). 1–6.https://doi.org/10.1109/BMSB47279.2019.8971922
G. Mesfi n, E. B. Saleme, O. Ademoye, E. Kani-Zabihi, C. A. S. Santos, and G.Ghinea. 2020. Less is (Just as Good as) More - an Investigation of Olfactory Intensity and Hedonic Valence in Mulsemedia QoE using Heart Rate and Eye Tracking. IEEE Transactions on Multimedia (2020), 11.
G. A. Mesfi n, N. Hussain, E. Kani-Zabihi, A. Covaci, E. B. Saleme, and G. Ghinea.2020. QoE of Cross-modally Mapped Mulsemedia: an Assessment Using Eye Gaze and Heart Rate. Multimedia Tools and Applications (2020), 21.
E. B. Saleme. 2019. A Conceptual Architecture and a Framework for Dealing with Variability in Mulsemedia Systems. Ph.D. Dissertation. Federal University of Espírito Santo. Online; Accessed on 03/09/2020. Available at http://informatica.ufes.br/pt-br/pos-graduacao/PPGI/detalhes-da-tese?id=13927.
E. B. Saleme, J. R. Celestrini, and C. A. S. Santos. 2017. Time Evaluation for the Integration of a Gestural Interactive Application with a Distributed Mulsemedia Platform. In Proc. of the 8th ACM on Multimedia Systems Conference. ACM, 308–314. https://doi.org/10.1145/3083187.3084013
E. B. Saleme, A. Covaci, G. Assres, I-S. Comsa, R. Trestian, C. A.S. Santos, and G. Ghinea. 2021. The Infl uence of Human Factors on 360 ◦ Mulsemedia QoE. International Journal of Human-Computer Studies 146 (2021), 102550. https://doi.org/10.1016/j.ijhcs.2020.102550
E. B. Saleme, A. Covaci, G. Mesfi n, C. A. S. Santos, and G. Ghinea. 2019. Mulsemedia DIY: A Survey of Devices and a Tutorial for Building Your Own Mulsemedia Environment. Comput. Surveys 52, 3, Article 58 (June 2019), 29 pages.
E. B. Saleme, A. Covaci, G. Mesfi n, C. A. S. Santos, and G. Ghinea. 2019. Sumarização de Dispositivos de Efeitos Multissensoriais para Interações Humano-Computador. In Extended Proceedings of IHC ’19: XVIII Brazilian Symposium on Human Factors in Computing Systems (IHC ’19). SBC, 2.
E. B. Saleme, C. A. S. Santos, R. A. Falbo, G. Ghinea, and F. Andres. 2018. To-wards a Reference Ontology on Mulsemedia Systems. In Proceedings of the 10thInternational Conference on Management of Digital EcoSystems (Tokyo, Japan)(MEDES ’18). ACM, 23–30. https://doi.org/10.1145/3281375.3281378
E. B. Saleme, C. A. S. Santos, R. A. Falbo, G. Ghinea, and F. Andres. 2019.MulseOnto: a Reference Ontology to Support the Design of Mulsemedia Systems Journal of Universal Computer Science 25, 13 (2019), 26.
E. B. Saleme, C. A. S. Santos, and G. Ghinea. 2018. Improving Response Time Interval in Networked Event-based Mulsemedia Systems. In Proceedings of the9th ACM Multimedia Systems Conference (Amsterdam, Netherlands) (MMSys ’18).ACM, 216–224. https://doi.org/10.1145/3204949.3204965
E. B. Saleme, C. A. S. Santos, and G. Ghinea. 2019. Coping With the Challenges of Delivering Multiple Sensorial Media. IEEE MultiMedia 26, 2 (April 2019), 66-75. https://doi.org/10.1109/MMUL.2018.2873565
E. B. Saleme, C. A. S. Santos, and G. Ghinea. 2019. A mulsemedia framework for delivering sensory effects to heterogeneous systems. Multimedia Systems 25, 4(01 Aug 2019), 421–447. https://doi.org/10.1007/s00530-019-00618-8
Publicado
30/11/2020
Como Citar
SALEME, Estêvão Bissoli; SANTOS, Celso A. S.; GHINEA, Gheorghita.
A Conceptual Architecture and a Framework for Dealing with Variability in Mulsemedia Systems. In: CONCURSO DE TESES E DISSERTAÇÕES - SIMPÓSIO BRASILEIRO DE SISTEMAS MULTIMÍDIA E WEB (WEBMEDIA), 26. , 2020, São Luís.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2020
.
p. 5-8.
ISSN 2596-1683.
DOI: https://doi.org/10.5753/webmedia_estendido.2020.13052.
