Computational Modeling of Sensory Effects
Abstract
The inclusion of sensory effects in interactive multimedia applications presents the challenge of controlling various aspects of reproducing these effects in conjunction with their representation in the virtual environment and user interaction. Using computational fluid dynamics techniques to simulate sensory effects and using this data to control actuators can facilitate the authoring of such applications and promote a better user experience. This paper presents some of the different approaches to fluid simulation, an implementation for use in the context of interactive applications, and demonstrates different visualizations of simulation data to study their behavior.
Keywords:
Mulsemidia, sensory effects, fluids, SPH
References
Apostolopoulos, J. G., Chou, P. A., Culbertson, B., Kalker, T., Trott, M. D., Wee, S. (2012). The road to immersive communication. Proceedings of the IEEE, 100(4):974–990.
da Silva Junior, J. R. (2010). Simulação computacional em tempo real de fluidos utilizando o método sph em ambiente heterogêneo cpu/gpu. Master’s thesis, Universidade Federal Fluminense, UFF, Niterói, Brasil.
Ghinea, G., Timmerer, C., Lin, W., Gulliver, S. R. (2014). Mulsemedia: State of the Art, Perspectives, and Challenges. ACM Transactions on Multimedia Computing, Communications, and Applications, 11(1s):1–23.
Gingold, R. A., Monaghan, J. J. (1977). Smoothed particle hydrodynamics: theory and application to non-spherical stars. Monthly notices of the royal astronomical society, 181(3):375–389.
Giorgi, G. (2018). Nonlinear hydrodynamic modelling of wave energy converters under controlled conditions. PhD thesis, National University of Ireland Maynooth.
Ishida, H., Matsukura, H., Yoshida, H., Nakamoto, T. (2008). Application of computational fluid dynamics simulation to olfactory display. In Proc. ICAT, pages 285–288.
Kahol, K., Tripathi, P., Mcdaniel, T., Bratton, L., Panchanathan, S. (2006). Modeling context in haptic perception, rendering, and visualization. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 2(3):219–240.
Liu, G.R., Liu, M.B. (2003). Smoothed particle hydrodynamics: a meshfree particle method. World scientific.
Lucy, L.B. (1977). A numerical approach to the testing of the fission hypothesis. The astronomical journal, 82:1013–1024.
Matsukura, H., Ishida, H. (2009). Olfactory display: fluid dynamic considerations for realistic odor presentation. In Proceedings of the 15th Joint virtual reality Eurographics conference on Virtual Environments, pages 61–64.
Matsukura, H., Yoshida, H., Ishida, H., Nakamoto, T. (2009). Interactive odor playback based on fluid dynamics simulation. In 2009 IEEE Virtual Reality Conference, pages 255–256. IEEE.
Müller, M., Charypar, D., Gross, M. H. (2003). Particle-based fluid simulation for interactive applications. In Symposium on Computer animation, pages 154–159.
Nakamoto, T., Hirasawa, T., Hanyu, Y. (2020). Virtual environment with smell using wearable olfactory display and computational fluid dynamics simulation. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pages 713–720. IEEE.
Ren, B., Yan, X., Yang, T., Li, C.-f., Lin, M. C., Hu, S.-m. (2016). Fast sph simulation for gaseous fluids. The Visual Computer, 32(4):523–534.
Timmerer, C., Waltl, M., Rainer, B., Hellwagner, H. (2012). Assessing the quality of sensory experience for multimedia presentations. Signal Processing: Image Communication, 27(8):909–916.
Tortell, R., Luigi, D., Dozois, A., Bouchard, S., Morie, J. F., Ilan, D. (2007). The effects of scent and game play experience on memory of a virtual environment. Virtual Reality, 11(1):61–68
Wesseling, P. (2009). Principles of computational fluid dynamics, volume 29. Springer Science & Business Media.
da Silva Junior, J. R. (2010). Simulação computacional em tempo real de fluidos utilizando o método sph em ambiente heterogêneo cpu/gpu. Master’s thesis, Universidade Federal Fluminense, UFF, Niterói, Brasil.
Ghinea, G., Timmerer, C., Lin, W., Gulliver, S. R. (2014). Mulsemedia: State of the Art, Perspectives, and Challenges. ACM Transactions on Multimedia Computing, Communications, and Applications, 11(1s):1–23.
Gingold, R. A., Monaghan, J. J. (1977). Smoothed particle hydrodynamics: theory and application to non-spherical stars. Monthly notices of the royal astronomical society, 181(3):375–389.
Giorgi, G. (2018). Nonlinear hydrodynamic modelling of wave energy converters under controlled conditions. PhD thesis, National University of Ireland Maynooth.
Ishida, H., Matsukura, H., Yoshida, H., Nakamoto, T. (2008). Application of computational fluid dynamics simulation to olfactory display. In Proc. ICAT, pages 285–288.
Kahol, K., Tripathi, P., Mcdaniel, T., Bratton, L., Panchanathan, S. (2006). Modeling context in haptic perception, rendering, and visualization. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 2(3):219–240.
Liu, G.R., Liu, M.B. (2003). Smoothed particle hydrodynamics: a meshfree particle method. World scientific.
Lucy, L.B. (1977). A numerical approach to the testing of the fission hypothesis. The astronomical journal, 82:1013–1024.
Matsukura, H., Ishida, H. (2009). Olfactory display: fluid dynamic considerations for realistic odor presentation. In Proceedings of the 15th Joint virtual reality Eurographics conference on Virtual Environments, pages 61–64.
Matsukura, H., Yoshida, H., Ishida, H., Nakamoto, T. (2009). Interactive odor playback based on fluid dynamics simulation. In 2009 IEEE Virtual Reality Conference, pages 255–256. IEEE.
Müller, M., Charypar, D., Gross, M. H. (2003). Particle-based fluid simulation for interactive applications. In Symposium on Computer animation, pages 154–159.
Nakamoto, T., Hirasawa, T., Hanyu, Y. (2020). Virtual environment with smell using wearable olfactory display and computational fluid dynamics simulation. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pages 713–720. IEEE.
Ren, B., Yan, X., Yang, T., Li, C.-f., Lin, M. C., Hu, S.-m. (2016). Fast sph simulation for gaseous fluids. The Visual Computer, 32(4):523–534.
Timmerer, C., Waltl, M., Rainer, B., Hellwagner, H. (2012). Assessing the quality of sensory experience for multimedia presentations. Signal Processing: Image Communication, 27(8):909–916.
Tortell, R., Luigi, D., Dozois, A., Bouchard, S., Morie, J. F., Ilan, D. (2007). The effects of scent and game play experience on memory of a virtual environment. Virtual Reality, 11(1):61–68
Wesseling, P. (2009). Principles of computational fluid dynamics, volume 29. Springer Science & Business Media.
Published
2021-11-23
How to Cite
RODRIGUES, Renato; HENRIQUES, Felipe; RICARDO, José; BRANDÃO, Diego; DOS SANTOS, Joel.
Computational Modeling of Sensory Effects. In: REGIONAL SCHOOL ON INFORMATICS OF RIO DE JANEIRO (ERI-RJ), 4. , 2021, Online.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2021
.
p. 1-8.
DOI: https://doi.org/10.5753/eri-rj.2021.18768.
