An Approach for Sensory Effects Dispersion Simulation with Computational Fluid Dynamics
Resumo
The inclusion of sensory effects in multimedia applications has the potential to increase the Quality of Experience (QoE) and improve users immersion. However, authoring such applications presents challenges arising from the need to control the rendering of sensory effects in the physical environment along with the presentation of their counterpart in the multimedia application and the constantly changing sensory effects state according to user interaction. Computational Fluid Dynamics (CFD) techniques can be used to simulate the sensory effects in a virtual environment and use the generated data to automatically control actuators. In this work, we propose an architecture to simulate wind sensory effects in an interactive real-time application and validate it using a CFD method. Data from simulation is then used to infer propagation delay and the wind temperature at the user position.
Palavras-chave:
Computational Fluid Dynamics, SPH, Mulsemedia, MPEG-V
Referências
John G. Apostolopoulos, Philip A. Chou, Bruce Culbertson, Ton Kalker, Mitchell D. Trott, and Susie Wee. 2012. The Road to Immersive Communication. Proc. IEEE 100, 4 (2012), 974–990. https://doi.org/10.1109/JPROC.2011.2182069
Gheorghita Ghinea, Christian Timmerer, Weisi Lin, and Stephen R. Gulliver. 2014. Mulsemedia : State of the Art, Perspectives, and Challenges. ACM Transactions on Multimedia Computing, Communications, and Applications 11, 1s (2014), 1–23. https://doi.org/10.1145/2617994
Giuseppe Giorgi. 2018. Nonlinear hydrodynamic modelling of wave energy converters under controlled conditions. Ph.D. Dissertation. National University of Ireland Maynooth.
Md Lokman Hosain and Rebei Bel Fdhila. 2015. Literature Review of Accelerated CFD Simulation Methods towards Online Application. Energy Procedia 75 (2015), 3307–3314. Clean, Efficient and Affordable Energy for a Sustainable Future: The 7th International Conference on Applied Energy (ICAE2015). https://doi.org/10.1016/j.egypro.2015.07.714
You-Yang Hu, Yao-Fu Jan, Kuan-Wei Tseng, You-Shin Tsai, Hung-Ming Sung, Jin-Yao Lin, and Yi-Ping Hung. 2021. ABio: Active Bi-Olfactory Display Using Subwoofers for Virtual Reality. Association for Computing Machinery, New York, NY, USA, 2065–2073. https://doi.org/10.1145/3474085.3475678
Hiroshi Ishida, Haruka Matsukura, Hitoshi Yoshida, and Takamichi Nakamoto. 2008. Application of computational fluid dynamics simulation to olfactory display. In Proc. ICAT. 285–288.
Marina Josué, Raphael Abreu, Fábio Barreto, Douglas Mattos, Glauco Amorim, Joel dos Santos, and Débora Muchaluat-Saade. 2018. Modeling Sensory Effects as First-Class Entities in Multimedia Applications. In Proceedings of the 9th ACM Multimedia Systems Conference (Amsterdam, Netherlands) (MMSys ’18). Association for Computing Machinery, New York, NY, USA, 225–236. https://doi.org/10.1145/3204949.3204967
Marina Josué, Débora Muchaluat-Saade, and Marcelo Moreno. 2018. Preparation of Media Object Presentation and Sensory Effect Rendering in Mulsemedia Applications. In Proceedings of the 24th Brazilian Symposium on Multimedia and the Web (Salvador, BA, Brazil) (WebMedia ’18). Association for Computing Machinery, New York, NY, USA, 45–52. https://doi.org/10.1145/3243082.3243098
Kanav Kahol, Priyamvada Tripathi, Troy Mcdaniel, Laura Bratton, and Sethuraman Panchanathan. 2006. Modeling Context in Haptic Perception, Rendering, and Visualization. ACM Trans. Multimedia Comput. Commun. Appl. 2, 3 (aug 2006), 219–240. https://doi.org/10.1145/1152149.1152153
H. Matsukura and H. Ishida. 2009. Olfactory Display: Fluid Dynamic Considerations for Realistic Odor Presentation. In Proceedings of the 15th Joint Virtual Reality Eurographics Conference on Virtual Environments (Lyon, France) (JVRC’09). Eurographics Association, Goslar, DEU, 61–64.
Haruka Matsukura, Hitoshi Yoshida, Hiroshi Ishida, and Takamichi Nakamoto. 2009. Interactive Odor Playback Based on Fluid Dynamics Simulation. In 2009 IEEE Virtual Reality Conference. 255–256. https://doi.org/10.1109/VR.2009.4811042
Matthias Müller, David Charypar, and Markus H Gross. 2003. Particle-based fluid simulation for interactive applications.. In Symposium on Computer animation. 154–159.
Niall Murray, Oluwakemi A. Ademoye, Gheorghita Ghinea, and Gabriel-Miro Muntean. 2017. A Tutorial for Olfaction-Based Multisensorial Media Application Design and Evaluation. ACM Comput. Surv. 50, 5, Article 67 (sep 2017), 30 pages. https://doi.org/10.1145/3108243
Takamichi Nakamoto, Tatsuya Hirasawa, and Yukiko Hanyu. 2020. Virtual environment with smell using wearable olfactory display and computational fluid dynamics simulation. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 713–720. https://doi.org/10.1109/VR46266.2020.00094
Constantine Pozrikidis et al. 1998. Numerical computation in science and engineering. Vol. 6. Oxford university press New York.
Bo Ren, Xiao Yan, Tao Yang, Chen-feng Li, Ming C Lin, and Shi-min Hu. 2016. Fast SPH simulation for gaseous fluids. The Visual Computer 32, 4 (2016), 523–534. https://doi.org/10.1007/s00371-015-1086-y
Eduardo C. Rodrigues, Estevao B. Saleme, and Celso A. S. Santos. 2021. A Haptic System for Switching Wind Temperatures Based on Ultrasonic Vibrations, Peltier Elements, and Electrical Resistances for Multisensory Applications. In Proceedings of the Brazilian Symposium on Multimedia and the Web (Belo Horizonte, Minas Gerais, Brazil) (WebMedia ’21). Association for Computing Machinery, New York, NY, USA, 73–80. https://doi.org/10.1145/3470482.3479638
Renato Rodrigues, Felipe Henriques, José Ricardo, Diego Brandão, and Joel dos Santos. 2021. Modelagem Computacional de Efeitos Sensoriais. In Anais da IV Escola Regional de Informática do Rio de Janeiro (Online). SBC, Porto Alegre, RS, Brasil, 1–8. https://doi.org/10.5753/eri-rj.2021.18768
Renato O. Rodrigues, Marina I. P. Josué, Raphael S. Abreu, Glauco F. Amorim, Débora C. Muchaluat-Saade, and Joel A. F. dos Santos. 2019. A Proposal for Supporting Sensory Effect Rendering in Ginga-NCL. In Proceedings of the 25th Brazillian Symposium on Multimedia and the Web (Rio de Janeiro, Brazil) (WebMedia ’19). Association for Computing Machinery, New York, NY, USA, 273–280. https://doi.org/10.1145/3323503.3349544
Estêvão Bissoli Saleme and Celso Alberto Saibel Santos. 2015. PlaySEM: A Platform for Rendering MulSeMedia Compatible with MPEG-V. Proceedings of the 21st Brazilian Symposium on Multimedia and the Web (2015), 145–148. https://doi.org/10.1145/2820426.2820450
Leonardo Di G. Sigalotti, Jaime Klapp, and Moncho Gómez Gesteira. 2021. The Mathematics of Smoothed Particle Hydrodynamics (SPH) Consistency. Frontiers in Applied Mathematics and Statistics 7 (2021).
Francisco Toja-Silva, Takaaki Kono, Carlos Peralta, Oscar Lopez-Garcia, and Jia Chen. 2018. A review of computational fluid dynamics (CFD) simulations of the wind flow around buildings for urban wind energy exploitation. Journal of Wind Engineering and Industrial Aerodynamics 180 (2018), 66–87. https://doi.org/10.1016/j.jweia.2018.07.010
R Tortell, DP Luigi, A Dozois, S Bouchard, Jacquelyn Ford Morie, and D Ilan. 2007. The effects of scent and game play experience on memory of a virtual environment. Virtual Reality 11, 1 (2007), 61–68. https://doi.org/10.1007/s10055-006-0056-0
Pieter Wesseling. 2009. Principles of computational fluid dynamics. Vol. 29. Springer Science & Business Media.
Gheorghita Ghinea, Christian Timmerer, Weisi Lin, and Stephen R. Gulliver. 2014. Mulsemedia : State of the Art, Perspectives, and Challenges. ACM Transactions on Multimedia Computing, Communications, and Applications 11, 1s (2014), 1–23. https://doi.org/10.1145/2617994
Giuseppe Giorgi. 2018. Nonlinear hydrodynamic modelling of wave energy converters under controlled conditions. Ph.D. Dissertation. National University of Ireland Maynooth.
Md Lokman Hosain and Rebei Bel Fdhila. 2015. Literature Review of Accelerated CFD Simulation Methods towards Online Application. Energy Procedia 75 (2015), 3307–3314. Clean, Efficient and Affordable Energy for a Sustainable Future: The 7th International Conference on Applied Energy (ICAE2015). https://doi.org/10.1016/j.egypro.2015.07.714
You-Yang Hu, Yao-Fu Jan, Kuan-Wei Tseng, You-Shin Tsai, Hung-Ming Sung, Jin-Yao Lin, and Yi-Ping Hung. 2021. ABio: Active Bi-Olfactory Display Using Subwoofers for Virtual Reality. Association for Computing Machinery, New York, NY, USA, 2065–2073. https://doi.org/10.1145/3474085.3475678
Hiroshi Ishida, Haruka Matsukura, Hitoshi Yoshida, and Takamichi Nakamoto. 2008. Application of computational fluid dynamics simulation to olfactory display. In Proc. ICAT. 285–288.
Marina Josué, Raphael Abreu, Fábio Barreto, Douglas Mattos, Glauco Amorim, Joel dos Santos, and Débora Muchaluat-Saade. 2018. Modeling Sensory Effects as First-Class Entities in Multimedia Applications. In Proceedings of the 9th ACM Multimedia Systems Conference (Amsterdam, Netherlands) (MMSys ’18). Association for Computing Machinery, New York, NY, USA, 225–236. https://doi.org/10.1145/3204949.3204967
Marina Josué, Débora Muchaluat-Saade, and Marcelo Moreno. 2018. Preparation of Media Object Presentation and Sensory Effect Rendering in Mulsemedia Applications. In Proceedings of the 24th Brazilian Symposium on Multimedia and the Web (Salvador, BA, Brazil) (WebMedia ’18). Association for Computing Machinery, New York, NY, USA, 45–52. https://doi.org/10.1145/3243082.3243098
Kanav Kahol, Priyamvada Tripathi, Troy Mcdaniel, Laura Bratton, and Sethuraman Panchanathan. 2006. Modeling Context in Haptic Perception, Rendering, and Visualization. ACM Trans. Multimedia Comput. Commun. Appl. 2, 3 (aug 2006), 219–240. https://doi.org/10.1145/1152149.1152153
H. Matsukura and H. Ishida. 2009. Olfactory Display: Fluid Dynamic Considerations for Realistic Odor Presentation. In Proceedings of the 15th Joint Virtual Reality Eurographics Conference on Virtual Environments (Lyon, France) (JVRC’09). Eurographics Association, Goslar, DEU, 61–64.
Haruka Matsukura, Hitoshi Yoshida, Hiroshi Ishida, and Takamichi Nakamoto. 2009. Interactive Odor Playback Based on Fluid Dynamics Simulation. In 2009 IEEE Virtual Reality Conference. 255–256. https://doi.org/10.1109/VR.2009.4811042
Matthias Müller, David Charypar, and Markus H Gross. 2003. Particle-based fluid simulation for interactive applications.. In Symposium on Computer animation. 154–159.
Niall Murray, Oluwakemi A. Ademoye, Gheorghita Ghinea, and Gabriel-Miro Muntean. 2017. A Tutorial for Olfaction-Based Multisensorial Media Application Design and Evaluation. ACM Comput. Surv. 50, 5, Article 67 (sep 2017), 30 pages. https://doi.org/10.1145/3108243
Takamichi Nakamoto, Tatsuya Hirasawa, and Yukiko Hanyu. 2020. Virtual environment with smell using wearable olfactory display and computational fluid dynamics simulation. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 713–720. https://doi.org/10.1109/VR46266.2020.00094
Constantine Pozrikidis et al. 1998. Numerical computation in science and engineering. Vol. 6. Oxford university press New York.
Bo Ren, Xiao Yan, Tao Yang, Chen-feng Li, Ming C Lin, and Shi-min Hu. 2016. Fast SPH simulation for gaseous fluids. The Visual Computer 32, 4 (2016), 523–534. https://doi.org/10.1007/s00371-015-1086-y
Eduardo C. Rodrigues, Estevao B. Saleme, and Celso A. S. Santos. 2021. A Haptic System for Switching Wind Temperatures Based on Ultrasonic Vibrations, Peltier Elements, and Electrical Resistances for Multisensory Applications. In Proceedings of the Brazilian Symposium on Multimedia and the Web (Belo Horizonte, Minas Gerais, Brazil) (WebMedia ’21). Association for Computing Machinery, New York, NY, USA, 73–80. https://doi.org/10.1145/3470482.3479638
Renato Rodrigues, Felipe Henriques, José Ricardo, Diego Brandão, and Joel dos Santos. 2021. Modelagem Computacional de Efeitos Sensoriais. In Anais da IV Escola Regional de Informática do Rio de Janeiro (Online). SBC, Porto Alegre, RS, Brasil, 1–8. https://doi.org/10.5753/eri-rj.2021.18768
Renato O. Rodrigues, Marina I. P. Josué, Raphael S. Abreu, Glauco F. Amorim, Débora C. Muchaluat-Saade, and Joel A. F. dos Santos. 2019. A Proposal for Supporting Sensory Effect Rendering in Ginga-NCL. In Proceedings of the 25th Brazillian Symposium on Multimedia and the Web (Rio de Janeiro, Brazil) (WebMedia ’19). Association for Computing Machinery, New York, NY, USA, 273–280. https://doi.org/10.1145/3323503.3349544
Estêvão Bissoli Saleme and Celso Alberto Saibel Santos. 2015. PlaySEM: A Platform for Rendering MulSeMedia Compatible with MPEG-V. Proceedings of the 21st Brazilian Symposium on Multimedia and the Web (2015), 145–148. https://doi.org/10.1145/2820426.2820450
Leonardo Di G. Sigalotti, Jaime Klapp, and Moncho Gómez Gesteira. 2021. The Mathematics of Smoothed Particle Hydrodynamics (SPH) Consistency. Frontiers in Applied Mathematics and Statistics 7 (2021).
Francisco Toja-Silva, Takaaki Kono, Carlos Peralta, Oscar Lopez-Garcia, and Jia Chen. 2018. A review of computational fluid dynamics (CFD) simulations of the wind flow around buildings for urban wind energy exploitation. Journal of Wind Engineering and Industrial Aerodynamics 180 (2018), 66–87. https://doi.org/10.1016/j.jweia.2018.07.010
R Tortell, DP Luigi, A Dozois, S Bouchard, Jacquelyn Ford Morie, and D Ilan. 2007. The effects of scent and game play experience on memory of a virtual environment. Virtual Reality 11, 1 (2007), 61–68. https://doi.org/10.1007/s10055-006-0056-0
Pieter Wesseling. 2009. Principles of computational fluid dynamics. Vol. 29. Springer Science & Business Media.
Publicado
07/11/2022
Como Citar
RODRIGUES, Renato; SILVA JR., José Ricardo da; BRANDÃO, Diego; SANTOS, Joel dos.
An Approach for Sensory Effects Dispersion Simulation with Computational Fluid Dynamics. In: SIMPÓSIO BRASILEIRO DE SISTEMAS MULTIMÍDIA E WEB (WEBMEDIA), 28. , 2022, Curitiba.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2022
.
p. 395-403.
