An Immersive Olfactory VR Framework: Integrating Virtual Field Environments with Real-Time Scent Delivery via MQTT
Resumo
This paper introduces an immersive olfactory virtual reality (OVR) framework that integrates AI-driven olfactory segmentation, a high-fidelity scent delivery device, and a photorealistic virtual environment. It leverages semantic segmentation and depth estimation to generate olfactory masks from 360-degree panoramas, enabling real-time context-aware scent delivery synchronized with user perspective and proximity. Implemented within Unreal Engine and validated through controlled VR scenes, the framework provides a comprehensive solution for enhancing multisensory realism and adaptability in virtual reality.
Palavras-chave:
Olfactory Virtual Reality, IoT, Artificial Intelligence, MQTT, Multisensory Interaction
Referências
Zhang, Z. Guo, X. and Lee, C. "Advances in olfactory augmented virtual reality towards future metaverse applications". Nature Communications, vol. 15, no. 6465, July 2024. DOI: 10.1038/s41467-024-50261-9
O. Baus and S. Bouchard, "Exposure to an unpleasant odour increases the sense of presence in virtual reality," Virtual Reality, vol. 21, no. 2, pp. 59–74, Oct. 2016, DOI: 10.1007/s10055-016-0299-3.
S. Persky and A. P. Dolwick, "Olfactory perception and presence in a virtual reality food environment," Frontiers in Virtual Reality, vol. 1, Sept. 2020, DOI: 10.3389/frvir.2020.571812.
Y. Liu et al. "Soft, miniaturized, wireless olfactory interface for virtual reality," Nature Communications, vol. 14, no. 1, May 2023, DOI: 10.1038/s41467-023-37678-4.
J. Tewell and N. Ranasinghe, "A review of olfactory display designs for virtual reality environments," ACM Computing Surveys, vol. 56, no. 11, pp. 1–35, June 2024, DOI: 10.1145/3665243.
E. Maggioni, R. Cobden, D. Dmitrenko, K. Hornbaek, and M. Obrist, "Smell space: Mapping out the olfactory design space for novel interactions," ACM Transactions on Computer-Human Interaction, vol. 27, no. 5, pp. 1–26, Aug. 2020, DOI: 10.1145/3402449.
Alikhani M, Khalid B and Stone M (2023) Image–text coherence and its implications for multimodal AI. Front. Artif. Intell. 6:1048874. DOI: 10.3389/frai.2023.1048874.
M. F. B. Da Silva et al. "SOFIA: Advancements in Olfactory Stimuli in Virtual Reality for Immersive Multisensory Experiences and Potential Applications in the Industry 5.0," 2025 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR), Lisbon, Portugal, pp. 419-424, 2025. Available: 10.1109/AIxVR63409.2025.00078
Y. Zhang et al. "OdorAgent: Generate Odor Sequences for Movies Based on Large Language Model," 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR), Orlando, FL, USA, pp. 105-114, 2024. Available: 10.1109/VR58804.2024.00034
M. F. B. Da Silva et al. "Creating an Olfactory Mask Dataset using Computer Vision and LLMs for Virtual Reality Environments," 2025 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR), Lisbon, Portugal, pp. 340-347, 2025. Available: 10.1109/AIxVR63409.2025.00065.
R. Ranftl et al. "Towards robust monocular depth estimation: Mixing datasets for zero-shot cross-dataset transfer". IEEE transactions on pattern analysis and machine intelligence, v. 44, n. 3, p. 1623-1637, 2020. Available: [link]
E. Maggioni, R. Cobden, D. Dmitrenko, K. Hornbaek, and M. Obrist, "SMELL SPACE: Mapping out the Olfactory Design Space for Novel Interactions," ACM Transactions on Computer-Human Interaction (TOCHI), vol. 27, no. 5, art. 36, pp. 1–26, Aug. 3, 2020. DOI: 10.1145/3402449.
Z. Zhang, X. Guo, and C. Lee, "Advances in olfactory augmented virtual reality towards future metaverse applications," Nature Communications, vol. 15, no. 1, Jul. 2024. DOI: 10.1038/s41467-024-50261-9.
OVR Technology. OVR Technology. [Online]. Available: [link]. Accessed: Jun. 2, 2025.
DESTINATION CRM. Something Smells in Marketing’s Future. Destination CRM, Feb. 28, 2025. [Online]. Available: [link]. Accessed: Jun. 2, 2025.
OSMO AI. Update on scent teleportation: we did it. Osmo.ai Blog, 2024. [Online]. Available: [link]. Accessed: Jun. 2, 2025.
Y. Zhang, P. Gao, F. Kang, J. Li, J. Liu, Q. Lu, and Y. Xu. OdorAgent: Generate Odor Sequences for Movies Based on Large Language Model. in 2024 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2024, pp. 105–114. DOI: 10.1109/VR58804.2024.00034.
M. Yildirim, A. Globa, O. Gocer, and A. Brambilla, "Digital smell technologies for the built environment: Evaluating human responses to multisensory stimuli in immersive virtual reality," Building and Environment, vol. 271, 2025, Art. no. 112608. DOI: 10.1016/j.buildenv.2025.112608.
S. Cho, H. Shin, S. Hong, A. Arnab, P. H. Seo, and S. Kim, "CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentation," arXiv preprint arXiv:2303.11797, Mar. 2023. [Online]. Available: [link].
X. Li, T. Wu, Z. Qi, G. Wang, Y. Shan, and X. Li, "SGAT4PASS: Spherical Geometry-Aware Transformer for Panoramic Semantic Segmentation," arXiv preprint arXiv:2306.03403, Jun. 2023. [Online]. Available: [link].
C. Ma, J. Zhang, K. Yang, A. Roitberg, and R. Stiefelhagen, "DensePASS: Dense Panoramic Semantic Segmentation via Unsupervised Domain Adaptation with Attention-Augmented Context Exchange," arXiv preprint arXiv:2108.06383, Aug. 2021. [Online]. Available: [link].
OpenAI, "GPT-4o mini: advancing cost-efficient intelligence," OpenAI Blog, Jul. 11, 2024. [Online]. Available: [link]
Blockade Labs, "Skybox AI: Generate 360° Skyboxes with AI," 2024. [Online]. Available: [link].
B. E. A. Sekachev et al. "opencv/cvat: v1.1.0," Zenodo, 2020. [Online]. DOI: 10.5281/zenodo.4009388
Z. S. See and A. D. Cheok, "Virtual Reality 360 Interactive Panorama Reproduction: Obstacles and Issues," Virtual Reality, vol. 19, no. 2, pp. 71–81, Jun. 2015. [Online]. DOI: 10.1007/s10055-014-0258-9.
J. Rantala et al. "Recall of Odorous Objects in Virtual Reality," Multimodal Technologies and Interaction, vol. 8, no. 6, p. 42, May 2024. [Online]. DOI: 10.3390/mti8060042.
A. Z. Sarabian, Integration of Olfactory Stimuli in a Virtual Reality Experience for People with Dementia, Master’s thesis, Technical University Eindhoven, Jun. 2024. [Online]. Available: [link].
S. Smid, Antonin. Comparison of unity and unreal engine. Bachelor Project, Czech Technical University in Prague, 2017, pp. 41-61. Available: [link]
Liu, M. et al. A star-nose-like tactile-olfactory bionic sensing array for robust object recognition in non-visual environments. Nat. Commun. 13, 1–10 (2022).
Nakamoto, T. Ito, S. Kato, S. & Qi, G. P. Multicomponent olfactory display using solenoid valves and SAW atomizer and its blending-capability evaluation. IEEE Sens. J. 18, 5213–5218 (2018).
Goh M. C. Kanagaraj E. Kamarudin L. M. Zakaria A. Nishizaki H. Mao X. Y. (2019). DOI: 10.1109/SENSORSNANO44414.2019.8940094,
O. Baus and S. Bouchard, "Exposure to an unpleasant odour increases the sense of presence in virtual reality," Virtual Reality, vol. 21, no. 2, pp. 59–74, Oct. 2016, DOI: 10.1007/s10055-016-0299-3.
S. Persky and A. P. Dolwick, "Olfactory perception and presence in a virtual reality food environment," Frontiers in Virtual Reality, vol. 1, Sept. 2020, DOI: 10.3389/frvir.2020.571812.
Y. Liu et al. "Soft, miniaturized, wireless olfactory interface for virtual reality," Nature Communications, vol. 14, no. 1, May 2023, DOI: 10.1038/s41467-023-37678-4.
J. Tewell and N. Ranasinghe, "A review of olfactory display designs for virtual reality environments," ACM Computing Surveys, vol. 56, no. 11, pp. 1–35, June 2024, DOI: 10.1145/3665243.
E. Maggioni, R. Cobden, D. Dmitrenko, K. Hornbaek, and M. Obrist, "Smell space: Mapping out the olfactory design space for novel interactions," ACM Transactions on Computer-Human Interaction, vol. 27, no. 5, pp. 1–26, Aug. 2020, DOI: 10.1145/3402449.
Alikhani M, Khalid B and Stone M (2023) Image–text coherence and its implications for multimodal AI. Front. Artif. Intell. 6:1048874. DOI: 10.3389/frai.2023.1048874.
M. F. B. Da Silva et al. "SOFIA: Advancements in Olfactory Stimuli in Virtual Reality for Immersive Multisensory Experiences and Potential Applications in the Industry 5.0," 2025 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR), Lisbon, Portugal, pp. 419-424, 2025. Available: 10.1109/AIxVR63409.2025.00078
Y. Zhang et al. "OdorAgent: Generate Odor Sequences for Movies Based on Large Language Model," 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR), Orlando, FL, USA, pp. 105-114, 2024. Available: 10.1109/VR58804.2024.00034
M. F. B. Da Silva et al. "Creating an Olfactory Mask Dataset using Computer Vision and LLMs for Virtual Reality Environments," 2025 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR), Lisbon, Portugal, pp. 340-347, 2025. Available: 10.1109/AIxVR63409.2025.00065.
R. Ranftl et al. "Towards robust monocular depth estimation: Mixing datasets for zero-shot cross-dataset transfer". IEEE transactions on pattern analysis and machine intelligence, v. 44, n. 3, p. 1623-1637, 2020. Available: [link]
E. Maggioni, R. Cobden, D. Dmitrenko, K. Hornbaek, and M. Obrist, "SMELL SPACE: Mapping out the Olfactory Design Space for Novel Interactions," ACM Transactions on Computer-Human Interaction (TOCHI), vol. 27, no. 5, art. 36, pp. 1–26, Aug. 3, 2020. DOI: 10.1145/3402449.
Z. Zhang, X. Guo, and C. Lee, "Advances in olfactory augmented virtual reality towards future metaverse applications," Nature Communications, vol. 15, no. 1, Jul. 2024. DOI: 10.1038/s41467-024-50261-9.
OVR Technology. OVR Technology. [Online]. Available: [link]. Accessed: Jun. 2, 2025.
DESTINATION CRM. Something Smells in Marketing’s Future. Destination CRM, Feb. 28, 2025. [Online]. Available: [link]. Accessed: Jun. 2, 2025.
OSMO AI. Update on scent teleportation: we did it. Osmo.ai Blog, 2024. [Online]. Available: [link]. Accessed: Jun. 2, 2025.
Y. Zhang, P. Gao, F. Kang, J. Li, J. Liu, Q. Lu, and Y. Xu. OdorAgent: Generate Odor Sequences for Movies Based on Large Language Model. in 2024 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2024, pp. 105–114. DOI: 10.1109/VR58804.2024.00034.
M. Yildirim, A. Globa, O. Gocer, and A. Brambilla, "Digital smell technologies for the built environment: Evaluating human responses to multisensory stimuli in immersive virtual reality," Building and Environment, vol. 271, 2025, Art. no. 112608. DOI: 10.1016/j.buildenv.2025.112608.
S. Cho, H. Shin, S. Hong, A. Arnab, P. H. Seo, and S. Kim, "CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentation," arXiv preprint arXiv:2303.11797, Mar. 2023. [Online]. Available: [link].
X. Li, T. Wu, Z. Qi, G. Wang, Y. Shan, and X. Li, "SGAT4PASS: Spherical Geometry-Aware Transformer for Panoramic Semantic Segmentation," arXiv preprint arXiv:2306.03403, Jun. 2023. [Online]. Available: [link].
C. Ma, J. Zhang, K. Yang, A. Roitberg, and R. Stiefelhagen, "DensePASS: Dense Panoramic Semantic Segmentation via Unsupervised Domain Adaptation with Attention-Augmented Context Exchange," arXiv preprint arXiv:2108.06383, Aug. 2021. [Online]. Available: [link].
OpenAI, "GPT-4o mini: advancing cost-efficient intelligence," OpenAI Blog, Jul. 11, 2024. [Online]. Available: [link]
Blockade Labs, "Skybox AI: Generate 360° Skyboxes with AI," 2024. [Online]. Available: [link].
B. E. A. Sekachev et al. "opencv/cvat: v1.1.0," Zenodo, 2020. [Online]. DOI: 10.5281/zenodo.4009388
Z. S. See and A. D. Cheok, "Virtual Reality 360 Interactive Panorama Reproduction: Obstacles and Issues," Virtual Reality, vol. 19, no. 2, pp. 71–81, Jun. 2015. [Online]. DOI: 10.1007/s10055-014-0258-9.
J. Rantala et al. "Recall of Odorous Objects in Virtual Reality," Multimodal Technologies and Interaction, vol. 8, no. 6, p. 42, May 2024. [Online]. DOI: 10.3390/mti8060042.
A. Z. Sarabian, Integration of Olfactory Stimuli in a Virtual Reality Experience for People with Dementia, Master’s thesis, Technical University Eindhoven, Jun. 2024. [Online]. Available: [link].
S. Smid, Antonin. Comparison of unity and unreal engine. Bachelor Project, Czech Technical University in Prague, 2017, pp. 41-61. Available: [link]
Liu, M. et al. A star-nose-like tactile-olfactory bionic sensing array for robust object recognition in non-visual environments. Nat. Commun. 13, 1–10 (2022).
Nakamoto, T. Ito, S. Kato, S. & Qi, G. P. Multicomponent olfactory display using solenoid valves and SAW atomizer and its blending-capability evaluation. IEEE Sens. J. 18, 5213–5218 (2018).
Goh M. C. Kanagaraj E. Kamarudin L. M. Zakaria A. Nishizaki H. Mao X. Y. (2019). DOI: 10.1109/SENSORSNANO44414.2019.8940094,
Publicado
30/09/2025
Como Citar
SILVA, Meryck F. B. Da et al.
An Immersive Olfactory VR Framework: Integrating Virtual Field Environments with Real-Time Scent Delivery via MQTT. In: SIMPÓSIO DE REALIDADE VIRTUAL E AUMENTADA (SVR), 27. , 2025, Salvador/BA.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2025
.
p. 120-129.
