Use of immersive technologies for behavior assessment and their implementation challenges in Industry

• Mateus Nazário Coelho UFOP
• Saul Delabrida UFOP
• Flávia Silvas UFOP

DOI: https://doi.org/10.5753/ihc_estendido.2024.242072

Abstract

Recent researches show promising results on immersive technologies, as they provide a safe and effective tool for representing hazardous environments that are often difficult to replicate in the real world. However, there is a gap in research on behavioral changes in users after using these technologies and on what the challenges would be for implementing them in the Industry, in addition to not evaluating the effectiveness of using industrial processes and training. This work seeks to evaluate and answer these questions using a case study in the Mining Industry, by using modern technologies for this evaluation.

References

Adhanom, I. B., MacNeilage, P., and Folmer, E. (2023). Correction to: Eye tracking in virtual reality: a broad review of applications and challenges. Virtual Reality, 27(2):1569– 1570.

Bailey, G. S., Arruda, D. G., and Stoffregen, T. A. (2022). Using quantitative data on postural activity to develop methods to predict and prevent cybersickness. Frontiers in Virtual Reality, 3:1001080.

Fernandes, P., Delabrida, S., Coelho, B., and Silvas, F. (2023). Avaliação da inclusão de operadores na indústria 4.0 por meio de instalações interativas virtuais: Caso de estudo de carregamento de vagões na mineração. In Anais Estendidos do XXII Simpósio Brasileiro de Fatores Humanos em Sistemas Computacionais, pages 204–208, Porto Alegre, RS, Brasil. SBC.

Grabowski, A. and Jankowski, J. (2015). Virtual reality-based pilot training for underground coal miners. Safety Science, 72:310–314.

Guo, Z., Zhou, D., Zhou, Q., Zhang, X., Geng, J., Zeng, S., Lv, C., and Hao, A. (2020). Applications of virtual reality in maintenance during the industrial product lifecycle: A systematic review. Journal of Manufacturing Systems, 56:525–538.

Havig, P., McIntire, J., and Geiselman, E. (2011). Virtual reality in a cave: Limitations and the need for hmds? Proceedings of SPIE - The International Society for Optical Engineering, 8041:58–63.

Howard, M. C. and Zandt, E. C. V. (2021). A meta-analysis of the virtual reality problem: Unequal effects of virtual reality sickness across individual differences. Virtual Reality, 25(4):1221–1246.

Isar, C. (2018). A glance into virtual reality development using unity. Informatica Economica, 22(3):14–22.

Kober, S. E. and Neuper, C. (2012). Using auditory event-related eeg potentials to assess presence in virtual reality. International Journal of Human-Computer Studies, 70(9):577–587.

Lanier, J. and Biocca, F. (1992). An insider’s view of the future of virtual reality. Journal of Communication, 42(4):150–172.

Nguyen, V. T. and Dang, T. (2017). Setting up virtual reality and augmented reality learning environment in unity. In Adjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017, pages 315–320. Institute of Electrical and Electronics Engineers Inc.

Nouira, A., Cheniti-Belcadhi, L., and Braham, R. (2018). An enhanced xapi data model supporting assessment analytics. Procedia Computer Science, 126:566–575. Knowledge-Based and Intelligent Information And Engineering Systems: Proceedings of the 22nd International Conference, KES-2018, Belgrade, Serbia.

Pedram, S., Perez, P., Palmisano, S., and Farrelly, M. (2017). Evaluating 360-virtual reality for mining industry’s safety training. In HCI International 2017–Posters’ Extended Abstracts: 19th International Conference, HCI International 2017, Vancouver, BC, Canada, July 9–14, 2017, Proceedings, Part I 19, volume 713, pages 555–561. Springer Verlag.

Stefan, H., Mortimer, M., and Horan, B. (2023). Evaluating the effectiveness of virtual reality for safety-relevant training: a systematic review. Virtual Reality, 27(4):2839 – 2869.

Vidal, J. C., Rabelo, T., and Lama, M. (2015). Semantic description of the experience api specification. In Proceedings - IEEE 15th International Conference on Advanced Learning Technologies: Advanced Technologies for Supporting Open Access to Formal and Informal Learning, ICALT 2015, page 268 – 269.

Villani, V., Gabbi, M., and Sabattini, L. (2022). Promoting operator’s wellbeing in industry 5.0: detecting mental and physical fatigue. In 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pages 2030–2036.

Yadav, D., Yadav, S., and Veer, K. (2020). A comprehensive assessment of brain computer interfaces: Recent trends and challenges. Journal of Neuroscience Methods, 346:108918.