Evaluating Virtual Reality Simulations for Wheel Loader Inspection
Resumo
In this study, a virtual reality simulation game for the inspection of a wheel loader is proposed. It has a cost-effective way to provide training and to monitor the performance of machinery operators in a mining company. This game is used during their mandatory pre-operation safety inspection, a tool that is otherwise nonexistent for their specific needs. The simulator was developed using a game engine and built to operate with different virtual reality headsets. It aims to use a guide to perform inspection procedures on a wheel loader of a mining company. A team of professional collaborators from the mining company evaluated the simulator under several scenarios. The computational results showed that the simulator provided the employees with an initial experience before conducting an actual field inspection of the wheel loader. In this sense, the simulator increases the safety of employees and does not expose them to risky situations, owing to a deeper knowledge of inspection procedures. Moreover, the simulator has a lower cost compared to an outsourced contract and can decrease machine downtime. Finally, the simulator is effective for training because it provides professional employees with a sense of realism.
Palavras-chave:
Virtual reality, Training simulation, Serious game, Inspection, Virtual environment
Referências
Z. Guo, D. Zhou, Q. Zhou, X. Zhang, J. Geng, S. Zeng, C. Lv, and A. Hao. 2020. Applications of virtual reality in maintenance during the industrial product lifecycle: A systematic review, Journal of Manufacturing Systems, vol. 56, p. 525-538.
Wenmin Zhu, Xiumin Fan, and Yanxin Zhang. 2019. Applications and research trends of digital human models in the manufacturing industry, Virtual Reality & Intelligent Hardware, vol. 1, n. 6, p. 558-579.
T. R. d. Oliveira, T. F. Martinelli, B. P. Bello, J. D. Batista, M. M. d. Silva, B. B. Rodrigues, R. A. N. Spinassé, M. Q. Schimidt, R. V. Andreão, and M. Mestria. 2020. Virtual Reality System for Industrial Motor Maintenance Training. In 22nd Symposium on Virtual and Augmented Reality (SVR), Porto de Galinhas, Brazil, p. 119-128.
L. Jiang. 2021. Research on 3D simulation of swimming technique training based on FPGA and virtual reality technology, Microprocessors and Microsystems, vol. 81, p. 103657.
Henrik Eschen, Tobias Kotter, Rebecca Rodeck, Martin Harnisch and Thorsten Schüppstuhl. 2017. Augmented and Virtual Reality for Inspection and Maintenance Processes in the Aviation Industry. 6th International Conference on Through-life Engineering Services, TESConf 2017. Bremen, Germany.
S. Dadhich. 2018. Automation of wheel-loaders. PhD dissertation. Department of Computer Science, Electrical and Space Engineering. Lulea University of Technology, Sweden. 219 pp.
X. Wang and Xiuyue Wang. 2018. Virtual Reality Training System for Surgical Anatomy. In Proceedings of the 2018 International Conference on Artificial Intelligence and Virtual Reality (AIVR 2018). Association for Computing Machinery, New York, NY, USA, p. 30-34.
Noelle E. Carlozzi, Venkata Gade, Albert Skip Rizzo, and David S. Tulsky. 2013. Using virtual reality driving simulators in persons with spinal cord injury: three screen display versus head mounted display, Disability and Rehabilitation: Assistive Technology, vol. 8, n. 2, p. 176-180.
Luis Pérez, Eduardo Diez, Rubén Usamentiaga, and Daniel F. García. 2019. Industrial robot control and operator training using virtual reality interfaces, Computers in Industry, vol. 109, p. 114-120.
Markus Jelonek, Eileen Fiala, Thomas Herrmann, Jochen Teizer, Stephan Embers, Markus König, and Arno Mathis. 2022. Evaluating Virtual Reality Simulations for Construction Safety Training: A User Study Exploring Learning Effects, Usability and User Experience, vol. 21, n. 2, p. 269-281.
Zhou Zhengdong, Zhang Lingwei, Wei Shisong, Zhang Xuling, and Mao Ling. 2022. Development and evaluation of BCI for operating VR flight simulator based on desktop VR equipment, Advanced Engineering Informatics, vol. 51, p. 101499.
C. Sinnott, S. Halow, J. Mulligan, J. Liu, A. Jones, M. Crognale, P. MacNeilage, C. Matera, M. Moroz, and E. Folmer. 2019. Underwater Virtual Reality System for Neutral Buoyancy Training: Development and Evaluation. 25th ACM Symposium on Virtual Reality Software and Technology (VRST), p. 1-9.
A. Nguyen, P. Wüest, and A. Kunz. 2020. Human Following Behavior In Virtual Reality. 26th ACM Symposium on Virtual Reality Software and Technology (VRST), p. 1-3.
J. Creutzfeldt, L. Hedman, and L. Felländer-Tsai. Effects of pre-training using serious game technology on CPR performance – an exploratory quasiexperimental transfer study. 2012. Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine, vol. 20, n. 79.
Z. Liang, K. Zhou, and K. Gao. 2019. Development of Virtual Reality Serious Game for Underground Rock-Related Hazards Safety Training, IEEE Access, vol. 7, p. 118639-118649.
Jacob Belga, Tiffany D. Do, Ryan Ghamandi, Ryan P. McMahan, and Joseph J. LaViola. 2022. Carousel: Improving the Accuracy of Virtual Reality Assessments for Inspection Training Tasks. In Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (VRST '22). Association for Computing Machinery, New York, NY, USA, Article 1, 1-10. https://doi.org/10.1145/3562939.3565618
Huai Jian Beh, Ali Rashidi, Amin Talei, and Yee Sye Lee. 2022. Developing engineering students’ capabilities through game-based virtual reality technology for building utility inspection. Engineering, Construction and Architectural Management, vol. 29, n. 7, p. 2854-2877. https://doi.org/10.1108/ECAM-02-2021-0174
Daeyeol Chang, James Hopfenblatt, Praveen Edara, and Bimal Balakrishnan. 2020. Immersive Virtual Reality Training for Inspecting Flagger Work zones. In 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR). IEEE, p. 327-330.
Wanwan Li, Haikun Huang, Tomay Solomon, Behzad Esmaeili, and Lap-Fai Yu. 2022. Synthesizing Personalized Construction Safety Training Scenarios for VR Training. IEEE Transactions on Visualization and Computer Graphics vol. 28, n. 5, p. 1993-2002.
Federico De Lorenzis, Filippo Gabriele Pratticò, Maurizio Repetto, Enrico Pons, Fabrizio Lamberti. 2023. Immersive Virtual Reality for procedural training: Comparing traditional and learning by teaching approaches. Computers in Industry, vol. 144, p. 103785. https://doi.org/10.1016/j.compind.2022.103785
Wenmin Zhu, Xiumin Fan, and Yanxin Zhang. 2019. Applications and research trends of digital human models in the manufacturing industry, Virtual Reality & Intelligent Hardware, vol. 1, n. 6, p. 558-579.
T. R. d. Oliveira, T. F. Martinelli, B. P. Bello, J. D. Batista, M. M. d. Silva, B. B. Rodrigues, R. A. N. Spinassé, M. Q. Schimidt, R. V. Andreão, and M. Mestria. 2020. Virtual Reality System for Industrial Motor Maintenance Training. In 22nd Symposium on Virtual and Augmented Reality (SVR), Porto de Galinhas, Brazil, p. 119-128.
L. Jiang. 2021. Research on 3D simulation of swimming technique training based on FPGA and virtual reality technology, Microprocessors and Microsystems, vol. 81, p. 103657.
Henrik Eschen, Tobias Kotter, Rebecca Rodeck, Martin Harnisch and Thorsten Schüppstuhl. 2017. Augmented and Virtual Reality for Inspection and Maintenance Processes in the Aviation Industry. 6th International Conference on Through-life Engineering Services, TESConf 2017. Bremen, Germany.
S. Dadhich. 2018. Automation of wheel-loaders. PhD dissertation. Department of Computer Science, Electrical and Space Engineering. Lulea University of Technology, Sweden. 219 pp.
X. Wang and Xiuyue Wang. 2018. Virtual Reality Training System for Surgical Anatomy. In Proceedings of the 2018 International Conference on Artificial Intelligence and Virtual Reality (AIVR 2018). Association for Computing Machinery, New York, NY, USA, p. 30-34.
Noelle E. Carlozzi, Venkata Gade, Albert Skip Rizzo, and David S. Tulsky. 2013. Using virtual reality driving simulators in persons with spinal cord injury: three screen display versus head mounted display, Disability and Rehabilitation: Assistive Technology, vol. 8, n. 2, p. 176-180.
Luis Pérez, Eduardo Diez, Rubén Usamentiaga, and Daniel F. García. 2019. Industrial robot control and operator training using virtual reality interfaces, Computers in Industry, vol. 109, p. 114-120.
Markus Jelonek, Eileen Fiala, Thomas Herrmann, Jochen Teizer, Stephan Embers, Markus König, and Arno Mathis. 2022. Evaluating Virtual Reality Simulations for Construction Safety Training: A User Study Exploring Learning Effects, Usability and User Experience, vol. 21, n. 2, p. 269-281.
Zhou Zhengdong, Zhang Lingwei, Wei Shisong, Zhang Xuling, and Mao Ling. 2022. Development and evaluation of BCI for operating VR flight simulator based on desktop VR equipment, Advanced Engineering Informatics, vol. 51, p. 101499.
C. Sinnott, S. Halow, J. Mulligan, J. Liu, A. Jones, M. Crognale, P. MacNeilage, C. Matera, M. Moroz, and E. Folmer. 2019. Underwater Virtual Reality System for Neutral Buoyancy Training: Development and Evaluation. 25th ACM Symposium on Virtual Reality Software and Technology (VRST), p. 1-9.
A. Nguyen, P. Wüest, and A. Kunz. 2020. Human Following Behavior In Virtual Reality. 26th ACM Symposium on Virtual Reality Software and Technology (VRST), p. 1-3.
J. Creutzfeldt, L. Hedman, and L. Felländer-Tsai. Effects of pre-training using serious game technology on CPR performance – an exploratory quasiexperimental transfer study. 2012. Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine, vol. 20, n. 79.
Z. Liang, K. Zhou, and K. Gao. 2019. Development of Virtual Reality Serious Game for Underground Rock-Related Hazards Safety Training, IEEE Access, vol. 7, p. 118639-118649.
Jacob Belga, Tiffany D. Do, Ryan Ghamandi, Ryan P. McMahan, and Joseph J. LaViola. 2022. Carousel: Improving the Accuracy of Virtual Reality Assessments for Inspection Training Tasks. In Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (VRST '22). Association for Computing Machinery, New York, NY, USA, Article 1, 1-10. https://doi.org/10.1145/3562939.3565618
Huai Jian Beh, Ali Rashidi, Amin Talei, and Yee Sye Lee. 2022. Developing engineering students’ capabilities through game-based virtual reality technology for building utility inspection. Engineering, Construction and Architectural Management, vol. 29, n. 7, p. 2854-2877. https://doi.org/10.1108/ECAM-02-2021-0174
Daeyeol Chang, James Hopfenblatt, Praveen Edara, and Bimal Balakrishnan. 2020. Immersive Virtual Reality Training for Inspecting Flagger Work zones. In 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR). IEEE, p. 327-330.
Wanwan Li, Haikun Huang, Tomay Solomon, Behzad Esmaeili, and Lap-Fai Yu. 2022. Synthesizing Personalized Construction Safety Training Scenarios for VR Training. IEEE Transactions on Visualization and Computer Graphics vol. 28, n. 5, p. 1993-2002.
Federico De Lorenzis, Filippo Gabriele Pratticò, Maurizio Repetto, Enrico Pons, Fabrizio Lamberti. 2023. Immersive Virtual Reality for procedural training: Comparing traditional and learning by teaching approaches. Computers in Industry, vol. 144, p. 103785. https://doi.org/10.1016/j.compind.2022.103785
Publicado
06/11/2023
Como Citar
BORGES, Luiz Felipe Muniz Rocha; VIANA, Pedro Henrique Porto; DE OLIVEIRA, Tainã Ribeiro; MARTINS, Thiago da Silva; ANDREÃO, Rodrigo Varejão; SCHIMIDT, Marcelo; MESTRIA, Mário.
Evaluating Virtual Reality Simulations for Wheel Loader Inspection. In: SIMPÓSIO DE REALIDADE VIRTUAL E AUMENTADA (SVR), 25. , 2023, Rio Grande/RS.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2023
.
p. 8–16.
