Would you mind? Evaluating User Acceptance and Usability of a Brain-Interface System in an Industrial Scenario
Resumo
Industry new ages demand its operator knowledge and mastery of interaction with emergent technologies. Virtual Reality (VR), Augmented Reality (AR), the Internet of Things (IoT), and Brain-Computer Interface (BCI) are some examples of technologies that are shaping how humans interact with industrial systems. VR technologies and BCI have become more prevalent due to price reduction and ergonomics. This work evaluates a VR scenario controlled by users using a brain-interface system. We explore a real-world mining industry case reproduced in an immersive environment. This study aims to evaluate users’ usability and acceptance of technology. Data from 26 participants were analyzed to investigate how prior VR experience influenced perceptions of usability (via SUS scores) and technology acceptance factors (via TAM questionnaire), including perceived ease of use (PEOU), perceived usefulness (PU), attitude toward use (ATU) and behavioral intention to use (BIU). The SUS average results (77.04 ± 14.79) and the ATU and BIU averages (4.52 and 4.60) indicate that the technology had an above-average global acceptance when compared with the literature, including an attitude and will to use the technology in the future. Statistical analyses include ANOVA and post-hoc tests to compare groups stratified by VR experience (novices to frequent users). ANOVA results demonstrated significant differences across VR experience groups: frequent users (>3 VR sessions) reported higher SUS scores (M = 90) and TAM ratings (e.g., BIU: M = 4.75) compared to novices (SUS: M = 65; BIU: M = 3.5). Qualitative feedback collected after the experiments highlighted usability barriers for novices, such as calibration delays and discomfort, while frequent users emphasized the system’s innovation.
Palavras-chave:
Virtual Reality, Brain Computer Interface, Industry, Human Interaction
Referências
Lasi, H. Fettke, P. Kemper, H. G. Feld, T. and Hoffmann, M. Industry 4.0. Business and Information Systems Engineering, 6:239–242, 2014.
Leng, J. Sha, W. Wang, B. Zheng, P. Zhuang, C. Liu, Q. Wuest, T. Mourtzis, D. and Wang, L. Industry 5.0 Prospect and retrospect. Journal of Manufacturing Systems, 65:279–295, 2022. Available [link]
Villani, V. Gabbi, M. and Sabattini, L. Promoting operator’s wellbeing in industry 5.0 detecting mental and physical fatigue. In 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2030–2036, 2022.
Pedram, S. Perez, P. Palmisano, S. and Farrelly, M. Evaluating 360-virtual reality for mining industry’s safety training. In HCI International 2017 – Posters’ Extended Abstracts 19th International Conference, Vancouver, Canada, July 9–14, 2017, 555–561. Springer Verlag.
Scorgie, D. Feng, Z. Paes, D. Parisi, F. Yiu, T. W. and Lovreglio, R. Virtual reality for safety training a systematic literature review and meta-analysis, 2024.
Werbinska-Wojciechowska, S. and Winiarska, K. Maintenance performance in the age of industry 4.0 a bibliometric performance analysis and systematic review, 2023.
Guo, Z. Zhou, D. Zhou, Q. Zhang, X. Geng, J. Zeng, S. Lv, C. and Hao, A. Applications of virtual reality in maintenance during the industrial product lifecycle a systematic review. Journal of Manufacturing Systems, 56:525–538, 2020.
Douibi, K. Le Bars, S. Lemontey, A. Nag, L. Balp, R. and Breda, G. Toward EEG-based BCI applications for industry 4.0 challenges and possible applications. Frontiers in Human Neuroscience, 15, 2021.
Kober, S. E. and Neuper, C. Using auditory event-related EEG potentials to assess presence in virtual reality. International Journal of Human–Computer Studies, 70(9):577–587, 2012.
Yadav, D. Yadav, S. and Veer, K. A comprehensive assessment of brain computer interfaces recent trends and challenges. Journal of Neuroscience Methods, 2020.
Kawala-Sterniuk, A. Browarska, N. Al-Bakri, A. Pelc, M. Zygarlicki, J. Sidikova, M. Martinek, R. and Gorzelanczyk, E. J. Summary of over fifty years with brain-computer interfaces a review. Brain Sciences, 11(1), 2021.
Gu, X. Cao, Z. Jolfaei, A. Xu, P. Wu, D. Jung, T. P. and Lin, C. T. EEG-based brain-computer interfaces BCIs a survey of recent studies on signal sensing technologies and computational intelligence approaches and their applications. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 18(5):1645–1666, 2021.
Martinez-Cagigal, V. Thielen, J. Santamaria-Vazquez, E. Perez-Velasco, S. Desain, P. and Hornero, R. Brain–computer interfaces based on code-modulated visual evoked potentials c-VEP a literature review. Journal of Neural Engineering, 18, 2021.
Moreno-Calderon, S. Martinez-Cagigal, V. Santamaria-Vazquez, E. Perez-Velasco, S. Marcos-Martinez, D. and Hornero, R. Combining brain-computer interfaces and multiplayer video games an application based on c-VEPs. Frontiers in Human Neuroscience, 17, 2023. Available [link]
Lanier, J. and Biocca, F. An insider’s view of the future of virtual reality. Journal of Communication, 42(4):150–172, 1992.
Lin, J. W. Duh, H. Parker, D. Abi-Rached, H. and Furness, T. Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment. Proceedings IEEE Virtual Reality 2002, 164–171, 2002.
Havig, P. McIntire, J. and Geiselman, E. Virtual reality in a cave limitations and the need for HMDs. Proceedings of SPIE The International Society for Optical Engineering, 8041, 2011.
Kyrlitsias, C. and Michael-Grigoriou, D. Social interaction with agents and avatars in immersive virtual environments a survey. Frontiers in Virtual Reality, 2, 2022.
Chalmers, D. J. The virtual and the real. Disputatio, 9(46):309–352, 2017.
Grabowski, A. and Jankowski, J. Virtual reality-based pilot training for underground coal miners. Safety Science, 72:310–314, 2015.
Takac, M. Collett, J. Blom, K. Conduit, R. Rehm, I. and Foe, A. Public speaking anxiety decreases within repeated virtual reality training sessions. PLOS ONE, 14:e0216288, 2019.
Cyrino, G. F. and Correa Viana, J. SBCI 3D simulator with brain-computer interface and virtual reality. 2016 XVIII Symposium on Virtual and Augmented Reality (SVR), 135–139, 2016.
Berger, L. M. Wood, G. and Kober, S. E. Effects of virtual reality-based feedback on neurofeedback training performance a sham-controlled study. Frontiers in Human Neuroscience, 16, 2022.
Bano, F. Alomar, M. A. Alotaibi, F. M. Serbaya, S. H. Rizwan, A. and Hasan, F. Leveraging virtual reality in engineering education to optimize manufacturing sustainability in industry 4.0. Sustainability, 16(18), 2024. Available [link]
Paszkiewicz, A. Salach, M. Dymora, P. Bolanowski, M. Budzik, G. and Kubiak, P. Methodology of implementing virtual reality in education for industry 4.0. Sustainability, 13(9), 2021.
Pottle, J. Virtual reality and the transformation of medical education. Future Healthcare Journal, 6(3):181, 2019.
Pedram, S. Skarbez, R. Palmisano, S. Farrelly, M. and Perez, P. Lessons learned from immersive and desktop VR training of mines rescuers. Frontiers in Virtual Reality, 2, 2021.
Arpaia, P. Esposito, A. Galasso, E. Galdieri, F. Natalizio, A. Parvis, M. Sommeling, M. and Volpe, M. Endless runner game in virtual reality controlled by a self-paced brain-computer interface based on EEG and motor imagery. In Extended Reality, Springer Nature, Cham, 208–225, 2024.
Weelden, E. V. van Beek, C. W. E. Alimardani, M. Wiltshire, T. J. Ledegang, W. D. Groen, E. L. and Louwerse, M. M. A passive brain-computer interface for predicting pilot workload in virtual reality flight training. 2024 IEEE 4th International Conference on Human-Machine Systems (ICHMS), 1–6, 2024.
Nwagu, C. AlSlaity, A. and Orji, R. EEG-based brain-computer interactions in immersive virtual and augmented reality a systematic review. Proceedings of the ACM on Human-Computer Interaction, 7(EICS), 2023. DOI: 10.1145/3593226
Pontifex, M. and Coffman, C. Validation of the g.tec Unicorn Hybrid Black wireless EEG system. Psychophysiology, 60:e14320, 2023.
Marangunic, N. and Granic, A. Technology acceptance model a literature review from 1986 to 2013. Universal Access in the Information Society, 14(1):81–95, 2015. DOI: 10.1007/s10209-014-0348-1
Pears, M. Rochester, M. Wadhwa, K. Payne, S. R. Konstantinidis, S. Hanchanale, V. Elmamoun, M. H. Biyani, C. S. and Doherty, R. A pilot study evaluating a virtual reality-based nontechnical skills training application for urology trainees usability, acceptability, and impact. Journal of Surgical Education, 80(12):1836–1842, 2023.
Aardoom, J. J. Hilt, A. D. Woudenberg, T. Chavannes, N. H. and Atsma, D. E. A preoperative virtual reality app for patients scheduled for cardiac catheterization pre–post questionnaire study examining feasibility, usability, and acceptability. JMIR Cardio, 6(1):e29473, 2022.
Xu, W. Liang, H. N. Baghaei, N. Ma, X. Yu, K. Meng, X. and Wen, S. Effects of an immersive virtual reality exergame on university students’ anxiety, depression, and perceived stress pilot feasibility and usability study. JMIR Serious Games, 9(4):e29330, 2021.
Leng, J. Sha, W. Wang, B. Zheng, P. Zhuang, C. Liu, Q. Wuest, T. Mourtzis, D. and Wang, L. Industry 5.0 Prospect and retrospect. Journal of Manufacturing Systems, 65:279–295, 2022. Available [link]
Villani, V. Gabbi, M. and Sabattini, L. Promoting operator’s wellbeing in industry 5.0 detecting mental and physical fatigue. In 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2030–2036, 2022.
Pedram, S. Perez, P. Palmisano, S. and Farrelly, M. Evaluating 360-virtual reality for mining industry’s safety training. In HCI International 2017 – Posters’ Extended Abstracts 19th International Conference, Vancouver, Canada, July 9–14, 2017, 555–561. Springer Verlag.
Scorgie, D. Feng, Z. Paes, D. Parisi, F. Yiu, T. W. and Lovreglio, R. Virtual reality for safety training a systematic literature review and meta-analysis, 2024.
Werbinska-Wojciechowska, S. and Winiarska, K. Maintenance performance in the age of industry 4.0 a bibliometric performance analysis and systematic review, 2023.
Guo, Z. Zhou, D. Zhou, Q. Zhang, X. Geng, J. Zeng, S. Lv, C. and Hao, A. Applications of virtual reality in maintenance during the industrial product lifecycle a systematic review. Journal of Manufacturing Systems, 56:525–538, 2020.
Douibi, K. Le Bars, S. Lemontey, A. Nag, L. Balp, R. and Breda, G. Toward EEG-based BCI applications for industry 4.0 challenges and possible applications. Frontiers in Human Neuroscience, 15, 2021.
Kober, S. E. and Neuper, C. Using auditory event-related EEG potentials to assess presence in virtual reality. International Journal of Human–Computer Studies, 70(9):577–587, 2012.
Yadav, D. Yadav, S. and Veer, K. A comprehensive assessment of brain computer interfaces recent trends and challenges. Journal of Neuroscience Methods, 2020.
Kawala-Sterniuk, A. Browarska, N. Al-Bakri, A. Pelc, M. Zygarlicki, J. Sidikova, M. Martinek, R. and Gorzelanczyk, E. J. Summary of over fifty years with brain-computer interfaces a review. Brain Sciences, 11(1), 2021.
Gu, X. Cao, Z. Jolfaei, A. Xu, P. Wu, D. Jung, T. P. and Lin, C. T. EEG-based brain-computer interfaces BCIs a survey of recent studies on signal sensing technologies and computational intelligence approaches and their applications. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 18(5):1645–1666, 2021.
Martinez-Cagigal, V. Thielen, J. Santamaria-Vazquez, E. Perez-Velasco, S. Desain, P. and Hornero, R. Brain–computer interfaces based on code-modulated visual evoked potentials c-VEP a literature review. Journal of Neural Engineering, 18, 2021.
Moreno-Calderon, S. Martinez-Cagigal, V. Santamaria-Vazquez, E. Perez-Velasco, S. Marcos-Martinez, D. and Hornero, R. Combining brain-computer interfaces and multiplayer video games an application based on c-VEPs. Frontiers in Human Neuroscience, 17, 2023. Available [link]
Lanier, J. and Biocca, F. An insider’s view of the future of virtual reality. Journal of Communication, 42(4):150–172, 1992.
Lin, J. W. Duh, H. Parker, D. Abi-Rached, H. and Furness, T. Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment. Proceedings IEEE Virtual Reality 2002, 164–171, 2002.
Havig, P. McIntire, J. and Geiselman, E. Virtual reality in a cave limitations and the need for HMDs. Proceedings of SPIE The International Society for Optical Engineering, 8041, 2011.
Kyrlitsias, C. and Michael-Grigoriou, D. Social interaction with agents and avatars in immersive virtual environments a survey. Frontiers in Virtual Reality, 2, 2022.
Chalmers, D. J. The virtual and the real. Disputatio, 9(46):309–352, 2017.
Grabowski, A. and Jankowski, J. Virtual reality-based pilot training for underground coal miners. Safety Science, 72:310–314, 2015.
Takac, M. Collett, J. Blom, K. Conduit, R. Rehm, I. and Foe, A. Public speaking anxiety decreases within repeated virtual reality training sessions. PLOS ONE, 14:e0216288, 2019.
Cyrino, G. F. and Correa Viana, J. SBCI 3D simulator with brain-computer interface and virtual reality. 2016 XVIII Symposium on Virtual and Augmented Reality (SVR), 135–139, 2016.
Berger, L. M. Wood, G. and Kober, S. E. Effects of virtual reality-based feedback on neurofeedback training performance a sham-controlled study. Frontiers in Human Neuroscience, 16, 2022.
Bano, F. Alomar, M. A. Alotaibi, F. M. Serbaya, S. H. Rizwan, A. and Hasan, F. Leveraging virtual reality in engineering education to optimize manufacturing sustainability in industry 4.0. Sustainability, 16(18), 2024. Available [link]
Paszkiewicz, A. Salach, M. Dymora, P. Bolanowski, M. Budzik, G. and Kubiak, P. Methodology of implementing virtual reality in education for industry 4.0. Sustainability, 13(9), 2021.
Pottle, J. Virtual reality and the transformation of medical education. Future Healthcare Journal, 6(3):181, 2019.
Pedram, S. Skarbez, R. Palmisano, S. Farrelly, M. and Perez, P. Lessons learned from immersive and desktop VR training of mines rescuers. Frontiers in Virtual Reality, 2, 2021.
Arpaia, P. Esposito, A. Galasso, E. Galdieri, F. Natalizio, A. Parvis, M. Sommeling, M. and Volpe, M. Endless runner game in virtual reality controlled by a self-paced brain-computer interface based on EEG and motor imagery. In Extended Reality, Springer Nature, Cham, 208–225, 2024.
Weelden, E. V. van Beek, C. W. E. Alimardani, M. Wiltshire, T. J. Ledegang, W. D. Groen, E. L. and Louwerse, M. M. A passive brain-computer interface for predicting pilot workload in virtual reality flight training. 2024 IEEE 4th International Conference on Human-Machine Systems (ICHMS), 1–6, 2024.
Nwagu, C. AlSlaity, A. and Orji, R. EEG-based brain-computer interactions in immersive virtual and augmented reality a systematic review. Proceedings of the ACM on Human-Computer Interaction, 7(EICS), 2023. DOI: 10.1145/3593226
Pontifex, M. and Coffman, C. Validation of the g.tec Unicorn Hybrid Black wireless EEG system. Psychophysiology, 60:e14320, 2023.
Marangunic, N. and Granic, A. Technology acceptance model a literature review from 1986 to 2013. Universal Access in the Information Society, 14(1):81–95, 2015. DOI: 10.1007/s10209-014-0348-1
Pears, M. Rochester, M. Wadhwa, K. Payne, S. R. Konstantinidis, S. Hanchanale, V. Elmamoun, M. H. Biyani, C. S. and Doherty, R. A pilot study evaluating a virtual reality-based nontechnical skills training application for urology trainees usability, acceptability, and impact. Journal of Surgical Education, 80(12):1836–1842, 2023.
Aardoom, J. J. Hilt, A. D. Woudenberg, T. Chavannes, N. H. and Atsma, D. E. A preoperative virtual reality app for patients scheduled for cardiac catheterization pre–post questionnaire study examining feasibility, usability, and acceptability. JMIR Cardio, 6(1):e29473, 2022.
Xu, W. Liang, H. N. Baghaei, N. Ma, X. Yu, K. Meng, X. and Wen, S. Effects of an immersive virtual reality exergame on university students’ anxiety, depression, and perceived stress pilot feasibility and usability study. JMIR Serious Games, 9(4):e29330, 2021.
Publicado
30/09/2025
Como Citar
COELHO, Mateus Nazario; JARDIM, João Victor; SILVA, Mateus Coelho; GLASS, Roberta; SILVAS, Flávia; DELABRIDA, Saul.
Would you mind? Evaluating User Acceptance and Usability of a Brain-Interface System in an Industrial Scenario. In: SIMPÓSIO DE REALIDADE VIRTUAL E AUMENTADA (SVR), 27. , 2025, Salvador/BA.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2025
.
p. 363-372.
