Immersive Environment with Virtual Reality and Eyetracking in the Public Sector: Modernization of the TCE-GO Server onboarding and Training Process

• Leonardo Oliveira Lima TCE-GO / AKCIT
• Jaqueline Gonçalvez do Nascimento AKCIT
• Pedro Koziel Deniz AKCIT / AbTech DataSolutions
• Judson Luiz Paz Vieira AKCIT / AbTech DataSolutions
• Carolina Horta Andrade AKCIT
• Meryck F. B. da Silva AKCIT / PUC Goiás / AbTech DataSolutions

DOI: https://doi.org/10.5753/svr_estendido.2025.15789

Resumo

The combination of virtual reality (VR) and biofeedback technologies, such as eye tracking, offers new possibilities for measuring user presence and attentional focus in immersive environments. In the context of institutional training, this synergy proves particularly promising. This study presents a proposed VR-based onboarding and training platform for new employees of the Court of Accounts of the State of Goiás (TCE-GO), with a focus on visual attention measurement. By employing 3D modeling, integration with eye tracking technology, and data analysis through AI models, the project aims not only to familiarize new employees with the court’s workflows but also to train technical skills and objectively assess their levels of engagement. The research is grounded in the Design Science Research (DSR) methodology, encompassing the design and development of the onboarding environment. Expected outcomes include increased efficiency and scalability in the training process, as well as a pioneering application of VR and biofeedback in employee training for Courts of Accounts.

Palavras-chave: Virtual Reality, Eye Tracking, Employee Training, Public Sector

Referências

Clay, V., König, P., and König, S. (2019). Eye tracking in virtual reality. J. Eye Mov. Res., 12(1).

Duchowski, A. T. (2017). Eye tracking methodology. Springer International Publishing, Cham, Switzerland, 3 edition.

Grassini, Simone e Laumann, K. e. R. S. M. (2020). O uso da realidade virtual por si só não promove o desempenho no treinamento (mas o senso de presença sim). Front. Psychol., 11:1743.

Hevner, March, Park, and Ram (2004). Design science in information systems research. MIS Q, 28(1):75.

Lamas, D., Loizides, F., Nacke, L., Petrie, H., Winckler, M., and Zaphiris, P., editors (2019). Human-computer interaction – INTERACT 2019. Lecture notes in computer science. Springer Nature, Cham, Switzerland, 2019 edition.

Nasri, M. (2025). Towards intelligent VR training: A physiological adaptation framework for cognitive load and stress detection. In Proceedings of the 33rd ACM Conference on User Modeling, Adaptation and Personalization, pages 419–423, New York, NY, USA. ACM.

Nasri, M., Kosa, M., Chukoskie, L., Moghaddam, M., and Harteveld, C. (2024). Exploring eye tracking to detect cognitive load in complex virtual reality training.

Pastel, Stefan e Marlok, J. e. B. N. e. W. K. Aplicação de sistemas de rastreamento ocular integrados à realidade virtual imersiva e possível transferência para o setor esportivo - uma revisão sistemática. 82(3).

Radianti, J., Majchrzak, T. A., Fromm, J., and Wohlgenannt, I. (2020). A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda. Comput. Educ., 147(103778):103778.

Receita Federal. Receita federal inicia treinamentos com realidade virtual para combater o contrabando e descaminho.

Ye, G. (2024). Police virtual simulation training system based on augmented reality technology. In Proceedings of the 2024 3rd International Conference on Algorithms, Data Mining, and Information Technology, pages 191–197, New York, NY, USA. ACM.