Immersive Data Analysis for Planning Military Operations: Design and Think-Aloud Study
Resumo
The ability to visualize data in immersive environments offers new interpretations that directly impact the outcomes of activities such as military planning, where effective decision-making is vital for mission execution. This work aims to explore the application of VR in military planning as a tool that exploits a metaphor of the sandbox, the current planning approach adding increased possibilities of visualizing training range data in 3D. To achieve this, we designed and developed a prototype that includes a virtual terrain and miniature models and provides interactions based on the sandbox concept. To evaluate the prototype, a user study was conducted with army experts performing a planning task using both conventional methods and VR. Results indicate that VR is a viable alternative with an impact on the decision-making process during military planning. Future research should focus on assessing the effects of multiple conditions with a larger group of participants and investigating additional functionalities such as spatial perception.
Palavras-chave:
Immersive Data Analysis, Virtual Reality, Military Planning
Referências
Mahmoud Albahbah, Serkan Kıvrak, and Gökhan Arslan. 2021. Application areas of augmented reality and virtual reality in construction project management: A scoping review. J. Constr. Eng. Manag. Innov 4 (2021), 151–172.
Sepehr Alizadehsalehi, Ahmad Hadavi, and Joseph Chuenhuei Huang. 2019. Virtual reality for design and construction education environment. AEI 2019: Integrated Building Solutions—The National Agenda (2019), 193–203.
Stéphane Bouchard, Maxine Berthiaume, Geneviève Robillard, Hélène Forget, Camille Daudelin-Peltier, Patrice Renaud, Caroline Blais, and Daniel Fiset. 2021. Arguing in favor of revising the simulator sickness questionnaire factor structure when assessing side effects induced by immersions in virtual reality. Frontiers in Psychiatry 12 (2021), 739742.
BRASIL. Ministério da Defesa. Exército Brasileiro. 2020. PROCESSO DE PLANEJAMENTO E CONDUÇÃO DAS OPERAÇÕES TERRESTRES (PPCOT) (2ª ed.). EGGCF, Brasília.
David Checa and Andres Bustillo. 2020. A review of immersive virtual reality serious games to enhance learning and training. Multimedia Tools and Applications 79 (2020), 5501–5527.
Chien Chou, Hsieh-Lung Hsu, and Yu-Seng Yao. 1997. Construction of a virtual reality learning environment for teaching structural analysis. Computer Applications in Engineering Education 5, 4 (1997), 223–230.
Brasil. Ministério da Defesa. 2021. C21-30: CATÁLOGO DE SÍMBOLOS E CONVENÇÕES CARTOGRÁFICAS DAS FORÇAS ARMADAS. 1ª Edição. Brasília.
Brasil. Ministério da Defesa. Exército Brasileiro. 2019. EB60-ME-13.301: Manual de Ensino Trabalho de Comando. 2ª Edição. EGGCF, Brasília.
Brasil. Ministério da Defesa. Exército Brasileiro. 2021. EB70-CI-11.450: Caderno de Instrução Patrulhas. 1ª Edição. EGGCF, Brasília.
Thiago da Silva Gonçalves and Alberto Barbosa Raposo. 2022. Realidade Virtual como ferramenta de apoio na tomada de decisão no Combate em Ambientes Confinados. In Anais Estendidos do XXIV Simpósio de Realidade Virtual e Aumentada. SBC, 11–15.
Jelia R Domingo and Elizabeth Gates Bradley. 2018. Education student perceptions of virtual reality as a learning tool. Journal of Educational Technology Systems 46, 3 (2018), 329–342.
Adrien Fonnet and Yannick Prie. 2019. Survey of immersive analytics. IEEE transactions on visualization and computer graphics 27, 3 (2019), 2101–2122.
Google. acessed in 2023. Google Earth. https://earth.google.com/. Acessed in February 2023.
David Harris, Mark Wilson, and Samuel Vine. 2020. Development and validation of a simulation workload measure: the simulation task load index (SIM-TLX). Virtual Reality 24, 4 (2020), 557–566.
Dorota Kamińska, Grzegorz Zwoliński, and Anna Laska-Leśniewicz. 2022. Usability Testing of Virtual Reality Applications—The Pilot Study. Sensors 22, 4 (2022), 1342.
Matthias Kraus, Johannes Fuchs, Björn Sommer, Karsten Klein, Ulrich Engelke, Daniel Keim, and Falk Schreiber. 2022. Immersive analytics with abstract 3D visualizations: A survey. In Computer Graphics Forum, Vol. 41. Wiley Online Library, 201–229.
J LaViola, B Williamson, Conner Brooks, Sergiu Veazanchin, Robert Sottilare, and Pat Garrity. 2015. Using augmented reality to tutor military tasks in the wild. In Proceedings of the Interservice/Industry Training Simulation & Education Conference, Orlando, Florida.
Ruggiero Lovreglio, Xinyue Duan, Anass Rahouti, Robyn Phipps, and Daniel Nilsson. 2021. Comparing the effectiveness of fire extinguisher virtual reality and video training. Virtual Reality 25, 1 (2021), 133–145.
Chia-Chi Mao, Chung-Chong Sun, and Chien-Hsu Chen. 2017. Evaluate learner’s acceptance of augmented reality based military decision making process training system. In Proceedings of the 5th International Conference on Information and Education Technology. 73–77.
Marina L Medeiros, Bettina Schlager, Katharina Krösl, and Anton Fuhrmann. 2022. The Potential of VR-based Tactical Resource Planning on Spatial Data. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 176–185.
Tamara Munzner. 2014. Visualization analysis and design. CRC press.
NASA Jet Propulsion Laboratory (JPL). acessed in 2023. Shuttle Radar Topography Mission (SRTM). https://www2.jpl.nasa.gov/srtm/. Acessed in January 2023.
NATO. 2011. NATO JOINT MILITARY SYMBOLOGY. APP-6(C).
OpenCV Contributors. acessed in 2023. OpenCV: Open Source Computer Vision Library. https://opencv.org/. Acessed in March 2023.
Panayiotis E Pelargos, Daniel T Nagasawa, Carlito Lagman, Stephen Tenn, Joanna V Demos, Seung J Lee, Timothy T Bui, Natalie E Barnette, Nikhilesh S Bhatt, Nolan Ung, 2017. Utilizing virtual and augmented reality for educational and clinical enhancements in neurosurgery. Journal of clinical neuroscience 35 (2017), 1–4.
QGIS Development Team. acessed in 2023. QGIS Geographic Information System. https://qgis.org/en/site/. Acessed in February 2023.
Sentinel Hub. acessed in 2023. Sentinel Hub. https://services.sentinel-hub.com/. Acessed in February 2023.
United States Geological Survey (USGS). acessed in 2023. Earth Explorer. https://earthexplorer.usgs.gov/. Acessed in January 2023.
JE Venson, JC Albiero Berni, C Edmilson da Silva Maia, AM Marques da Silva, M Cordeiro d’Ornellas, and A Maciel. 2018. A Case-Based Study with Radiologists Performing Diagnosis Tasks in Virtual Reality.. In InMEDINFO 2017: Precision Healthcare through Informatics: Proceedings of the 16th World Congress on Medical and Health Informatics, Vol. 245. IOS Press, 244.
Nathan Yau. 2013. Data points: Visualization that means something. John Wiley & Sons.
Xuesong Zhang and Adalberto L Simeone. 2022. Using the Think Aloud Protocol in an Immersive Virtual Reality Evaluation of a Virtual Twin. In Proceedings of the 2022 ACM Symposium on Spatial User Interaction. 1–8.
Yidan Zhang, Barrett Ens, Kadek Ananta Satriadi, Ying Yang, and Sarah Goodwin. 2023. Defining Embodied Provenance for Immersive Sensemaking. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–7.
Sepehr Alizadehsalehi, Ahmad Hadavi, and Joseph Chuenhuei Huang. 2019. Virtual reality for design and construction education environment. AEI 2019: Integrated Building Solutions—The National Agenda (2019), 193–203.
Stéphane Bouchard, Maxine Berthiaume, Geneviève Robillard, Hélène Forget, Camille Daudelin-Peltier, Patrice Renaud, Caroline Blais, and Daniel Fiset. 2021. Arguing in favor of revising the simulator sickness questionnaire factor structure when assessing side effects induced by immersions in virtual reality. Frontiers in Psychiatry 12 (2021), 739742.
BRASIL. Ministério da Defesa. Exército Brasileiro. 2020. PROCESSO DE PLANEJAMENTO E CONDUÇÃO DAS OPERAÇÕES TERRESTRES (PPCOT) (2ª ed.). EGGCF, Brasília.
David Checa and Andres Bustillo. 2020. A review of immersive virtual reality serious games to enhance learning and training. Multimedia Tools and Applications 79 (2020), 5501–5527.
Chien Chou, Hsieh-Lung Hsu, and Yu-Seng Yao. 1997. Construction of a virtual reality learning environment for teaching structural analysis. Computer Applications in Engineering Education 5, 4 (1997), 223–230.
Brasil. Ministério da Defesa. 2021. C21-30: CATÁLOGO DE SÍMBOLOS E CONVENÇÕES CARTOGRÁFICAS DAS FORÇAS ARMADAS. 1ª Edição. Brasília.
Brasil. Ministério da Defesa. Exército Brasileiro. 2019. EB60-ME-13.301: Manual de Ensino Trabalho de Comando. 2ª Edição. EGGCF, Brasília.
Brasil. Ministério da Defesa. Exército Brasileiro. 2021. EB70-CI-11.450: Caderno de Instrução Patrulhas. 1ª Edição. EGGCF, Brasília.
Thiago da Silva Gonçalves and Alberto Barbosa Raposo. 2022. Realidade Virtual como ferramenta de apoio na tomada de decisão no Combate em Ambientes Confinados. In Anais Estendidos do XXIV Simpósio de Realidade Virtual e Aumentada. SBC, 11–15.
Jelia R Domingo and Elizabeth Gates Bradley. 2018. Education student perceptions of virtual reality as a learning tool. Journal of Educational Technology Systems 46, 3 (2018), 329–342.
Adrien Fonnet and Yannick Prie. 2019. Survey of immersive analytics. IEEE transactions on visualization and computer graphics 27, 3 (2019), 2101–2122.
Google. acessed in 2023. Google Earth. https://earth.google.com/. Acessed in February 2023.
David Harris, Mark Wilson, and Samuel Vine. 2020. Development and validation of a simulation workload measure: the simulation task load index (SIM-TLX). Virtual Reality 24, 4 (2020), 557–566.
Dorota Kamińska, Grzegorz Zwoliński, and Anna Laska-Leśniewicz. 2022. Usability Testing of Virtual Reality Applications—The Pilot Study. Sensors 22, 4 (2022), 1342.
Matthias Kraus, Johannes Fuchs, Björn Sommer, Karsten Klein, Ulrich Engelke, Daniel Keim, and Falk Schreiber. 2022. Immersive analytics with abstract 3D visualizations: A survey. In Computer Graphics Forum, Vol. 41. Wiley Online Library, 201–229.
J LaViola, B Williamson, Conner Brooks, Sergiu Veazanchin, Robert Sottilare, and Pat Garrity. 2015. Using augmented reality to tutor military tasks in the wild. In Proceedings of the Interservice/Industry Training Simulation & Education Conference, Orlando, Florida.
Ruggiero Lovreglio, Xinyue Duan, Anass Rahouti, Robyn Phipps, and Daniel Nilsson. 2021. Comparing the effectiveness of fire extinguisher virtual reality and video training. Virtual Reality 25, 1 (2021), 133–145.
Chia-Chi Mao, Chung-Chong Sun, and Chien-Hsu Chen. 2017. Evaluate learner’s acceptance of augmented reality based military decision making process training system. In Proceedings of the 5th International Conference on Information and Education Technology. 73–77.
Marina L Medeiros, Bettina Schlager, Katharina Krösl, and Anton Fuhrmann. 2022. The Potential of VR-based Tactical Resource Planning on Spatial Data. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 176–185.
Tamara Munzner. 2014. Visualization analysis and design. CRC press.
NASA Jet Propulsion Laboratory (JPL). acessed in 2023. Shuttle Radar Topography Mission (SRTM). https://www2.jpl.nasa.gov/srtm/. Acessed in January 2023.
NATO. 2011. NATO JOINT MILITARY SYMBOLOGY. APP-6(C).
OpenCV Contributors. acessed in 2023. OpenCV: Open Source Computer Vision Library. https://opencv.org/. Acessed in March 2023.
Panayiotis E Pelargos, Daniel T Nagasawa, Carlito Lagman, Stephen Tenn, Joanna V Demos, Seung J Lee, Timothy T Bui, Natalie E Barnette, Nikhilesh S Bhatt, Nolan Ung, 2017. Utilizing virtual and augmented reality for educational and clinical enhancements in neurosurgery. Journal of clinical neuroscience 35 (2017), 1–4.
QGIS Development Team. acessed in 2023. QGIS Geographic Information System. https://qgis.org/en/site/. Acessed in February 2023.
Sentinel Hub. acessed in 2023. Sentinel Hub. https://services.sentinel-hub.com/. Acessed in February 2023.
United States Geological Survey (USGS). acessed in 2023. Earth Explorer. https://earthexplorer.usgs.gov/. Acessed in January 2023.
JE Venson, JC Albiero Berni, C Edmilson da Silva Maia, AM Marques da Silva, M Cordeiro d’Ornellas, and A Maciel. 2018. A Case-Based Study with Radiologists Performing Diagnosis Tasks in Virtual Reality.. In InMEDINFO 2017: Precision Healthcare through Informatics: Proceedings of the 16th World Congress on Medical and Health Informatics, Vol. 245. IOS Press, 244.
Nathan Yau. 2013. Data points: Visualization that means something. John Wiley & Sons.
Xuesong Zhang and Adalberto L Simeone. 2022. Using the Think Aloud Protocol in an Immersive Virtual Reality Evaluation of a Virtual Twin. In Proceedings of the 2022 ACM Symposium on Spatial User Interaction. 1–8.
Yidan Zhang, Barrett Ens, Kadek Ananta Satriadi, Ying Yang, and Sarah Goodwin. 2023. Defining Embodied Provenance for Immersive Sensemaking. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–7.
Publicado
06/11/2023
Como Citar
NETO, Jerson; SECCO, Otávio; FREITAS, Carla; WAGNER, Jorge; MACIEL, Anderson; NEDEL, Luciana.
Immersive Data Analysis for Planning Military Operations: Design and Think-Aloud Study. In: SIMPÓSIO DE REALIDADE VIRTUAL E AUMENTADA (SVR), 25. , 2023, Rio Grande/RS.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2023
.
p. 66–76.
