skip to main content
10.1145/3625008.3625019acmotherconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
research-article

Immersive Data Analysis for Planning Military Operations: Design and Think-Aloud Study

Published:06 January 2024Publication History

ABSTRACT

The ability to visualize data in immersive environments offers new interpretations that directly impact the outcomes of activities such as military planning, where effective decision-making is vital for mission execution. This work aims to explore the application of VR in military planning as a tool that exploits a metaphor of the sandbox, the current planning approach adding increased possibilities of visualizing training range data in 3D. To achieve this, we designed and developed a prototype that includes a virtual terrain and miniature models and provides interactions based on the sandbox concept. To evaluate the prototype, a user study was conducted with army experts performing a planning task using both conventional methods and VR. Results indicate that VR is a viable alternative with an impact on the decision-making process during military planning. Future research should focus on assessing the effects of multiple conditions with a larger group of participants and investigating additional functionalities such as spatial perception.

Skip Supplemental Material Section

Supplemental Material

VRSandbox - SVR.mp4

mp4

19.1 MB

References

  1. Mahmoud Albahbah, Serkan Kıvrak, and Gökhan Arslan. 2021. Application areas of augmented reality and virtual reality in construction project management: A scoping review. J. Constr. Eng. Manag. Innov 4 (2021), 151–172.Google ScholarGoogle Scholar
  2. Sepehr Alizadehsalehi, Ahmad Hadavi, and Joseph Chuenhuei Huang. 2019. Virtual reality for design and construction education environment. AEI 2019: Integrated Building Solutions—The National Agenda (2019), 193–203.Google ScholarGoogle ScholarCross RefCross Ref
  3. Stéphane Bouchard, Maxine Berthiaume, Geneviève Robillard, Hélène Forget, Camille Daudelin-Peltier, Patrice Renaud, Caroline Blais, and Daniel Fiset. 2021. Arguing in favor of revising the simulator sickness questionnaire factor structure when assessing side effects induced by immersions in virtual reality. Frontiers in Psychiatry 12 (2021), 739742.Google ScholarGoogle ScholarCross RefCross Ref
  4. BRASIL. Ministério da Defesa. Exército Brasileiro. 2020. PROCESSO DE PLANEJAMENTO E CONDUÇÃO DAS OPERAÇÕES TERRESTRES (PPCOT) (2ª ed.). EGGCF, Brasília.Google ScholarGoogle Scholar
  5. David Checa and Andres Bustillo. 2020. A review of immersive virtual reality serious games to enhance learning and training. Multimedia Tools and Applications 79 (2020), 5501–5527.Google ScholarGoogle ScholarCross RefCross Ref
  6. Chien Chou, Hsieh-Lung Hsu, and Yu-Seng Yao. 1997. Construction of a virtual reality learning environment for teaching structural analysis. Computer Applications in Engineering Education 5, 4 (1997), 223–230.Google ScholarGoogle ScholarCross RefCross Ref
  7. Brasil. Ministério da Defesa. 2021. C21-30: CATÁLOGO DE SÍMBOLOS E CONVENÇÕES CARTOGRÁFICAS DAS FORÇAS ARMADAS. 1ª Edição. Brasília.Google ScholarGoogle Scholar
  8. Brasil. Ministério da Defesa. Exército Brasileiro. 2019. EB60-ME-13.301: Manual de Ensino Trabalho de Comando. 2ª Edição. EGGCF, Brasília.Google ScholarGoogle Scholar
  9. Brasil. Ministério da Defesa. Exército Brasileiro. 2021. EB70-CI-11.450: Caderno de Instrução Patrulhas. 1ª Edição. EGGCF, Brasília.Google ScholarGoogle Scholar
  10. Thiago da Silva Gonçalves and Alberto Barbosa Raposo. 2022. Realidade Virtual como ferramenta de apoio na tomada de decisão no Combate em Ambientes Confinados. In Anais Estendidos do XXIV Simpósio de Realidade Virtual e Aumentada. SBC, 11–15.Google ScholarGoogle Scholar
  11. Jelia R Domingo and Elizabeth Gates Bradley. 2018. Education student perceptions of virtual reality as a learning tool. Journal of Educational Technology Systems 46, 3 (2018), 329–342.Google ScholarGoogle ScholarCross RefCross Ref
  12. Adrien Fonnet and Yannick Prie. 2019. Survey of immersive analytics. IEEE transactions on visualization and computer graphics 27, 3 (2019), 2101–2122.Google ScholarGoogle ScholarCross RefCross Ref
  13. Google. acessed in 2023. Google Earth. https://earth.google.com/. Acessed in February 2023.Google ScholarGoogle Scholar
  14. David Harris, Mark Wilson, and Samuel Vine. 2020. Development and validation of a simulation workload measure: the simulation task load index (SIM-TLX). Virtual Reality 24, 4 (2020), 557–566.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Dorota Kamińska, Grzegorz Zwoliński, and Anna Laska-Leśniewicz. 2022. Usability Testing of Virtual Reality Applications—The Pilot Study. Sensors 22, 4 (2022), 1342.Google ScholarGoogle ScholarCross RefCross Ref
  16. Matthias Kraus, Johannes Fuchs, Björn Sommer, Karsten Klein, Ulrich Engelke, Daniel Keim, and Falk Schreiber. 2022. Immersive analytics with abstract 3D visualizations: A survey. In Computer Graphics Forum, Vol. 41. Wiley Online Library, 201–229.Google ScholarGoogle Scholar
  17. J LaViola, B Williamson, Conner Brooks, Sergiu Veazanchin, Robert Sottilare, and Pat Garrity. 2015. Using augmented reality to tutor military tasks in the wild. In Proceedings of the Interservice/Industry Training Simulation & Education Conference, Orlando, Florida.Google ScholarGoogle Scholar
  18. Ruggiero Lovreglio, Xinyue Duan, Anass Rahouti, Robyn Phipps, and Daniel Nilsson. 2021. Comparing the effectiveness of fire extinguisher virtual reality and video training. Virtual Reality 25, 1 (2021), 133–145.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Chia-Chi Mao, Chung-Chong Sun, and Chien-Hsu Chen. 2017. Evaluate learner’s acceptance of augmented reality based military decision making process training system. In Proceedings of the 5th International Conference on Information and Education Technology. 73–77.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Marina L Medeiros, Bettina Schlager, Katharina Krösl, and Anton Fuhrmann. 2022. The Potential of VR-based Tactical Resource Planning on Spatial Data. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 176–185.Google ScholarGoogle Scholar
  21. Tamara Munzner. 2014. Visualization analysis and design. CRC press.Google ScholarGoogle Scholar
  22. NASA Jet Propulsion Laboratory (JPL). acessed in 2023. Shuttle Radar Topography Mission (SRTM). https://www2.jpl.nasa.gov/srtm/. Acessed in January 2023.Google ScholarGoogle Scholar
  23. NATO. 2011. NATO JOINT MILITARY SYMBOLOGY. APP-6(C).Google ScholarGoogle Scholar
  24. OpenCV Contributors. acessed in 2023. OpenCV: Open Source Computer Vision Library. https://opencv.org/. Acessed in March 2023.Google ScholarGoogle Scholar
  25. Panayiotis E Pelargos, Daniel T Nagasawa, Carlito Lagman, Stephen Tenn, Joanna V Demos, Seung J Lee, Timothy T Bui, Natalie E Barnette, Nikhilesh S Bhatt, Nolan Ung, 2017. Utilizing virtual and augmented reality for educational and clinical enhancements in neurosurgery. Journal of clinical neuroscience 35 (2017), 1–4.Google ScholarGoogle ScholarCross RefCross Ref
  26. QGIS Development Team. acessed in 2023. QGIS Geographic Information System. https://qgis.org/en/site/. Acessed in February 2023.Google ScholarGoogle Scholar
  27. Sentinel Hub. acessed in 2023. Sentinel Hub. https://services.sentinel-hub.com/. Acessed in February 2023.Google ScholarGoogle Scholar
  28. United States Geological Survey (USGS). acessed in 2023. Earth Explorer. https://earthexplorer.usgs.gov/. Acessed in January 2023.Google ScholarGoogle Scholar
  29. JE Venson, JC Albiero Berni, C Edmilson da Silva Maia, AM Marques da Silva, M Cordeiro d’Ornellas, and A Maciel. 2018. A Case-Based Study with Radiologists Performing Diagnosis Tasks in Virtual Reality.. In InMEDINFO 2017: Precision Healthcare through Informatics: Proceedings of the 16th World Congress on Medical and Health Informatics, Vol. 245. IOS Press, 244.Google ScholarGoogle Scholar
  30. Nathan Yau. 2013. Data points: Visualization that means something. John Wiley & Sons.Google ScholarGoogle Scholar
  31. Xuesong Zhang and Adalberto L Simeone. 2022. Using the Think Aloud Protocol in an Immersive Virtual Reality Evaluation of a Virtual Twin. In Proceedings of the 2022 ACM Symposium on Spatial User Interaction. 1–8.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Yidan Zhang, Barrett Ens, Kadek Ananta Satriadi, Ying Yang, and Sarah Goodwin. 2023. Defining Embodied Provenance for Immersive Sensemaking. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–7.Google ScholarGoogle Scholar

Index Terms

  1. Immersive Data Analysis for Planning Military Operations: Design and Think-Aloud Study

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          SVR '23: Proceedings of the 25th Symposium on Virtual and Augmented Reality
          November 2023
          315 pages
          ISBN:9798400709432
          DOI:10.1145/3625008

          Copyright © 2023 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 6 January 2024

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed limited
        • Article Metrics

          • Downloads (Last 12 months)14
          • Downloads (Last 6 weeks)7

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format