Methods for Evaluating Immersive 3D Virtual Environments: a Systematic Literature Review
Resumo
Although evaluation methods for Virtual Reality systems have been proposed in many studies, most of them are developed for particular applications with no possibility of generalization. Additionally, few studies proposed compilation and categorization of these studies, which turn difficulty obtaining an overview of the state-of-art. This systematic literature review aims to analyze and categorize evaluation methods for interaction in immersive three-dimensional virtual environments. By reviewing studies published from 2019 to April 2024, diverse approaches and methodologies used to assess Virtual Reality interaction techniques were identified. The studies were categorized into five main areas: locomotion, input, visualization and selection, evaluation of haptic interfaces, and transitions and scenarios. Our findings highlight that most studies employed established evaluation methods, with only one study proposing new method. Objective method, particularly time-related measures, were frequently used, alongside subjective method obtained through questionnaires and interviews. The review emphasizes the importance of combining subjective and objective method to provide a comprehensive analysis of user experience and interaction effectiveness. A significant need for standardized evaluation frameworks to enable consistent comparisons across studies was identified.
Palavras-chave:
Immersive Virtual Environments, User Interaction Techniques, Evaluation Methods
Referências
Alexandre Abbey, Thibault Porssut, Bruno Herbelin, and Ronan Boulic. 2021. Assessing the Impact of Mixed Reality Immersion on Presence and Embodiment. In Proceedings of the 14th ACM SIGGRAPH Conference on Motion, Interaction and Games (Virtual Event, Switzerland) (MIG ’21). Association for Computing Machinery, New York, NY, USA, Article 2, 10 pages. DOI: 10.1145/3487983.3488304
Fedaa Abd-Alhamid, Michael Kent, Christopher Bennett, John Calautit, and Yupeng Wu. 2019. Developing an Innovative Method for Visual Perception Evaluation in a Physical-Based Virtual Environment. Building and Environment 162 (2019), 106278. DOI: 10.1016/j.buildenv.2019.106278
Zeeshan Ahmad, Suha Rabbani, Muhammad Rehman Zafar, Syem Ishaque, Sri Krishnan, and Naimul Khan. 2023. Multilevel Stress Assessment From ECG in a Virtual Reality Environment Using Multimodal Fusion. IEEE Sensors Journal 23, 23 (Dec 2023), 29559–29570. DOI: 10.1109/JSEN.2023.3323290
Bilikis Banire, Dena Al Thani, Marwa Qaraqe, and Bilal Mansoor. 2017. A systematic review: Attention assessment of virtual reality based intervention for learning in children with autism spectrum disorder. In 2017 7th IEEE International Conference on Control System, Computing and Engineering (ICCSCE). IEEE, 97–103.
Carlos Bermejo, Lik Hang Lee, Paul Chojecki, David Przewozny, and Pan Hui. 2021. Exploring Button Designs for Mid-air Interaction in Virtual Reality: A Hexa-metric Evaluation of Key Representations and Multi-modal Cues. Proc. ACM Hum.-Comput. Interact. 5, EICS, Article 194 (May 2021), 26 pages. DOI: 10.1145/3457141
Ayush Bhargava, Roshan Venkatakrishnan, Rohith Venkatakrishnan, Hannah Solini, Kathryn Lucaites, Andrew C. Robb, Christopher C. Pagano, and Sabarish V. Babu. 2023. Empirically Evaluating the Effects of Eye Height and Self-Avatars on Dynamic Passability Affordances in Virtual Reality. In 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR). 308–317. DOI: 10.1109/VR55154.2023.00046
Shimmila Bhowmick, Nilotpal Biswas, Pratul Chandra Kalita, and Keyur Sorathia. 2023. Design and evaluation of AMAZE: A multi-finger approach to select small and distant objects in dense virtual environments. Displays 80 (2023), 102539. DOI: 10.1016/j.displa.2023.102539
Andreea Dalia Blaga, Maite Frutos-Pascual, Chris Creed, and Ian Williams. 2020. Too Hot to Handle: An Evaluation of the Effect of Thermal Visual Representation on User Grasping Interaction in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–16. DOI: 10.1145/3313831.3376554
Alberto Boem and Luca Turchet. 2024. Selection as Tapping: An evaluation of 3D input techniques for timing tasks in musical Virtual Reality. International Journal of Human-Computer Studies 185 (2024), 103231. DOI: 10.1016/j.ijhcs.2024.103231
Larissa Brübach, Franziska Westermeier, Carolin Wienrich, and Marc Erich Latoschik. 2023. A Systematic Evaluation of Incongruencies and Their Influence on Plausibility in Virtual Reality. In 2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 894–901. DOI: 10.1109/ISMAR59233.2023.00105
Fabio Buttussi and Luca Chittaro. 2021. Locomotion in Place in Virtual Reality: A Comparative Evaluation of Joystick, Teleport, and Leaning. IEEE Transactions on Visualization and Computer Graphics 27, 1 (Jan 2021), 125–136. DOI: 10.1109/TVCG.2019.2928304
Alberto Cannavò, Davide Calandra, F. Gabriele Pratticò, Valentina Gatteschi, and Fabrizio Lamberti. 2021. An Evaluation Testbed for Locomotion in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 27, 3 (March 2021), 1871–1889. DOI: 10.1109/TVCG.2020.3032440
Ananth N Ramaseri Chandra, Fatima El Jamiy, and Hassan Reza. 2019. A review on usability and performance evaluation in virtual reality systems. In 2019 International Conference on Computational Science and Computational Intelligence (CSCI). IEEE, 1107–1114.
Umer Asghar Chattha, Uzair Iqbal Janjua, Fozia Anwar, Tahir Mustafa Madni, Muhammad Faisal Cheema, and Sana Iqbal Janjua. 2020. Motion Sickness in Virtual Reality: An Empirical Evaluation. IEEE Access 8 (2020), 130486–130499. DOI: 10.1109/ACCESS.2020.3007076
Xiaoping Che, Siqi Ma, Qi Yu, and Chenfeng Yue. 2019. An Event-Based User Experience Evaluation Method for Virtual Reality Applications. In 2019 IEEE SmartWorld, Ubiquitous Intelligence Computing, Advanced Trusted Computing, Scalable Computing Communications, Cloud Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI). 767–774. DOI: 10.1109/SmartWorld-UIC-ATC-SCALCOM-IOP-SCI.2019.00164
Xiao-Lin Chen and Wen-Jun Hou. 2021. Visual Fatigue Assessment Model Based on Eye-Related Data in Virtual Reality. In 2021 IEEE 7th International Conference on Virtual Reality (ICVR). 262–268. DOI: 10.1109/ICVR51878.2021.9483841
Alexandre Gomes de Siqueira, Rohith Venkatakrishnan, Roshan Venkatakrishnan, Ayush Bhargava, Kathryn Lucaites, Hannah Solini, Moloud Nasiri, Andrew Robb, Christopher Pagano, Brygg Ullmer, and Sabarish V. Babu. 2021. Empirically Evaluating the Effects of Perceptual Information Channels on the Size Perception of Tangibles in Near-Field Virtual Reality. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 1–10. DOI: 10.1109/VR50410.2021.00086
Majed Elwardy, Hans-Jürgen Zepernick, Yan Hu, Thi My Chinh Chu, and Veronica Sundstedt. 2020. Evaluation of Simulator Sickness for 360° Videos on an HMD Subject to Participants’ Experience with Virtual Reality. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 477–484. DOI: 10.1109/VRW50115.2020.00100
Dylan Fafard, Ian Stavness, Martin Dechant, Regan Mandryk, Qian Zhou, and Sidney Fels. 2019. FTVR in VR: Evaluation of 3D Perception With a Simulated Volumetric Fish-Tank Virtual Reality Display. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. DOI: 10.1145/3290605.3300763
Selma Rizvic, Dimitrios Skarlatos, Filip Škola, Dušanka Boskovic, and Fotis Liarokapis. 2024. Assessing User Experience and Cognitive Workload in Virtual Reality Digital Storytelling. International Journal of Human–Computer Interaction 40, 6 (2024), 1479–1486. DOI: 10.1080/10447318.2023.2247846
Markus Funk, Florian Müller, Marco Fendrich, Megan Shene, Moritz Kolvenbach, Niclas Dobbertin, Sebastian Günther, and Max Mühlhäuser. 2019. Assessing the Accuracy of Point & Teleport Locomotion with Orientation Indication for Virtual Reality using Curved Trajectories. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. DOI: 10.1145/3290605.3300377
BoYu Gao, Zijun Mai, Huawei Tu, and Henry Been-Lirn Duh. 2021. Evaluation of Body-centric Locomotion with Different Transfer Functions in Virtual Reality. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 493–500. DOI: 10.1109/VR50410.2021.00073
BoYu Gao, Haojun Zheng, Jingbo Zhao, Huawei Tu, HyungSeok Kim, and Henry Been-Lirn Duh. 2024. Evaluating Plausible Preference of Body-Centric Locomotion using Subjective Matching in Virtual Reality. In 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR). 1054–1064. DOI: 10.1109/VR58804.2024.00124
Hong Gao, Lasse Frommelt, and Enkelejda Kasneci. 2022. The Evaluation of Gait-Free Locomotion Methods with Eye Movement in Virtual Reality. In 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 530–535. DOI: 10.1109/ISMAR-Adjunct57072.2022.00112
Georg Schummers, Ulrich Eck, Gloria Zörnack, Jakob Weiss, and Nassir Navab. 2021. Evaluating surface visualization methods in semi-transparent volume rendering in virtual reality. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization 9, 4 (2021), 339–348. DOI: 10.1080/21681163.2020.1835545
Patrick Harms. 2019. Automated Usability Evaluation of Virtual Reality Applications. ACM Trans. Comput.-Hum. Interact. 26, 3, Article 14 (Apr 2019), 36 pages. DOI: 10.1145/3301423
Chengcheng Hua, Lining Chai, Ying Yan, Jia Liu, Qiaoxiu Wang, Rongrong Fu, and Zhanfeng Zhou. 2023. Assessment of Virtual Reality Motion Sickness Severity Based on EEG via LSTM/BiLSTM. IEEE Sensors Journal 23, 20 (Oct 2023), 24839–24848. DOI: 10.1109/JSEN.2023.3309260
Malte Husung and Eike Langbehn. 2019. Of Portals and Orbs: An Evaluation of Scene Transition Techniques for Virtual Reality. In Proceedings of Mensch Und Computer 2019 (Hamburg, Germany) (MuC ’19). Association for Computing Machinery, New York, NY, USA, 245–254. DOI: 10.1145/3340764.3340779
Maxence Hébert-Lavoie, Philippe Doyon-Poulin, and Benoît Ozell. 2020. Identification of Visual Functional Thresholds for Immersion Assessment in Virtual Reality. Presence 29 (Dec 2020), 1–22. DOI: 10.1162/pres_a_00354
Felix Immohr, Gareth Rendle, Anton Lammert, Annika Neidhardt, Victoria Meyer Zur Heyde, Bernd Froehlich, and Alexander Raake. 2024. Evaluating the Effect of Binaural Auralization on Audiovisual Plausibility and Communication Behavior in Virtual Reality. In 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR). 849–858. DOI: 10.1109/VR58804.2024.00104
Jason Jerald. 2015. The VR book: Human-centered design for virtual reality. Morgan & Claypool.
Tyler A. Jost, Grant Drewelow, Scott Koziol, and Jonathan Rylander. 2019. A quantitative method for evaluation of 6 degree of freedom virtual reality systems. Journal of Biomechanics 97 (2019), 109379. DOI: 10.1016/j.jbiomech.2019.109379
Reza Kazemi and Seul Chan Lee. 2023. Human Factors/Ergonomics (HFE) evaluation in the virtual reality environment: A systematic review. International Journal of Human–Computer Interaction (2023), 1–17.
Yong Min Kim, Yushin Lee, Ilsun Rhiu, and Myung Hwan Yun. 2021. Evaluation of locomotion methods in virtual reality navigation environments: An involuntary position shift and task performance. International Journal of Human-Computer Studies 155 (2021), 102691. DOI: 10.1016/j.ijhcs.2021.102691
Julian Kreimeier, Sebastian Hammer, Daniel Friedmann, Pascal Karg, Clemens Bühner, Lukas Bankel, and Timo Götzelmann. 2019. Evaluation of different types of haptic feedback influencing the task-based presence and performance in virtual reality. In Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments (Rhodes, Greece) (PETRA ’19). Association for Computing Machinery, New York, NY, USA, 289–298. DOI: 10.1145/3316782.3321536
Zhenxing Li, Maria Kiiveri, Jussi Rantala, and Roope Raisamo. 2021. Evaluation of haptic virtual reality user interfaces for medical marking on 3D models. International Journal of Human-Computer Studies 147 (2021), 102561. DOI: 10.1016/j.ijhcs.2020.102561
Donghae Lim, Shizuka Shirai, Jason Orlosky, Photchara Ratsamee, Yuki Uranishi, and Haruo Takemura. 2022. Evaluation of User Interfaces for Three-Dimensional Locomotion in Virtual Reality. In Proceedings of the 2022 ACM Symposium on Spatial User Interaction (Online, CA, USA) (SUI ’22). Association for Computing Machinery, New York, NY, USA, Article 8, 9 pages. DOI: 10.1145/3565970.3567693
Hyun Kyoon Lim, Kyoungha Ji, Ye Shin Woo, Dong uk Han, Dong-Hyun Lee, Sun Gu Nam, and Kyoung-Mi Jang. 2021. Test-retest reliability of the virtual reality sickness evaluation using electroencephalography (EEG). Neuroscience Letters 743 (2021), 135589. DOI: 10.1016/j.neulet.2020.135589
Wan-Yi Lin, Rohith Venkatakrishnan, Roshan Venkatakrishnan, Sabarish V. Babu, Christopher Pagano, and Wen-Chieh Lin. 2024. An Empirical Evaluation of the Calibration of Auditory Distance Perception under Different Levels of Virtual Environment Visibilities. In 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR). 690–700. DOI: 10.1109/VR58804.2024.00089
Jesse Lohman and Luca Turchet. 2022. Evaluating Cybersickness of Walking on an Omnidirectional Treadmill in Virtual Reality. IEEE Transactions on Human-Machine Systems 52, 4 (Aug 2022), 613–623. DOI: 10.1109/THMS.2022.3175407
Alexandre Luc, Stephany Tamer, Renaud Hage, Christine Detrembleur, and Laurent Pitance. 2022. Do the kinematics and sensorimotor control of people with chronic non-specific neck pain differ from those of healthy individuals when assessed in an immersive virtual reality environment? A systematic review. Physical Therapy Reviews 27, 6 (2022), 430–443.
Tiffany Luong, Ferran Argelaguet, Nicolas Martin, and Anatole Lecuyer. 2020. Introducing Mental Workload Assessment for the Design of Virtual Reality Training Scenarios. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 662–671. DOI: 10.1109/VR46266.2020.00089
Tiffany Luong, Yi Fei Cheng, Max Möbus, Andreas Fender, and Christian Holz. 2023. Controllers or Bare Hands? A Controlled Evaluation of Input Techniques on Interaction Performance and Exertion in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 29, 11 (Nov 2023), 4633–4643. DOI: 10.1109/TVCG.2023.3320211
Takao Endo, Tomomitsu Miyoshi, Suguru Miyagawa, Yoko Hirohara, Tatsuo Yamaguchi, Makoto Saika, Takeshi Morimoto, Masakazu Hirota, Hiroyuki Kanda, and Takashi Fujikado. 2019. Comparison of visual fatigue caused by head-mounted display for virtual reality and two-dimensional display using objective and subjective evaluation. Ergonomics 62, 6 (2019), 759–766. DOI: 10.1080/00140139.2019.1582805
Martin Mundt and Tintu Mathew. 2020. An Evaluation of Pie Menus for System Control in Virtual Reality. In Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society (Tallinn, Estonia) (NordiCHI ’20). Association for Computing Machinery, New York, NY, USA, Article 12, 8 pages. DOI: 10.1145/3419249.3420146
Yana Nehmé, Jean-Philippe Farrugia, Florent Dupont, Patrick Le Callet, and Guillaume Lavoué. 2021. Comparison of Subjective Methods for Quality Assessment of 3D Graphics in Virtual Reality. ACM Trans. Appl. Percept. 18, 1, Article 2 (Dec 2021), 23 pages. DOI: 10.1145/3427931
Yana Nehmé, Florent Dupont, Jean-Philippe Farrugia, Patrick Le Callet, and Guillaume Lavoué. 2021. Visual Quality of 3D Meshes With Diffuse Colors in Virtual Reality: Subjective and Objective Evaluation. IEEE Transactions on Visualization and Computer Graphics 27, 3 (March 2021), 2202–2219. DOI: 10.1109/TVCG.2020.3036153
Federica Pallavicini, Alessandro Pepe, Ambra Ferrari, Giacomo Garcea, Andrea Zanacchi, and Fabrizia Mantovani. 2020. What Is the Relationship Among Positive Emotions, Sense of Presence, and Ease of Interaction in Virtual Reality Systems? An On-Site Evaluation of a Commercial Virtual Experience. Presence 27, 2 (Feb 2020), 183–201. DOI: 10.1162/pres_a_00325
Ken Pfeuffer, Lukas Mecke, Sarah Delgado Rodriguez, Mariam Hassib, Hannah Maier, and Florian Alt. 2024. Gaze-enhanced Menus: Using Eye-tracking to Complement Multimodal Menus in Virtual Reality. In 2024 ACM Symposium on Spatial User Interaction (Online, CA, USA) (SUI ’24). Association for Computing Machinery, New York, NY, USA, 1–9. DOI: 10.1145/3365610.3365630
F. Gabriele Pratticò, Davide Calandra, Matteo Piviotti, and Fabrizio Lamberti. 2021. Assessing the User Experience of Consumer Haptic Devices for Simulation-based Virtual Reality. In 2021 IEEE 11th International Conference on Consumer Electronics (ICCE-Berlin). 1–6. DOI: 10.1109/ICCE-Berlin53567.2021.9719998
Min Chul Cha Reza Kazemi, Chae Heon Lim and Seul Chan Lee. 2023. Evaluation of Drag-and-Drop Task in Virtual Environment: Effects of Target Size and Movement Distance on Performances and Workload. International Journal of Human–Computer Interaction 0, 0 (2023), 1–10. DOI: 10.1080/10447318.2023.2276531 arXiv: [link]
Thomas Robotham, Olli S. Rummukainen, Miriam Kurz, Marie Eckert, and Emanuël A. P. Habets. 2022. Comparing Direct and Indirect Methods of Audio Quality Evaluation in Virtual Reality Scenes of Varying Complexity IEEE Transactions on Visualization and Computer Graphics 28, 5 (May 2022), 2091–2101. DOI: 10.1109/TVCG.2022.3150491
Lucas H Sallaberry, Romero Tori, and Fátima LS Nunes. 2022. Automatic performance assessment in three-dimensional interactive haptic medical simulators: A systematic review. Comput. Surveys 55, 7 (2022), 1–35.
Volkan Sevinc and Mehmet Ilker Berkman. 2020. Psychometric evaluation of Simulator Sickness Questionnaire and its variants as a measure of cybersickness in consumer virtual environments. Applied Ergonomics 82 (2020), 102958. DOI: 10.1016/j.apergo.2019.102958
William R Sherman and Alan B Craig. 2018. Understanding virtual reality: Interface, application, and design. Morgan Kaufmann.
Ting Han Jun Hu Chenqi Zhang Shuo Li, Hongtao Zheng and Cong Yu. 2023. Enhanced Presence Evaluation in Virtual Reality Feedback System with TOPSIS Model. International Journal of Human–Computer Interaction 0, 0 (2023), 1–15. DOI: 10.1080/10447318.2023.2263697 arXiv: [link]
Rijul Saurabh Soans, Remco J. Renken, Rohit Saxena, Radhika Tandon, Frans W. Cornelissen, and Tapan Kumar Gandhi. 2023. A Framework for the Continuous Evaluation of 3D Motion Perception in Virtual Reality. IEEE Transactions on Biomedical Engineering 70, 10 (Oct 2023), 2933–2942. DOI: 10.1109/TBME.2023.3271288
Eduardo Tanaka, Tiago Paula, Alisson Silva, Victor Antunes, Leonardo Domingues, Lucimara de Almeida, Alex Alves, and Roberta Oliveira. 2020. Evaluation of immersive virtual reality locomotion mechanisms. In Proceedings of the 19th Brazilian Symposium on Human Factors in
Computing Systems (Diamantina, Brazil) (IHC ’20). Association for Computing Machinery, New York, NY, USA, Article 47, 6 pages. DOI: 10.1145/3424953.3426550
Jeroen van der Hooft, Maria Torres Vega, Stefano Petrangeli, Tim Wauters, and Filip De Turck. 2019. Quality Assessment for Adaptive Virtual Reality Video Streaming: A Probabilistic Approach on the User’s Gaze. In 2019 22nd Conference on Innovation in Clouds, Internet and Networks and Workshops (ICIN). 19–24. DOI: 10.1109/ICIN.2019.8685904
Isabelina Nahmens William Carman, Laura Ikuma and Roberto Champney. 2023. Initial validation of the GUESS-18 for usability in virtual reality gaming environments: a pilot study. Theoretical Issues in Ergonomics Science 0, 0 (2023), 1–23. DOI: 10.1080/1463922X.2023.2166145 arXiv: [link]
Rui Wu, Jeevitha Pandurangaiah, Grayson Morgan Blankenship, Christopher Xavier Castro, Shanyue Guan, Andrew Ju, and Zhen Zhu. 2020. Evaluation of Virtual Reality Tracking Performance for Indoor Navigation. In 2020 IEEE/ION Position, Location and Navigation Symposium (PLANS). 1311–1316. DOI: 10.1109/PLANS46316.2020.9110225
Tingzhu Wu, Shijie Liang, Lili Zheng, Yue Lin, Ziquan Guo, Yulin Gao, Yijun Lu, Sung-Wen Huang Chen, Chun-Fu Lee, Jia-Rou Zhou, Hao-Chung Kuo, and Zhong Chen. 2019. Assessment and Optimization of the Circadian Performance of Smartphone-Based Virtual Reality Displays. IEEE Journal of the Electron Devices Society 7 (2019), 358–367. DOI: 10.1109/ JEDS.2019.2899646
Wenge Xu, Xuanru Meng, Kangyou Yu, Sayan Sarcar, and Hai-Ning Liang. 2022. Evaluation of Text Selection Techniques in Virtual Reality Head-Mounted Displays. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 131–140. DOI: 10.1109/ISMAR55827.2022.00027
Zhaoyu Yan, Jing Wang, and Zhuoran Li. 2019. A Multi-criteria Subjective Evaluation Method for Binaural Audio Rendering Techniques in Virtual Reality Applications. In 2019 IEEE International Conference on Multimedia Expo Workshops (ICMEW). 402–407. DOI: 10.1109/ICMEW.2019.00075
Suiang-Shyan Lee Yi-Jheng Huang, Kang-Yi Liu and I-Cheng Yeh. 2021. Evaluation of a Hybrid of Hand Gesture and Controller Inputs in Virtual Reality. International Journal of Human–Computer Interaction 37, 2 (2021), 169–180. DOI: 10.1080/10447318.2020.1809248 arXiv: [link]
Difeng Yu, Hai-Ning Liang, Kaixuan Fan, Heng Zhang, Charles Fleming, and Konstantinos Papangelis. 2020. Design and Evaluation of Visualization Techniques of Off-Screen and Occluded Targets in Virtual Reality Environments. IEEE Transactions on Visualization and Computer Graphics 26, 9 (Sep. 2020), 2762–2774. DOI: 10.1109/TVCG.2019.2905580
Fedaa Abd-Alhamid, Michael Kent, Christopher Bennett, John Calautit, and Yupeng Wu. 2019. Developing an Innovative Method for Visual Perception Evaluation in a Physical-Based Virtual Environment. Building and Environment 162 (2019), 106278. DOI: 10.1016/j.buildenv.2019.106278
Zeeshan Ahmad, Suha Rabbani, Muhammad Rehman Zafar, Syem Ishaque, Sri Krishnan, and Naimul Khan. 2023. Multilevel Stress Assessment From ECG in a Virtual Reality Environment Using Multimodal Fusion. IEEE Sensors Journal 23, 23 (Dec 2023), 29559–29570. DOI: 10.1109/JSEN.2023.3323290
Bilikis Banire, Dena Al Thani, Marwa Qaraqe, and Bilal Mansoor. 2017. A systematic review: Attention assessment of virtual reality based intervention for learning in children with autism spectrum disorder. In 2017 7th IEEE International Conference on Control System, Computing and Engineering (ICCSCE). IEEE, 97–103.
Carlos Bermejo, Lik Hang Lee, Paul Chojecki, David Przewozny, and Pan Hui. 2021. Exploring Button Designs for Mid-air Interaction in Virtual Reality: A Hexa-metric Evaluation of Key Representations and Multi-modal Cues. Proc. ACM Hum.-Comput. Interact. 5, EICS, Article 194 (May 2021), 26 pages. DOI: 10.1145/3457141
Ayush Bhargava, Roshan Venkatakrishnan, Rohith Venkatakrishnan, Hannah Solini, Kathryn Lucaites, Andrew C. Robb, Christopher C. Pagano, and Sabarish V. Babu. 2023. Empirically Evaluating the Effects of Eye Height and Self-Avatars on Dynamic Passability Affordances in Virtual Reality. In 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR). 308–317. DOI: 10.1109/VR55154.2023.00046
Shimmila Bhowmick, Nilotpal Biswas, Pratul Chandra Kalita, and Keyur Sorathia. 2023. Design and evaluation of AMAZE: A multi-finger approach to select small and distant objects in dense virtual environments. Displays 80 (2023), 102539. DOI: 10.1016/j.displa.2023.102539
Andreea Dalia Blaga, Maite Frutos-Pascual, Chris Creed, and Ian Williams. 2020. Too Hot to Handle: An Evaluation of the Effect of Thermal Visual Representation on User Grasping Interaction in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–16. DOI: 10.1145/3313831.3376554
Alberto Boem and Luca Turchet. 2024. Selection as Tapping: An evaluation of 3D input techniques for timing tasks in musical Virtual Reality. International Journal of Human-Computer Studies 185 (2024), 103231. DOI: 10.1016/j.ijhcs.2024.103231
Larissa Brübach, Franziska Westermeier, Carolin Wienrich, and Marc Erich Latoschik. 2023. A Systematic Evaluation of Incongruencies and Their Influence on Plausibility in Virtual Reality. In 2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 894–901. DOI: 10.1109/ISMAR59233.2023.00105
Fabio Buttussi and Luca Chittaro. 2021. Locomotion in Place in Virtual Reality: A Comparative Evaluation of Joystick, Teleport, and Leaning. IEEE Transactions on Visualization and Computer Graphics 27, 1 (Jan 2021), 125–136. DOI: 10.1109/TVCG.2019.2928304
Alberto Cannavò, Davide Calandra, F. Gabriele Pratticò, Valentina Gatteschi, and Fabrizio Lamberti. 2021. An Evaluation Testbed for Locomotion in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 27, 3 (March 2021), 1871–1889. DOI: 10.1109/TVCG.2020.3032440
Ananth N Ramaseri Chandra, Fatima El Jamiy, and Hassan Reza. 2019. A review on usability and performance evaluation in virtual reality systems. In 2019 International Conference on Computational Science and Computational Intelligence (CSCI). IEEE, 1107–1114.
Umer Asghar Chattha, Uzair Iqbal Janjua, Fozia Anwar, Tahir Mustafa Madni, Muhammad Faisal Cheema, and Sana Iqbal Janjua. 2020. Motion Sickness in Virtual Reality: An Empirical Evaluation. IEEE Access 8 (2020), 130486–130499. DOI: 10.1109/ACCESS.2020.3007076
Xiaoping Che, Siqi Ma, Qi Yu, and Chenfeng Yue. 2019. An Event-Based User Experience Evaluation Method for Virtual Reality Applications. In 2019 IEEE SmartWorld, Ubiquitous Intelligence Computing, Advanced Trusted Computing, Scalable Computing Communications, Cloud Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI). 767–774. DOI: 10.1109/SmartWorld-UIC-ATC-SCALCOM-IOP-SCI.2019.00164
Xiao-Lin Chen and Wen-Jun Hou. 2021. Visual Fatigue Assessment Model Based on Eye-Related Data in Virtual Reality. In 2021 IEEE 7th International Conference on Virtual Reality (ICVR). 262–268. DOI: 10.1109/ICVR51878.2021.9483841
Alexandre Gomes de Siqueira, Rohith Venkatakrishnan, Roshan Venkatakrishnan, Ayush Bhargava, Kathryn Lucaites, Hannah Solini, Moloud Nasiri, Andrew Robb, Christopher Pagano, Brygg Ullmer, and Sabarish V. Babu. 2021. Empirically Evaluating the Effects of Perceptual Information Channels on the Size Perception of Tangibles in Near-Field Virtual Reality. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 1–10. DOI: 10.1109/VR50410.2021.00086
Majed Elwardy, Hans-Jürgen Zepernick, Yan Hu, Thi My Chinh Chu, and Veronica Sundstedt. 2020. Evaluation of Simulator Sickness for 360° Videos on an HMD Subject to Participants’ Experience with Virtual Reality. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 477–484. DOI: 10.1109/VRW50115.2020.00100
Dylan Fafard, Ian Stavness, Martin Dechant, Regan Mandryk, Qian Zhou, and Sidney Fels. 2019. FTVR in VR: Evaluation of 3D Perception With a Simulated Volumetric Fish-Tank Virtual Reality Display. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. DOI: 10.1145/3290605.3300763
Selma Rizvic, Dimitrios Skarlatos, Filip Škola, Dušanka Boskovic, and Fotis Liarokapis. 2024. Assessing User Experience and Cognitive Workload in Virtual Reality Digital Storytelling. International Journal of Human–Computer Interaction 40, 6 (2024), 1479–1486. DOI: 10.1080/10447318.2023.2247846
Markus Funk, Florian Müller, Marco Fendrich, Megan Shene, Moritz Kolvenbach, Niclas Dobbertin, Sebastian Günther, and Max Mühlhäuser. 2019. Assessing the Accuracy of Point & Teleport Locomotion with Orientation Indication for Virtual Reality using Curved Trajectories. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. DOI: 10.1145/3290605.3300377
BoYu Gao, Zijun Mai, Huawei Tu, and Henry Been-Lirn Duh. 2021. Evaluation of Body-centric Locomotion with Different Transfer Functions in Virtual Reality. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 493–500. DOI: 10.1109/VR50410.2021.00073
BoYu Gao, Haojun Zheng, Jingbo Zhao, Huawei Tu, HyungSeok Kim, and Henry Been-Lirn Duh. 2024. Evaluating Plausible Preference of Body-Centric Locomotion using Subjective Matching in Virtual Reality. In 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR). 1054–1064. DOI: 10.1109/VR58804.2024.00124
Hong Gao, Lasse Frommelt, and Enkelejda Kasneci. 2022. The Evaluation of Gait-Free Locomotion Methods with Eye Movement in Virtual Reality. In 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 530–535. DOI: 10.1109/ISMAR-Adjunct57072.2022.00112
Georg Schummers, Ulrich Eck, Gloria Zörnack, Jakob Weiss, and Nassir Navab. 2021. Evaluating surface visualization methods in semi-transparent volume rendering in virtual reality. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization 9, 4 (2021), 339–348. DOI: 10.1080/21681163.2020.1835545
Patrick Harms. 2019. Automated Usability Evaluation of Virtual Reality Applications. ACM Trans. Comput.-Hum. Interact. 26, 3, Article 14 (Apr 2019), 36 pages. DOI: 10.1145/3301423
Chengcheng Hua, Lining Chai, Ying Yan, Jia Liu, Qiaoxiu Wang, Rongrong Fu, and Zhanfeng Zhou. 2023. Assessment of Virtual Reality Motion Sickness Severity Based on EEG via LSTM/BiLSTM. IEEE Sensors Journal 23, 20 (Oct 2023), 24839–24848. DOI: 10.1109/JSEN.2023.3309260
Malte Husung and Eike Langbehn. 2019. Of Portals and Orbs: An Evaluation of Scene Transition Techniques for Virtual Reality. In Proceedings of Mensch Und Computer 2019 (Hamburg, Germany) (MuC ’19). Association for Computing Machinery, New York, NY, USA, 245–254. DOI: 10.1145/3340764.3340779
Maxence Hébert-Lavoie, Philippe Doyon-Poulin, and Benoît Ozell. 2020. Identification of Visual Functional Thresholds for Immersion Assessment in Virtual Reality. Presence 29 (Dec 2020), 1–22. DOI: 10.1162/pres_a_00354
Felix Immohr, Gareth Rendle, Anton Lammert, Annika Neidhardt, Victoria Meyer Zur Heyde, Bernd Froehlich, and Alexander Raake. 2024. Evaluating the Effect of Binaural Auralization on Audiovisual Plausibility and Communication Behavior in Virtual Reality. In 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR). 849–858. DOI: 10.1109/VR58804.2024.00104
Jason Jerald. 2015. The VR book: Human-centered design for virtual reality. Morgan & Claypool.
Tyler A. Jost, Grant Drewelow, Scott Koziol, and Jonathan Rylander. 2019. A quantitative method for evaluation of 6 degree of freedom virtual reality systems. Journal of Biomechanics 97 (2019), 109379. DOI: 10.1016/j.jbiomech.2019.109379
Reza Kazemi and Seul Chan Lee. 2023. Human Factors/Ergonomics (HFE) evaluation in the virtual reality environment: A systematic review. International Journal of Human–Computer Interaction (2023), 1–17.
Yong Min Kim, Yushin Lee, Ilsun Rhiu, and Myung Hwan Yun. 2021. Evaluation of locomotion methods in virtual reality navigation environments: An involuntary position shift and task performance. International Journal of Human-Computer Studies 155 (2021), 102691. DOI: 10.1016/j.ijhcs.2021.102691
Julian Kreimeier, Sebastian Hammer, Daniel Friedmann, Pascal Karg, Clemens Bühner, Lukas Bankel, and Timo Götzelmann. 2019. Evaluation of different types of haptic feedback influencing the task-based presence and performance in virtual reality. In Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments (Rhodes, Greece) (PETRA ’19). Association for Computing Machinery, New York, NY, USA, 289–298. DOI: 10.1145/3316782.3321536
Zhenxing Li, Maria Kiiveri, Jussi Rantala, and Roope Raisamo. 2021. Evaluation of haptic virtual reality user interfaces for medical marking on 3D models. International Journal of Human-Computer Studies 147 (2021), 102561. DOI: 10.1016/j.ijhcs.2020.102561
Donghae Lim, Shizuka Shirai, Jason Orlosky, Photchara Ratsamee, Yuki Uranishi, and Haruo Takemura. 2022. Evaluation of User Interfaces for Three-Dimensional Locomotion in Virtual Reality. In Proceedings of the 2022 ACM Symposium on Spatial User Interaction (Online, CA, USA) (SUI ’22). Association for Computing Machinery, New York, NY, USA, Article 8, 9 pages. DOI: 10.1145/3565970.3567693
Hyun Kyoon Lim, Kyoungha Ji, Ye Shin Woo, Dong uk Han, Dong-Hyun Lee, Sun Gu Nam, and Kyoung-Mi Jang. 2021. Test-retest reliability of the virtual reality sickness evaluation using electroencephalography (EEG). Neuroscience Letters 743 (2021), 135589. DOI: 10.1016/j.neulet.2020.135589
Wan-Yi Lin, Rohith Venkatakrishnan, Roshan Venkatakrishnan, Sabarish V. Babu, Christopher Pagano, and Wen-Chieh Lin. 2024. An Empirical Evaluation of the Calibration of Auditory Distance Perception under Different Levels of Virtual Environment Visibilities. In 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR). 690–700. DOI: 10.1109/VR58804.2024.00089
Jesse Lohman and Luca Turchet. 2022. Evaluating Cybersickness of Walking on an Omnidirectional Treadmill in Virtual Reality. IEEE Transactions on Human-Machine Systems 52, 4 (Aug 2022), 613–623. DOI: 10.1109/THMS.2022.3175407
Alexandre Luc, Stephany Tamer, Renaud Hage, Christine Detrembleur, and Laurent Pitance. 2022. Do the kinematics and sensorimotor control of people with chronic non-specific neck pain differ from those of healthy individuals when assessed in an immersive virtual reality environment? A systematic review. Physical Therapy Reviews 27, 6 (2022), 430–443.
Tiffany Luong, Ferran Argelaguet, Nicolas Martin, and Anatole Lecuyer. 2020. Introducing Mental Workload Assessment for the Design of Virtual Reality Training Scenarios. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 662–671. DOI: 10.1109/VR46266.2020.00089
Tiffany Luong, Yi Fei Cheng, Max Möbus, Andreas Fender, and Christian Holz. 2023. Controllers or Bare Hands? A Controlled Evaluation of Input Techniques on Interaction Performance and Exertion in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 29, 11 (Nov 2023), 4633–4643. DOI: 10.1109/TVCG.2023.3320211
Takao Endo, Tomomitsu Miyoshi, Suguru Miyagawa, Yoko Hirohara, Tatsuo Yamaguchi, Makoto Saika, Takeshi Morimoto, Masakazu Hirota, Hiroyuki Kanda, and Takashi Fujikado. 2019. Comparison of visual fatigue caused by head-mounted display for virtual reality and two-dimensional display using objective and subjective evaluation. Ergonomics 62, 6 (2019), 759–766. DOI: 10.1080/00140139.2019.1582805
Martin Mundt and Tintu Mathew. 2020. An Evaluation of Pie Menus for System Control in Virtual Reality. In Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society (Tallinn, Estonia) (NordiCHI ’20). Association for Computing Machinery, New York, NY, USA, Article 12, 8 pages. DOI: 10.1145/3419249.3420146
Yana Nehmé, Jean-Philippe Farrugia, Florent Dupont, Patrick Le Callet, and Guillaume Lavoué. 2021. Comparison of Subjective Methods for Quality Assessment of 3D Graphics in Virtual Reality. ACM Trans. Appl. Percept. 18, 1, Article 2 (Dec 2021), 23 pages. DOI: 10.1145/3427931
Yana Nehmé, Florent Dupont, Jean-Philippe Farrugia, Patrick Le Callet, and Guillaume Lavoué. 2021. Visual Quality of 3D Meshes With Diffuse Colors in Virtual Reality: Subjective and Objective Evaluation. IEEE Transactions on Visualization and Computer Graphics 27, 3 (March 2021), 2202–2219. DOI: 10.1109/TVCG.2020.3036153
Federica Pallavicini, Alessandro Pepe, Ambra Ferrari, Giacomo Garcea, Andrea Zanacchi, and Fabrizia Mantovani. 2020. What Is the Relationship Among Positive Emotions, Sense of Presence, and Ease of Interaction in Virtual Reality Systems? An On-Site Evaluation of a Commercial Virtual Experience. Presence 27, 2 (Feb 2020), 183–201. DOI: 10.1162/pres_a_00325
Ken Pfeuffer, Lukas Mecke, Sarah Delgado Rodriguez, Mariam Hassib, Hannah Maier, and Florian Alt. 2024. Gaze-enhanced Menus: Using Eye-tracking to Complement Multimodal Menus in Virtual Reality. In 2024 ACM Symposium on Spatial User Interaction (Online, CA, USA) (SUI ’24). Association for Computing Machinery, New York, NY, USA, 1–9. DOI: 10.1145/3365610.3365630
F. Gabriele Pratticò, Davide Calandra, Matteo Piviotti, and Fabrizio Lamberti. 2021. Assessing the User Experience of Consumer Haptic Devices for Simulation-based Virtual Reality. In 2021 IEEE 11th International Conference on Consumer Electronics (ICCE-Berlin). 1–6. DOI: 10.1109/ICCE-Berlin53567.2021.9719998
Min Chul Cha Reza Kazemi, Chae Heon Lim and Seul Chan Lee. 2023. Evaluation of Drag-and-Drop Task in Virtual Environment: Effects of Target Size and Movement Distance on Performances and Workload. International Journal of Human–Computer Interaction 0, 0 (2023), 1–10. DOI: 10.1080/10447318.2023.2276531 arXiv: [link]
Thomas Robotham, Olli S. Rummukainen, Miriam Kurz, Marie Eckert, and Emanuël A. P. Habets. 2022. Comparing Direct and Indirect Methods of Audio Quality Evaluation in Virtual Reality Scenes of Varying Complexity IEEE Transactions on Visualization and Computer Graphics 28, 5 (May 2022), 2091–2101. DOI: 10.1109/TVCG.2022.3150491
Lucas H Sallaberry, Romero Tori, and Fátima LS Nunes. 2022. Automatic performance assessment in three-dimensional interactive haptic medical simulators: A systematic review. Comput. Surveys 55, 7 (2022), 1–35.
Volkan Sevinc and Mehmet Ilker Berkman. 2020. Psychometric evaluation of Simulator Sickness Questionnaire and its variants as a measure of cybersickness in consumer virtual environments. Applied Ergonomics 82 (2020), 102958. DOI: 10.1016/j.apergo.2019.102958
William R Sherman and Alan B Craig. 2018. Understanding virtual reality: Interface, application, and design. Morgan Kaufmann.
Ting Han Jun Hu Chenqi Zhang Shuo Li, Hongtao Zheng and Cong Yu. 2023. Enhanced Presence Evaluation in Virtual Reality Feedback System with TOPSIS Model. International Journal of Human–Computer Interaction 0, 0 (2023), 1–15. DOI: 10.1080/10447318.2023.2263697 arXiv: [link]
Rijul Saurabh Soans, Remco J. Renken, Rohit Saxena, Radhika Tandon, Frans W. Cornelissen, and Tapan Kumar Gandhi. 2023. A Framework for the Continuous Evaluation of 3D Motion Perception in Virtual Reality. IEEE Transactions on Biomedical Engineering 70, 10 (Oct 2023), 2933–2942. DOI: 10.1109/TBME.2023.3271288
Eduardo Tanaka, Tiago Paula, Alisson Silva, Victor Antunes, Leonardo Domingues, Lucimara de Almeida, Alex Alves, and Roberta Oliveira. 2020. Evaluation of immersive virtual reality locomotion mechanisms. In Proceedings of the 19th Brazilian Symposium on Human Factors in
Computing Systems (Diamantina, Brazil) (IHC ’20). Association for Computing Machinery, New York, NY, USA, Article 47, 6 pages. DOI: 10.1145/3424953.3426550
Jeroen van der Hooft, Maria Torres Vega, Stefano Petrangeli, Tim Wauters, and Filip De Turck. 2019. Quality Assessment for Adaptive Virtual Reality Video Streaming: A Probabilistic Approach on the User’s Gaze. In 2019 22nd Conference on Innovation in Clouds, Internet and Networks and Workshops (ICIN). 19–24. DOI: 10.1109/ICIN.2019.8685904
Isabelina Nahmens William Carman, Laura Ikuma and Roberto Champney. 2023. Initial validation of the GUESS-18 for usability in virtual reality gaming environments: a pilot study. Theoretical Issues in Ergonomics Science 0, 0 (2023), 1–23. DOI: 10.1080/1463922X.2023.2166145 arXiv: [link]
Rui Wu, Jeevitha Pandurangaiah, Grayson Morgan Blankenship, Christopher Xavier Castro, Shanyue Guan, Andrew Ju, and Zhen Zhu. 2020. Evaluation of Virtual Reality Tracking Performance for Indoor Navigation. In 2020 IEEE/ION Position, Location and Navigation Symposium (PLANS). 1311–1316. DOI: 10.1109/PLANS46316.2020.9110225
Tingzhu Wu, Shijie Liang, Lili Zheng, Yue Lin, Ziquan Guo, Yulin Gao, Yijun Lu, Sung-Wen Huang Chen, Chun-Fu Lee, Jia-Rou Zhou, Hao-Chung Kuo, and Zhong Chen. 2019. Assessment and Optimization of the Circadian Performance of Smartphone-Based Virtual Reality Displays. IEEE Journal of the Electron Devices Society 7 (2019), 358–367. DOI: 10.1109/ JEDS.2019.2899646
Wenge Xu, Xuanru Meng, Kangyou Yu, Sayan Sarcar, and Hai-Ning Liang. 2022. Evaluation of Text Selection Techniques in Virtual Reality Head-Mounted Displays. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 131–140. DOI: 10.1109/ISMAR55827.2022.00027
Zhaoyu Yan, Jing Wang, and Zhuoran Li. 2019. A Multi-criteria Subjective Evaluation Method for Binaural Audio Rendering Techniques in Virtual Reality Applications. In 2019 IEEE International Conference on Multimedia Expo Workshops (ICMEW). 402–407. DOI: 10.1109/ICMEW.2019.00075
Suiang-Shyan Lee Yi-Jheng Huang, Kang-Yi Liu and I-Cheng Yeh. 2021. Evaluation of a Hybrid of Hand Gesture and Controller Inputs in Virtual Reality. International Journal of Human–Computer Interaction 37, 2 (2021), 169–180. DOI: 10.1080/10447318.2020.1809248 arXiv: [link]
Difeng Yu, Hai-Ning Liang, Kaixuan Fan, Heng Zhang, Charles Fleming, and Konstantinos Papangelis. 2020. Design and Evaluation of Visualization Techniques of Off-Screen and Occluded Targets in Virtual Reality Environments. IEEE Transactions on Visualization and Computer Graphics 26, 9 (Sep. 2020), 2762–2774. DOI: 10.1109/TVCG.2019.2905580
Publicado
30/09/2024
Como Citar
PERES, Fabiana Frata Furlan; NUNES, Fatima; TEIXEIRA, João Marcelo; MAURÍCIO, Claudio R. M.; CONCEIÇÃO, Katiani P.; YOSHIDA, Leina.
Methods for Evaluating Immersive 3D Virtual Environments: a Systematic Literature Review. In: SIMPÓSIO DE REALIDADE VIRTUAL E AUMENTADA (SVR), 26. , 2024, Manaus/AM.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2024
.
p. 140-151.
