Virtual MultiView Panels for Distant Object Interaction and Navigation in Virtual Reality
Resumo
In this paper we present a technique to improve interaction and navigation in virtual reality through the use of multiple virtual cameras projecting their view to windows around the user, expanding the through-the-lens metaphor to a virtual-drone metaphor, and making it possible for users to monitor, and navigate and interact with multiple occluded locations simultaneously using these windows. With this technique, users are able to reach anywhere in the virtual environment in an easy and fast way, without causing discomfort or disorientation. We evaluate the effectiveness of the proposed technique through a user study with two different tasks and assess the task completion performance, user behavior, and preference compared to other known methods.
Palavras-chave:
Virtual Reality, Large Environment, Visualization, Interaction Technique
Referências
Daniel Ablett, Andrew Cunningham, Gun A Lee, and Bruce H Thomas. 2022. Portal Rendering and Creation Interactions in Virtual Reality. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 160–168. https://doi.org/10.1109/ISMAR55827.2022.00030
Laurenz Berger and Katrin Wolf. 2018. WIM: Fast Locomotion in Virtual Reality with Spatial Orientation Gain & without Motion Sickness. In Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia (Cairo, Egypt) (MUM ’18). Association for Computing Machinery, New York, NY, USA, 19–24. https://doi.org/10.1145/3282894.3282932
Phanidhar Bezawada Raghupathy and Christoph W. Borst. 2011. Investigation of Secondary Views in a Multimodal VR Environment: 3D Lenses, Windows, and Mirrors. In Advances in Visual Computing. Springer Berlin Heidelberg, Berlin, Heidelberg, 180–189. https://doi.org/10.1007/978-3-642-24031-7_18
Doug A. Bowman, Donald B. Johnson, and Larry F. Hodges. 1999. Testbed Evaluation of Virtual Environment Interaction Techniques. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (London, United Kingdom) (VRST ’99). Association for Computing Machinery, New York, NY, USA, 26–33. https://doi.org/10.1145/323663.323667
John Brooke. 1996. Sus: a “quick and dirty’usability. Usability evaluation in industry 189, 3 (1996), 189–194.
Chris Christou and Poppy Aristidou. 2017. Steering Versus Teleport Locomotion for Head Mounted Displays. https://doi.org/10.1007/978-3-319-60928-7_37
Jeremy Clifton and Stephen Palmisano. 2020. Effects of Steering Locomotion and Teleporting on Cybersickness and Presence in HMD-Based Virtual Reality. Virtual Real. 24, 3 (sep 2020), 453–468. https://doi.org/10.1007/s10055-019-00407-8
Kurtis Danyluk and Wesley Willett. 2019. Evaluating the Performance of Virtual Reality Navigation Techniques for Large Environments. In Advances in Computer Graphics, Marina Gavrilova, Jian Chang, Nadia Magnenat Thalmann, Eckhard Hitzer, and Hiroshi Ishikawa (Eds.). Springer International Publishing, Cham, 203–215. https://doi.org/10.1007/978-3-030-22514-8_17
Carmine Elvezio, Mengu Sukan, Steven Feiner, and Barbara Tversky. 2017. Travel in large-scale head-worn VR: Pre-oriented teleportation with WIMs and previews. In 2017 IEEE Virtual Reality (VR). IEEE, 475–476. https://doi.org/10.1109/VR.2017.7892386
Barrett Ens, Juan David Hincapié-Ramos, and Pourang Irani. 2014. Ethereal Planes: A Design Framework for 2D Information Space in 3D Mixed Reality Environments. In Proceedings of the 2nd ACM Symposium on Spatial User Interaction (Honolulu, Hawaii, USA) (SUI ’14). Association for Computing Machinery, New York, NY, USA, 2–12. https://doi.org/10.1145/2659766.2659769
Michael Gleicher and Andrew Witkin. 1992. Through-the-Lens Camera Control. In Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’92). Association for Computing Machinery, New York, NY, USA, 331–340. https://doi.org/10.1145/133994.134088
Tovi Grossman and Ravin Balakrishnan. 2006. The Design and Evaluation of Selection Techniques for 3D Volumetric Displays. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (Montreux, Switzerland) (UIST ’06). Association for Computing Machinery, New York, NY, USA, 3–12. https://doi.org/10.1145/1166253.1166257
Dongyun Han, Donghoon Kim, and Isaac Cho. 2022. PORTAL: Portal Widget for Remote Target Acquisition and Control in Immersive Virtual Environments. , Article 16 (2022), 11 pages. https://doi.org/10.1145/3562939.3565639
Sandra G Hart. 2006. NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 50. Sage publications Sage CA: Los Angeles, CA, 904–908. https://doi.org/10.1177/154193120605000909
Malte Husung and Eike Langbehn. 2019. Of Portals and Orbs: An Evaluation of Scene Transition Techniques for Virtual Reality. In Proceedings of Mensch Und Computer 2019 (Hamburg, Germany) (MuC’19). Association for Computing Machinery, New York, NY, USA, 245–254. https://doi.org/10.1145/3340764.3340779
Dominik P. Käser, Evan Parker, Adam Glazier, Mike Podwal, Matt Seegmiller, Chun-Po Wang, Per Karlsson, Nadav Ashkenazi, Joanna Kim, Andre Le, Matthias Bühlmann, and Joshua Moshier. 2017. The Making of Google Earth VR. In ACM SIGGRAPH 2017 Talks (Los Angeles, California) (SIGGRAPH ’17). Association for Computing Machinery, New York, NY, USA, Article 63, 2 pages. https://doi.org/10.1145/3084363.3085094
Woojoo Kim and Shuping Xiong. 2022. ViewfinderVR: configurable viewfinder for selection of distant objects in VR. Virtual Reality 26, 4 (2022), 1573–1592. https://doi.org/10.1007/s10055-022-00649-z
Kiyoshi Kiyokawa and Haruo Takemura. 2005. A tunnel window and its variations: Seamless teleportation techniques in a virtual environment. In HCI International. Citeseer.
Andrey Krekhov, Sebastian Cmentowski, Katharina Emmerich, Maic Masuch, and Jens Krüger. 2018. GulliVR: A Walking-Oriented Technique for Navigation in Virtual Reality Games Based on Virtual Body Resizing. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (Melbourne, VIC, Australia) (CHI PLAY ’18). Association for Computing Machinery, New York, NY, USA, 243–256. https://doi.org/10.1145/3242671.3242704
Nianlong Li, Zhengquan Zhang, Can Liu, Zengyao Yang, Yinan Fu, Feng Tian, Teng Han, and Mingming Fan. 2021. VMirror: Enhancing the Interaction with Occluded or Distant Objects in VR with Virtual Mirrors. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article Berwaldt, Di Domenico and Pozzer 132, 11 pages. https://doi.org/10.1145/3411764.3445537
Jiazhou Liu, Arnaud Prouzeau, Barrett Ens, and Tim Dwyer. 2022. Effects of Display Layout on Spatial Memory for Immersive Environments. Proc. ACM Hum.-Comput. Interact. 6, ISS, Article 576 (nov 2022), 21 pages. https://doi.org/10.1145/3567729
Alejandro Martin-Gomez, Javad Fotouhi, Ulrich Eck, and Nassir Navab. 2020. Gain a new perspective: towards exploring multi-view alignment in mixed reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 207–216. https://doi.org/10.1109/ISMAR50242.2020.00044
Mark R. Mine. 1995. Virtual Environment Interaction Techniques. Technical Report. Chapel Hill, NC, USA.
Shohei Mori, Satoshi Hashiguchi, Fumihisa Shibata, and Asako Kimura. 2023. Point & Teleport with Orientation Specification, Revisited: Is Natural Turning Always Superior? Journal of Information Processing 31 (2023), 392–403. https://doi.org/10.2197/ipsjjip.31.392
Henning Pohl, Klemen Lilija, Jess McIntosh, and Kasper Hornbæk. 2021. Poros: Configurable Proxies for Distant Interactions in VR. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 532, 12 pages. https://doi.org/10.1145/3411764.3445685
Kadek Ananta Satriadi, Barrett Ens, Maxime Cordeil, Tobias Czauderna, and Bernhard Jenny. 2020. Maps Around Me: 3D Multiview Layouts in Immersive Spaces. Proc. ACM Hum.-Comput. Interact. 4, ISS, Article 201 (nov 2020), 20 pages. https://doi.org/10.1145/3427329
Arash Shahbaz Badr and Raffaele De Amicis. 2023. An empirical evaluation of enhanced teleportation for navigating large urban immersive virtual environments. Frontiers in Virtual Reality 3 (2023). https://doi.org/10.3389/frvir.2022.1075811
Richard Stoakley, Matthew J. Conway, and Randy Pausch. 1995. Virtual Reality on a WIM: Interactive Worlds in Miniature. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’95). ACM Press/Addison-Wesley Publishing Co., USA, 265–272. https://doi.org/10.1145/223904.223938
Stanislav L. Stoev and Dieter Schmalstieg. 2002. Application and Taxonomy of Through-the-Lens Techniques. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (Hong Kong, China) (VRST ’02). Association for Computing Machinery, New York, NY, USA, 57–64. https://doi.org/10.1145/585740.585751
Mengu Sukan, Steven Feiner, Barbara Tversky, and Semih Energin. 2012. Quick viewpoint switching for manipulating virtual objects in hand-held augmented reality using stored snapshots. In 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 217–226. https://doi.org/10.1109/ISMAR.2012.6402560
Laurenz Berger and Katrin Wolf. 2018. WIM: Fast Locomotion in Virtual Reality with Spatial Orientation Gain & without Motion Sickness. In Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia (Cairo, Egypt) (MUM ’18). Association for Computing Machinery, New York, NY, USA, 19–24. https://doi.org/10.1145/3282894.3282932
Phanidhar Bezawada Raghupathy and Christoph W. Borst. 2011. Investigation of Secondary Views in a Multimodal VR Environment: 3D Lenses, Windows, and Mirrors. In Advances in Visual Computing. Springer Berlin Heidelberg, Berlin, Heidelberg, 180–189. https://doi.org/10.1007/978-3-642-24031-7_18
Doug A. Bowman, Donald B. Johnson, and Larry F. Hodges. 1999. Testbed Evaluation of Virtual Environment Interaction Techniques. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (London, United Kingdom) (VRST ’99). Association for Computing Machinery, New York, NY, USA, 26–33. https://doi.org/10.1145/323663.323667
John Brooke. 1996. Sus: a “quick and dirty’usability. Usability evaluation in industry 189, 3 (1996), 189–194.
Chris Christou and Poppy Aristidou. 2017. Steering Versus Teleport Locomotion for Head Mounted Displays. https://doi.org/10.1007/978-3-319-60928-7_37
Jeremy Clifton and Stephen Palmisano. 2020. Effects of Steering Locomotion and Teleporting on Cybersickness and Presence in HMD-Based Virtual Reality. Virtual Real. 24, 3 (sep 2020), 453–468. https://doi.org/10.1007/s10055-019-00407-8
Kurtis Danyluk and Wesley Willett. 2019. Evaluating the Performance of Virtual Reality Navigation Techniques for Large Environments. In Advances in Computer Graphics, Marina Gavrilova, Jian Chang, Nadia Magnenat Thalmann, Eckhard Hitzer, and Hiroshi Ishikawa (Eds.). Springer International Publishing, Cham, 203–215. https://doi.org/10.1007/978-3-030-22514-8_17
Carmine Elvezio, Mengu Sukan, Steven Feiner, and Barbara Tversky. 2017. Travel in large-scale head-worn VR: Pre-oriented teleportation with WIMs and previews. In 2017 IEEE Virtual Reality (VR). IEEE, 475–476. https://doi.org/10.1109/VR.2017.7892386
Barrett Ens, Juan David Hincapié-Ramos, and Pourang Irani. 2014. Ethereal Planes: A Design Framework for 2D Information Space in 3D Mixed Reality Environments. In Proceedings of the 2nd ACM Symposium on Spatial User Interaction (Honolulu, Hawaii, USA) (SUI ’14). Association for Computing Machinery, New York, NY, USA, 2–12. https://doi.org/10.1145/2659766.2659769
Michael Gleicher and Andrew Witkin. 1992. Through-the-Lens Camera Control. In Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’92). Association for Computing Machinery, New York, NY, USA, 331–340. https://doi.org/10.1145/133994.134088
Tovi Grossman and Ravin Balakrishnan. 2006. The Design and Evaluation of Selection Techniques for 3D Volumetric Displays. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (Montreux, Switzerland) (UIST ’06). Association for Computing Machinery, New York, NY, USA, 3–12. https://doi.org/10.1145/1166253.1166257
Dongyun Han, Donghoon Kim, and Isaac Cho. 2022. PORTAL: Portal Widget for Remote Target Acquisition and Control in Immersive Virtual Environments. , Article 16 (2022), 11 pages. https://doi.org/10.1145/3562939.3565639
Sandra G Hart. 2006. NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 50. Sage publications Sage CA: Los Angeles, CA, 904–908. https://doi.org/10.1177/154193120605000909
Malte Husung and Eike Langbehn. 2019. Of Portals and Orbs: An Evaluation of Scene Transition Techniques for Virtual Reality. In Proceedings of Mensch Und Computer 2019 (Hamburg, Germany) (MuC’19). Association for Computing Machinery, New York, NY, USA, 245–254. https://doi.org/10.1145/3340764.3340779
Dominik P. Käser, Evan Parker, Adam Glazier, Mike Podwal, Matt Seegmiller, Chun-Po Wang, Per Karlsson, Nadav Ashkenazi, Joanna Kim, Andre Le, Matthias Bühlmann, and Joshua Moshier. 2017. The Making of Google Earth VR. In ACM SIGGRAPH 2017 Talks (Los Angeles, California) (SIGGRAPH ’17). Association for Computing Machinery, New York, NY, USA, Article 63, 2 pages. https://doi.org/10.1145/3084363.3085094
Woojoo Kim and Shuping Xiong. 2022. ViewfinderVR: configurable viewfinder for selection of distant objects in VR. Virtual Reality 26, 4 (2022), 1573–1592. https://doi.org/10.1007/s10055-022-00649-z
Kiyoshi Kiyokawa and Haruo Takemura. 2005. A tunnel window and its variations: Seamless teleportation techniques in a virtual environment. In HCI International. Citeseer.
Andrey Krekhov, Sebastian Cmentowski, Katharina Emmerich, Maic Masuch, and Jens Krüger. 2018. GulliVR: A Walking-Oriented Technique for Navigation in Virtual Reality Games Based on Virtual Body Resizing. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (Melbourne, VIC, Australia) (CHI PLAY ’18). Association for Computing Machinery, New York, NY, USA, 243–256. https://doi.org/10.1145/3242671.3242704
Nianlong Li, Zhengquan Zhang, Can Liu, Zengyao Yang, Yinan Fu, Feng Tian, Teng Han, and Mingming Fan. 2021. VMirror: Enhancing the Interaction with Occluded or Distant Objects in VR with Virtual Mirrors. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article Berwaldt, Di Domenico and Pozzer 132, 11 pages. https://doi.org/10.1145/3411764.3445537
Jiazhou Liu, Arnaud Prouzeau, Barrett Ens, and Tim Dwyer. 2022. Effects of Display Layout on Spatial Memory for Immersive Environments. Proc. ACM Hum.-Comput. Interact. 6, ISS, Article 576 (nov 2022), 21 pages. https://doi.org/10.1145/3567729
Alejandro Martin-Gomez, Javad Fotouhi, Ulrich Eck, and Nassir Navab. 2020. Gain a new perspective: towards exploring multi-view alignment in mixed reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 207–216. https://doi.org/10.1109/ISMAR50242.2020.00044
Mark R. Mine. 1995. Virtual Environment Interaction Techniques. Technical Report. Chapel Hill, NC, USA.
Shohei Mori, Satoshi Hashiguchi, Fumihisa Shibata, and Asako Kimura. 2023. Point & Teleport with Orientation Specification, Revisited: Is Natural Turning Always Superior? Journal of Information Processing 31 (2023), 392–403. https://doi.org/10.2197/ipsjjip.31.392
Henning Pohl, Klemen Lilija, Jess McIntosh, and Kasper Hornbæk. 2021. Poros: Configurable Proxies for Distant Interactions in VR. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 532, 12 pages. https://doi.org/10.1145/3411764.3445685
Kadek Ananta Satriadi, Barrett Ens, Maxime Cordeil, Tobias Czauderna, and Bernhard Jenny. 2020. Maps Around Me: 3D Multiview Layouts in Immersive Spaces. Proc. ACM Hum.-Comput. Interact. 4, ISS, Article 201 (nov 2020), 20 pages. https://doi.org/10.1145/3427329
Arash Shahbaz Badr and Raffaele De Amicis. 2023. An empirical evaluation of enhanced teleportation for navigating large urban immersive virtual environments. Frontiers in Virtual Reality 3 (2023). https://doi.org/10.3389/frvir.2022.1075811
Richard Stoakley, Matthew J. Conway, and Randy Pausch. 1995. Virtual Reality on a WIM: Interactive Worlds in Miniature. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’95). ACM Press/Addison-Wesley Publishing Co., USA, 265–272. https://doi.org/10.1145/223904.223938
Stanislav L. Stoev and Dieter Schmalstieg. 2002. Application and Taxonomy of Through-the-Lens Techniques. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (Hong Kong, China) (VRST ’02). Association for Computing Machinery, New York, NY, USA, 57–64. https://doi.org/10.1145/585740.585751
Mengu Sukan, Steven Feiner, Barbara Tversky, and Semih Energin. 2012. Quick viewpoint switching for manipulating virtual objects in hand-held augmented reality using stored snapshots. In 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 217–226. https://doi.org/10.1109/ISMAR.2012.6402560
Publicado
06/11/2023
Como Citar
BERWALDT, Natan Luiz Paetzhold; DI DOMENICO, Gabriel; POZZER, Cesar Tadeu.
Virtual MultiView Panels for Distant Object Interaction and Navigation in Virtual Reality. In: SIMPÓSIO DE REALIDADE VIRTUAL E AUMENTADA (SVR), 25. , 2023, Rio Grande/RS.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2023
.
p. 88–95.
