DeAR: Combining Desktop and Augmented Reality for Visual Data Analysis

  • Yhonatan Iquiapaza UFRGS
  • Jorge Wagner UFRGS
  • Luciana Nedel UFRGS

Resumo


Combining different interfaces and displays might enhance the capabilities of data analysis, particularly in the context of Immersive Analytics. In this work, we design a prototype, called DeAR (Combining Desktop and Augmented Reality for Visual Data Analysis), which integrates a desktop environment with an augmented reality one. DeAR enables users to interact with both environments simultaneously, facilitating visualizations comparisons and diverse data analysis tasks. With our prototype, users can interact with two visualization paradigms, with changes made to visualizations in one being reflected in the other. We describe a use case scenario to demonstrate how our proposed design could facilitate exploration and selection tasks. The primary contribution of our work lies in the design and implementation of a proof-of-concept prototype, named DeAR, that allows interaction with data in hybrid environments. This prototype combines heterogeneous interfaces and displays, providing new opportunities for data analysis.
Palavras-chave: Immersive Analytics, Visualization, Augmented Reality, Hybrid User Interfaces, HCI

Referências

Matthew Brehmer, Bongshin Lee, Petra Isenberg, and Eun Kyoung Choe. 2020. A Comparative Evaluation of Animation and Small Multiples for Trend Visualization on Mobile Phones. IEEE Transactions on Visualization and Computer Graphics 26, 1 (2020), 364–374. https://doi.org/10.1109/TVCG.2019.2934397

Maxime Cordeil, Andrew Cunningham, Benjamin Bach, Christophe Hurter, Bruce H. Thomas, Kim Marriott, and Tim Dwyer. 2019. IATK: An Immersive Analytics Toolkit. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 200–209. https://doi.org/10.1109/VR.2019.8797978

Tim Dwyer, Kim Marriott, Tobias Isenberg, Karsten Klein, Nathalie Riche, Falk Schreiber, Wolfgang Stuerzlinger, and Bruce H. Thomas. 2018. Immersive Analytics: An Introduction. Springer International Publishing, Cham, 1–23. https://doi.org/10.1007/978-3-030-01388-2_1

Steven Feiner and Ari Shamash. 1991. Hybrid User Interfaces: Breeding Virtually Bigger Interfaces for Physically Smaller Computers. In Proceedings of the 4th Annual ACM Symposium on User Interface Software and Technology (Hilton Head, South Carolina, USA) (UIST ’91). Association for Computing Machinery, New York, NY, USA, 9–17. https://doi.org/10.1145/120782.120783

Jorge A. Wagner Filho, Carla M. D. S. Freitas, and Luciana Nedel. 2019. Comfortable Immersive Analytics With the VirtualDesk Metaphor. IEEE Computer Graphics and Applications 39, 3 (2019), 41–53. https://doi.org/10.1109/MCG.2019.2898856

Sebastian Hubenschmid, Johannes Zagermann, Simon Butscher, and Harald Reiterer. 2021. STREAM: Exploring the Combination of Spatially-Aware Tablets with Augmented Reality Head-Mounted Displays for Immersive Analytics. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 469, 14 pages. https://doi.org/10.1145/3411764.3445298

Sebastian Hubenschmid, Johannes Zagermann, Daniel Fink, Jonathan Wieland, Tiare Feuchtner, and Harald Reiterer. 2021. Towards Asynchronous Hybrid User Interfaces for Cross-Reality Interaction. In ISS’21 Workshop Proceedings: "Transitional Interfaces in Mixed and Cross-Reality: A new frontier?", Hans-Christian Jetter, Jan-Henrik Schröder, Jan Gugenheimer, Mark Billinghurst, Christoph Anthes, Mohamed Khamis, and Tiare Feuchtner (Eds.). https://doi.org/10.18148/kops/352-2-84mm0sggczq02

Ricardo Langner, Marc Satkowski, Wolfgang Büschel, and Raimund Dachselt. 2021. MARVIS: Combining Mobile Devices and Augmented Reality for Visual Data Analysis. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 468, 17 pages. https://doi.org/10.1145/3411764.3445593

T. Munzner. 2015. Visualization Analysis and Design. CRC Press. https://books.google.de/books?id=NfkYCwAAQBAJ

Carole Plasson, Renaud Blanch, and Laurence Nigay. 2022. Selection Techniques for 3D Extended Desktop Workstation with AR HMD. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 460–469. https://doi.org/10.1109/ISMAR55827.2022.00062

Patrick Reipschlager, Tamara Flemisch, and Raimund Dachselt. 2021. Personal Augmented Reality for Information Visualization on Large Interactive Displays. IEEE Transactions on Visualization and Computer Graphics 27, 2 (2021), 1182–1192. https://doi.org/10.1109/TVCG.2020.3030460

George Robertson, Roland Fernandez, Danyel Fisher, Bongshin Lee, and John Stasko. 2008. Effectiveness of Animation in Trend Visualization. IEEE Transactions on Visualization and Computer Graphics 14, 6 (2008), 1325–1332. https://doi.org/10.1109/TVCG.2008.125

Bahador Saket, Alex Endert, and Çağatay Demiralp. 2019. Task-Based Effectiveness of Basic Visualizations. IEEE Transactions on Visualization and Computer Graphics 25, 7 (2019), 2505–2512. https://doi.org/10.1109/TVCG.2018.2829750

Ronell Sicat, Jiabao Li, Junyoung Choi, Maxime Cordeil, Won-Ki Jeong, Benjamin Bach, and Hanspeter Pfister. 2019. DXR: A Toolkit for Building Immersive Data Visualizations. IEEE Transactions on Visualization and Computer Graphics 25, 1 (2019), 715–725. https://doi.org/10.1109/TVCG.2018.2865152

Xiyao Wang, Lonni Besançon, David Rousseau, Mickael Sereno, Mehdi Ammi, and Tobias Isenberg. 2020. Towards an Understanding of Augmented Reality Extensions for Existing 3D Data Analysis Tools. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376657
Publicado
06/11/2023
IQUIAPAZA, Yhonatan; WAGNER, Jorge; NEDEL, Luciana. DeAR: Combining Desktop and Augmented Reality for Visual Data Analysis. In: SIMPÓSIO DE REALIDADE VIRTUAL E AUMENTADA (SVR), 25. , 2023, Rio Grande/RS. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2023 . p. 233–237.