DeAR: Combining Desktop and Augmented Reality for Visual Data Analysis
Resumo
Combining different interfaces and displays might enhance the capabilities of data analysis, particularly in the context of Immersive Analytics. In this work, we design a prototype, called DeAR (Combining Desktop and Augmented Reality for Visual Data Analysis), which integrates a desktop environment with an augmented reality one. DeAR enables users to interact with both environments simultaneously, facilitating visualizations comparisons and diverse data analysis tasks. With our prototype, users can interact with two visualization paradigms, with changes made to visualizations in one being reflected in the other. We describe a use case scenario to demonstrate how our proposed design could facilitate exploration and selection tasks. The primary contribution of our work lies in the design and implementation of a proof-of-concept prototype, named DeAR, that allows interaction with data in hybrid environments. This prototype combines heterogeneous interfaces and displays, providing new opportunities for data analysis.
Palavras-chave:
Immersive Analytics, Visualization, Augmented Reality, Hybrid User Interfaces, HCI
Referências
Matthew Brehmer, Bongshin Lee, Petra Isenberg, and Eun Kyoung Choe. 2020. A Comparative Evaluation of Animation and Small Multiples for Trend Visualization on Mobile Phones. IEEE Transactions on Visualization and Computer Graphics 26, 1 (2020), 364–374. https://doi.org/10.1109/TVCG.2019.2934397
Maxime Cordeil, Andrew Cunningham, Benjamin Bach, Christophe Hurter, Bruce H. Thomas, Kim Marriott, and Tim Dwyer. 2019. IATK: An Immersive Analytics Toolkit. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 200–209. https://doi.org/10.1109/VR.2019.8797978
Tim Dwyer, Kim Marriott, Tobias Isenberg, Karsten Klein, Nathalie Riche, Falk Schreiber, Wolfgang Stuerzlinger, and Bruce H. Thomas. 2018. Immersive Analytics: An Introduction. Springer International Publishing, Cham, 1–23. https://doi.org/10.1007/978-3-030-01388-2_1
Steven Feiner and Ari Shamash. 1991. Hybrid User Interfaces: Breeding Virtually Bigger Interfaces for Physically Smaller Computers. In Proceedings of the 4th Annual ACM Symposium on User Interface Software and Technology (Hilton Head, South Carolina, USA) (UIST ’91). Association for Computing Machinery, New York, NY, USA, 9–17. https://doi.org/10.1145/120782.120783
Jorge A. Wagner Filho, Carla M. D. S. Freitas, and Luciana Nedel. 2019. Comfortable Immersive Analytics With the VirtualDesk Metaphor. IEEE Computer Graphics and Applications 39, 3 (2019), 41–53. https://doi.org/10.1109/MCG.2019.2898856
Sebastian Hubenschmid, Johannes Zagermann, Simon Butscher, and Harald Reiterer. 2021. STREAM: Exploring the Combination of Spatially-Aware Tablets with Augmented Reality Head-Mounted Displays for Immersive Analytics. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 469, 14 pages. https://doi.org/10.1145/3411764.3445298
Sebastian Hubenschmid, Johannes Zagermann, Daniel Fink, Jonathan Wieland, Tiare Feuchtner, and Harald Reiterer. 2021. Towards Asynchronous Hybrid User Interfaces for Cross-Reality Interaction. In ISS’21 Workshop Proceedings: "Transitional Interfaces in Mixed and Cross-Reality: A new frontier?", Hans-Christian Jetter, Jan-Henrik Schröder, Jan Gugenheimer, Mark Billinghurst, Christoph Anthes, Mohamed Khamis, and Tiare Feuchtner (Eds.). https://doi.org/10.18148/kops/352-2-84mm0sggczq02
Ricardo Langner, Marc Satkowski, Wolfgang Büschel, and Raimund Dachselt. 2021. MARVIS: Combining Mobile Devices and Augmented Reality for Visual Data Analysis. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 468, 17 pages. https://doi.org/10.1145/3411764.3445593
T. Munzner. 2015. Visualization Analysis and Design. CRC Press. https://books.google.de/books?id=NfkYCwAAQBAJ
Carole Plasson, Renaud Blanch, and Laurence Nigay. 2022. Selection Techniques for 3D Extended Desktop Workstation with AR HMD. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 460–469. https://doi.org/10.1109/ISMAR55827.2022.00062
Patrick Reipschlager, Tamara Flemisch, and Raimund Dachselt. 2021. Personal Augmented Reality for Information Visualization on Large Interactive Displays. IEEE Transactions on Visualization and Computer Graphics 27, 2 (2021), 1182–1192. https://doi.org/10.1109/TVCG.2020.3030460
George Robertson, Roland Fernandez, Danyel Fisher, Bongshin Lee, and John Stasko. 2008. Effectiveness of Animation in Trend Visualization. IEEE Transactions on Visualization and Computer Graphics 14, 6 (2008), 1325–1332. https://doi.org/10.1109/TVCG.2008.125
Bahador Saket, Alex Endert, and Çağatay Demiralp. 2019. Task-Based Effectiveness of Basic Visualizations. IEEE Transactions on Visualization and Computer Graphics 25, 7 (2019), 2505–2512. https://doi.org/10.1109/TVCG.2018.2829750
Ronell Sicat, Jiabao Li, Junyoung Choi, Maxime Cordeil, Won-Ki Jeong, Benjamin Bach, and Hanspeter Pfister. 2019. DXR: A Toolkit for Building Immersive Data Visualizations. IEEE Transactions on Visualization and Computer Graphics 25, 1 (2019), 715–725. https://doi.org/10.1109/TVCG.2018.2865152
Xiyao Wang, Lonni Besançon, David Rousseau, Mickael Sereno, Mehdi Ammi, and Tobias Isenberg. 2020. Towards an Understanding of Augmented Reality Extensions for Existing 3D Data Analysis Tools. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376657
Maxime Cordeil, Andrew Cunningham, Benjamin Bach, Christophe Hurter, Bruce H. Thomas, Kim Marriott, and Tim Dwyer. 2019. IATK: An Immersive Analytics Toolkit. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 200–209. https://doi.org/10.1109/VR.2019.8797978
Tim Dwyer, Kim Marriott, Tobias Isenberg, Karsten Klein, Nathalie Riche, Falk Schreiber, Wolfgang Stuerzlinger, and Bruce H. Thomas. 2018. Immersive Analytics: An Introduction. Springer International Publishing, Cham, 1–23. https://doi.org/10.1007/978-3-030-01388-2_1
Steven Feiner and Ari Shamash. 1991. Hybrid User Interfaces: Breeding Virtually Bigger Interfaces for Physically Smaller Computers. In Proceedings of the 4th Annual ACM Symposium on User Interface Software and Technology (Hilton Head, South Carolina, USA) (UIST ’91). Association for Computing Machinery, New York, NY, USA, 9–17. https://doi.org/10.1145/120782.120783
Jorge A. Wagner Filho, Carla M. D. S. Freitas, and Luciana Nedel. 2019. Comfortable Immersive Analytics With the VirtualDesk Metaphor. IEEE Computer Graphics and Applications 39, 3 (2019), 41–53. https://doi.org/10.1109/MCG.2019.2898856
Sebastian Hubenschmid, Johannes Zagermann, Simon Butscher, and Harald Reiterer. 2021. STREAM: Exploring the Combination of Spatially-Aware Tablets with Augmented Reality Head-Mounted Displays for Immersive Analytics. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 469, 14 pages. https://doi.org/10.1145/3411764.3445298
Sebastian Hubenschmid, Johannes Zagermann, Daniel Fink, Jonathan Wieland, Tiare Feuchtner, and Harald Reiterer. 2021. Towards Asynchronous Hybrid User Interfaces for Cross-Reality Interaction. In ISS’21 Workshop Proceedings: "Transitional Interfaces in Mixed and Cross-Reality: A new frontier?", Hans-Christian Jetter, Jan-Henrik Schröder, Jan Gugenheimer, Mark Billinghurst, Christoph Anthes, Mohamed Khamis, and Tiare Feuchtner (Eds.). https://doi.org/10.18148/kops/352-2-84mm0sggczq02
Ricardo Langner, Marc Satkowski, Wolfgang Büschel, and Raimund Dachselt. 2021. MARVIS: Combining Mobile Devices and Augmented Reality for Visual Data Analysis. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 468, 17 pages. https://doi.org/10.1145/3411764.3445593
T. Munzner. 2015. Visualization Analysis and Design. CRC Press. https://books.google.de/books?id=NfkYCwAAQBAJ
Carole Plasson, Renaud Blanch, and Laurence Nigay. 2022. Selection Techniques for 3D Extended Desktop Workstation with AR HMD. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 460–469. https://doi.org/10.1109/ISMAR55827.2022.00062
Patrick Reipschlager, Tamara Flemisch, and Raimund Dachselt. 2021. Personal Augmented Reality for Information Visualization on Large Interactive Displays. IEEE Transactions on Visualization and Computer Graphics 27, 2 (2021), 1182–1192. https://doi.org/10.1109/TVCG.2020.3030460
George Robertson, Roland Fernandez, Danyel Fisher, Bongshin Lee, and John Stasko. 2008. Effectiveness of Animation in Trend Visualization. IEEE Transactions on Visualization and Computer Graphics 14, 6 (2008), 1325–1332. https://doi.org/10.1109/TVCG.2008.125
Bahador Saket, Alex Endert, and Çağatay Demiralp. 2019. Task-Based Effectiveness of Basic Visualizations. IEEE Transactions on Visualization and Computer Graphics 25, 7 (2019), 2505–2512. https://doi.org/10.1109/TVCG.2018.2829750
Ronell Sicat, Jiabao Li, Junyoung Choi, Maxime Cordeil, Won-Ki Jeong, Benjamin Bach, and Hanspeter Pfister. 2019. DXR: A Toolkit for Building Immersive Data Visualizations. IEEE Transactions on Visualization and Computer Graphics 25, 1 (2019), 715–725. https://doi.org/10.1109/TVCG.2018.2865152
Xiyao Wang, Lonni Besançon, David Rousseau, Mickael Sereno, Mehdi Ammi, and Tobias Isenberg. 2020. Towards an Understanding of Augmented Reality Extensions for Existing 3D Data Analysis Tools. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376657
Publicado
06/11/2023
Como Citar
IQUIAPAZA, Yhonatan; WAGNER, Jorge; NEDEL, Luciana.
DeAR: Combining Desktop and Augmented Reality for Visual Data Analysis. In: SIMPÓSIO DE REALIDADE VIRTUAL E AUMENTADA (SVR), 25. , 2023, Rio Grande/RS.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2023
.
p. 233–237.
