ABSTRACT
Combining different interfaces and displays might enhance the capabilities of data analysis, particularly in the context of Immersive Analytics. In this work, we design a prototype, called DeAR (Combining Desktop and Augmented Reality for Visual Data Analysis), which integrates a desktop environment with an augmented reality one. DeAR enables users to interact with both environments simultaneously, facilitating visualizations comparisons and diverse data analysis tasks. With our prototype, users can interact with two visualization paradigms, with changes made to visualizations in one being reflected in the other. We describe a use case scenario to demonstrate how our proposed design could facilitate exploration and selection tasks. The primary contribution of our work lies in the design and implementation of a proof-of-concept prototype, named DeAR, that allows interaction with data in hybrid environments. This prototype combines heterogeneous interfaces and displays, providing new opportunities for data analysis.
Supplemental Material
Available for Download
Poster
- Matthew Brehmer, Bongshin Lee, Petra Isenberg, and Eun Kyoung Choe. 2020. A Comparative Evaluation of Animation and Small Multiples for Trend Visualization on Mobile Phones. IEEE Transactions on Visualization and Computer Graphics 26, 1 (2020), 364–374. https://doi.org/10.1109/TVCG.2019.2934397Google ScholarCross Ref
- Maxime Cordeil, Andrew Cunningham, Benjamin Bach, Christophe Hurter, Bruce H. Thomas, Kim Marriott, and Tim Dwyer. 2019. IATK: An Immersive Analytics Toolkit. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 200–209. https://doi.org/10.1109/VR.2019.8797978Google ScholarCross Ref
- Tim Dwyer, Kim Marriott, Tobias Isenberg, Karsten Klein, Nathalie Riche, Falk Schreiber, Wolfgang Stuerzlinger, and Bruce H. Thomas. 2018. Immersive Analytics: An Introduction. Springer International Publishing, Cham, 1–23. https://doi.org/10.1007/978-3-030-01388-2_1Google ScholarCross Ref
- Steven Feiner and Ari Shamash. 1991. Hybrid User Interfaces: Breeding Virtually Bigger Interfaces for Physically Smaller Computers. In Proceedings of the 4th Annual ACM Symposium on User Interface Software and Technology (Hilton Head, South Carolina, USA) (UIST ’91). Association for Computing Machinery, New York, NY, USA, 9–17. https://doi.org/10.1145/120782.120783Google ScholarDigital Library
- Jorge A. Wagner Filho, Carla M. D. S. Freitas, and Luciana Nedel. 2019. Comfortable Immersive Analytics With the VirtualDesk Metaphor. IEEE Computer Graphics and Applications 39, 3 (2019), 41–53. https://doi.org/10.1109/MCG.2019.2898856Google ScholarDigital Library
- Sebastian Hubenschmid, Johannes Zagermann, Simon Butscher, and Harald Reiterer. 2021. STREAM: Exploring the Combination of Spatially-Aware Tablets with Augmented Reality Head-Mounted Displays for Immersive Analytics. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 469, 14 pages. https://doi.org/10.1145/3411764.3445298Google ScholarDigital Library
- Sebastian Hubenschmid, Johannes Zagermann, Daniel Fink, Jonathan Wieland, Tiare Feuchtner, and Harald Reiterer. 2021. Towards Asynchronous Hybrid User Interfaces for Cross-Reality Interaction. In ISS’21 Workshop Proceedings: "Transitional Interfaces in Mixed and Cross-Reality: A new frontier?", Hans-Christian Jetter, Jan-Henrik Schröder, Jan Gugenheimer, Mark Billinghurst, Christoph Anthes, Mohamed Khamis, and Tiare Feuchtner (Eds.). https://doi.org/10.18148/kops/352-2-84mm0sggczq02Google ScholarCross Ref
- Ricardo Langner, Marc Satkowski, Wolfgang Büschel, and Raimund Dachselt. 2021. MARVIS: Combining Mobile Devices and Augmented Reality for Visual Data Analysis. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 468, 17 pages. https://doi.org/10.1145/3411764.3445593Google ScholarDigital Library
- T. Munzner. 2015. Visualization Analysis and Design. CRC Press. https://books.google.de/books?id=NfkYCwAAQBAJGoogle Scholar
- Carole Plasson, Renaud Blanch, and Laurence Nigay. 2022. Selection Techniques for 3D Extended Desktop Workstation with AR HMD. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 460–469. https://doi.org/10.1109/ISMAR55827.2022.00062Google ScholarCross Ref
- Patrick Reipschlager, Tamara Flemisch, and Raimund Dachselt. 2021. Personal Augmented Reality for Information Visualization on Large Interactive Displays. IEEE Transactions on Visualization and Computer Graphics 27, 2 (2021), 1182–1192. https://doi.org/10.1109/TVCG.2020.3030460Google ScholarCross Ref
- George Robertson, Roland Fernandez, Danyel Fisher, Bongshin Lee, and John Stasko. 2008. Effectiveness of Animation in Trend Visualization. IEEE Transactions on Visualization and Computer Graphics 14, 6 (2008), 1325–1332. https://doi.org/10.1109/TVCG.2008.125Google ScholarDigital Library
- Bahador Saket, Alex Endert, and Çağatay Demiralp. 2019. Task-Based Effectiveness of Basic Visualizations. IEEE Transactions on Visualization and Computer Graphics 25, 7 (2019), 2505–2512. https://doi.org/10.1109/TVCG.2018.2829750Google ScholarCross Ref
- Ronell Sicat, Jiabao Li, Junyoung Choi, Maxime Cordeil, Won-Ki Jeong, Benjamin Bach, and Hanspeter Pfister. 2019. DXR: A Toolkit for Building Immersive Data Visualizations. IEEE Transactions on Visualization and Computer Graphics 25, 1 (2019), 715–725. https://doi.org/10.1109/TVCG.2018.2865152Google ScholarDigital Library
- Xiyao Wang, Lonni Besançon, David Rousseau, Mickael Sereno, Mehdi Ammi, and Tobias Isenberg. 2020. Towards an Understanding of Augmented Reality Extensions for Existing 3D Data Analysis Tools. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376657Google ScholarDigital Library
Index Terms
- DeAR: Combining Desktop and Augmented Reality for Visual Data Analysis
Recommendations
MARVIS: Combining Mobile Devices and Augmented Reality for Visual Data Analysis
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsWe present Marvis, a conceptual framework that combines mobile devices and head-mounted Augmented Reality (AR) for visual data analysis. We propose novel concepts and techniques addressing visualization-specific challenges. By showing additional 2D and ...
A Pilot Study Comparing User Interactions Between Augmented and Virtual Reality
Advances in Visual ComputingAbstractImmersive Analytics (IA) and consumer adoption of augmented reality (AR) and virtual reality (VR) head-mounted displays (HMDs) are both rapidly growing. When used in conjunction, stereoscopic IA environments can offer improved user understanding ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Comments