Human+Human or Human+AI: A Comparative Analysis of a Narrative Visualization Design Guide

• Mariana Gomes Borges Pontifical Catholic University of Rio Grande do Sul https://orcid.org/0000-0002-0085-5696
• Claiton Marques Correa Farroupilha Federal Institute / Pontifical Catholic University of Rio Grande do Sul http://orcid.org/0000-0003-2339-1844
• Milene Selbach Silveira Pontifical Catholic University of Rio Grande do Sul https://orcid.org/0000-0003-2159-551

Abstract

Narrative visualizations integrate storytelling techniques with data visualization to enhance user engagement and understanding. These visualizations facilitate a more intuitive grasp of complex information. In this context, we developed a guide to support designers in creating such visualizations. This guide outlines systematic steps to identify suitable narrative genres and data visualization techniques recommended for planning a narrative data visualization. The guide’s clarity and applicability were assessed through two studies. The first study, with data visualization professionals, allowed the guide’s utility to be evaluated in a real-world setting, with participants who bring specific industry experiences and knowledge. The second one, utilizing emerging AI technology, specifically ChatGPT 4.0, besides testing the guide’s comprehensibility and usability, enabled the analysis of using innovative applications for simulating user interactions. Considering the studies’ results, despite some adjustments, the guide proved especially beneficial for professionals without prior knowledge of narrative elements, as it clarified numerous queries and facilitated the visualization process. Interaction via ChatGPT 4.0 provided insights into the guide’s usability and effectiveness across different user types, suggesting further improvements. Based on the findings, the guide is proposed to be revised to incorporate the suggestions and then be re-evaluated in further studies. Additionally, the study brings a reflection on the interactions and outcomes with human professionals and with an AI tool, highlighting differences, similarities, and limitations, paving the way for the development of AI-driven recommendation tools that can dynamically suggest narrative structures and visualization techniques tailored to specific datasets and user needs.

Keywords: narrative visualization, storytelling techniques, narrative genres, ChatGPT 4.0, user studies

References

Mariana Borges, Claiton Marques Correa, and Milene Selbach Silveira. 2022. Fundamental elements and characteristics for telling stories using data. Journal on Interactive Systems 13, 1 (Jun. 2022), 77–86. DOI: 10.5753/jis.2022.2330

Mariana Gomes Borges. 2022. Apoio à construção de visualizações narrativas de dados com ênfase em gêneros narrativos. Master’s thesis. Pontifícia Universidade Católica do Rio Grande do Sul.

Claiton Marques Correa. 2023. An Approach for Designing and Exploring Customizable Narrative Data Visualizations. Ph. D. Dissertation. Pontifícia Universidade Católica do Rio Grande do Sul (PUCRS).

Claiton Marques Correa, Gabriel Diniz Junqueira Barbosa, Simone Diniz Junqueira Barbosa, and Milene Selbach Silveira. 2022. HCI Research Experiences during the Pandemic: Lessons Learned for the Road Ahead. Interacting With Computers 1 (Nov 2022), 1–15.

Shan Hao, Zezhong Wang, Benjamin Bach, and Larissa Pschetz. 2024. Design Patterns for Data-Driven News Articles. In SIGCHI Conference on Human Factors in Computing Systems. 1–16.

Hossein Hassani and Emmanuel Sirmal Silva. 2023. The Role of ChatGPT in Data Science: How AI-Assisted Conversational Interfaces Are Revolutionizing the Field. Big Data and Cognitive Computing 7 (Mar 2023), 1–16.

Bongshin Lee, Nathalie Henry Riche, Petra Isenberg, and Sheelagh Carpendale. 2015. More than telling a story: Transforming data into visually shared stories. IEEE Computer Graphics and Applications 35 (Sep 2015), 84–90.

Haotian Li, Yun Wang, and Huamin Qu. 2024. Where Are We So Far? Understanding Data Storytelling Tools from the Perspective of Human-AI Collaboration. In SIGCHI Conference on Human Factors in Computing Systems. 1–19.

Ali Soyoof Ngo Cong-Lem and Diki Tsering. 2024. A Systematic Review of the Limitations and Associated Opportunities of ChatGPT. International Journal of Human–Computer Interaction 40 (May 2024), 1–16.

Edward Segel and Jeffrey Heer. 2010. Narrative visualization: Telling stories with data. IEEE Transactions on Visualization and Computer Graphics 16 (Oct 2010), 1139–1148.

Alice Thudt, Jagoda Walny, Theresia Gschwandtner, Jason Dykes, and John Stasko. 2018. Exploration and explanation in data-driven storytelling. In Data-Driven Storytelling. AK Peters/CRC Press, 59–83.

Xumeng Wang, Ziliang Wu, Wenqi Huang, Yating Wei, Zhaosong Huang, Mingliang Xu, and Wei Chen. 2023. VIS+AI: integrating visualization with artificial intelligence for efficient data analysis. Frontiers of Computer Science 17 (Apr 2023), 1–12.

Aoyu Wu, Yun Wang, Xinhuan Shu, Dominik Moritz, Weiwei Cui, Haidong Zhang, Dongmei Zhang, and Huamin Qu. 2021. AI4VIS: Survey on Artificial Intelligence Approaches for Data Visualization. IEEE Transactions on Visualization and Computer Graphics 28 (Jul 2021), 5049–5070.

Yangjinbo Zhang, Mark Reynolds, Artur Lugmayr, Katarina Damjanov, and Ghulam Mubashar Hassan. 2022. A Visual Data Storytelling Framework. Informatics 9 (Sep 2022), 1–22.

Qian Zhu, Linping Yuan, Zian Xu, Leni Yang, Meng Xia, Zhuo Wang, Hai-Ning Liang, and Xiaojuan Ma. 2024. From reader to experiencer: Design and evaluation of a VR data story for promoting the situation awareness of public health threats. International Journal of Human-Computer Studies 181 (Jan 2024), 1–13.