Comparing the effectiveness of visualizations of different data distributions
Resumo
The effectiveness of a data visualization depends on several factors, such as the visual encoding of its elements, the analytical task it aims to support, the dimensionality of the data, and even the data distribution. In this work, we report an empirical evaluation of common data visualizations, focusing on how different data distributions affect their effectiveness and the level of confidence users have when answering questions related to certain analytical task types. The study allowed us to assess to what extent some data visualizations are more effective than others, regardless of data distribution. We conclude that data visualization creators and algorithms need to consider the data distribution when generating data visualizations. From the results, we also propose recommendations for choosing a visualization when dealing with data distribution issues.
Palavras-chave:
information visualization, visualization tasks
Referências
M. Card Readings in information visualization: using vision to think Morgan Kaufmann 1999.
S. Gnanamgari Information presentation through default displays may 1981.
J. Mackinlay "Automating the design of graphical presentations of relational information" ACM Transactions On Graphics vol. 5 no. 2 pp. 110-1986.
P. Hanrahan "Vizql: a language for query analysis and visualization" Proceedings of the 2006 ACM SIGMOD international conference on Management of data pp. 721-2006.
S. F. Roth J. Mattis "Data characterization for intelligent graphics presentation" Proceedings of the SIGCHI Conference on Human Factors in Computing Systems pp. 193-1990.
B. Shneiderman "The eyes have it: A task by data type taxonomy for information visualizations" in The Craft of Information Visualization Elsevier pp. 364-2003.
F. B. Viegas M. Wattenberg F. van Ham J. Kriss M. McKeon "Manyeyes: a site for visualization at internet scale" IEEE Trans. Visual Comput. Graphics vol. 13 no. 6 pp. 1121-12007.
K. Wongsuphasawat D. Moritz A. Anand J. Mackinlay B. Howe J. Heer "Voyager: Exploratory analysis via faceted browsing of visualization recommendations" IEEE Trans. Visual Comput. Graphics vol. 22 no. 1 pp. 649-2016.
A. Satyanarayan D. Moritz K. Wongsuphasawat J. Heer "Vega-lite: A grammar of interactive graphics" IEEE Trans. Visual Comput. Graphics vol. 23 no. 1 pp. 341-2017.
A. Key B. Howe D. Perry C. Aragon "Vizdeck: self-organizing dashboards for visual analytics" Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data pp. 681-2012.
M. Vartak S. Huang T. Siddiqui S. Madden A. Parameswaran "Towards visualization recommendation systems" ACM SIGMOD Record vol. 45 no. 4 pp. 34-39 2017.
T. A. F. de Sousa S. D. J. Barbosa "Sistema de recomendação para apoiar a construcao de gráficos com dados estatísticos" Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems pp. 168-2013.
B. Ondov N. Jardine N. Elmqvist S. Franconeri "Face to face: Evaluating visual comparison" IEEE Trans. Visual Comput. Graphics vol. 25 no. 1 pp. 861-871 2019.
B. Saket A. Endert C. Demiralp "Task-based effectiveness of basic visualizations" IEEE Trans. Visual Comput. Graphics 2018.
C. Ware Information visualization: perception for design Elsevier 2012.
J. Bertin W. J. Berg H. Wainer Semiology of graphics: diagrams networks maps University of Wisconsin press Madison 1983.
W. S. Cleveland R. McGill "Graphical perception: Theory experimentation and application to the development of graphical methods" Journal of the American statistical association vol. 79 no. pp. 531-1984.
J. Heer M. Bostock "Crowdsourcing graphical perception: using mechanical turk to assess visualization design" Proceedings of the SIGCHI conference on human factors in computing systems pp. 203-2010.
J. Mackinlay P. Hanrahan C. Stolte "Show me: Automatic presentation for visual analysis" IEEE Trans. Visual Comput. Graphics vol. 13 no. 6 pp. 1137-12007.
S. Lee S.-H. Kim B. C. Kwon "Vlat: Development of a visualization literacy assessment test" IEEE Trans. Visual Comput. Graphics vol. 23 no. 1 pp. 551-2017.
Y. Kim J. Heer "Assessing effects of task and data distribution on the effectiveness of visual encodings" in Computer Graphics Forum Wiley Online Library vol. 37 no. 3 pp. 157-2018.
V. F. de Santana F. M. de Moraes B. S. R. de Souza "Investigating treemap visualization in inverted scale" Proceedings of the 14th Brazilian Symposium on Human Factors in Computing Systems pp. 34 2015.
V. F. de Santana R. A. de Paula C. S. Pinhanez "Modeling task deviations as eccentricity distribution peaks" Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems pp. 36 2017.
H.-J. Schulz T. Nocke M. Heitzler H. Schumann "A design space of visualization tasks" IEEE Transactions on Visualization and Computer Graphics vol. 19 no. 12 pp. 2366-22013.
S. Wehrend C. Lewis "A problem-oriented classification of visualization techniques" Proceedings of the First IEEE Conference on Visualization: Visualization 90 pp. 139-1990.
M. X. Zhou S. K. Feiner "Visual task characterization for automated visual discourse synthesis" CHI 1998.
S. Kerpedjiev G. Carenini N. Green J. Moore S. Roth "Saying it in graphics: from intentions to visualizations" Proceedings IEEE Symposium on Information Visualization (Cat. No. 98TB1002pp. 97-1998.
E. H.-h. Chi J. T. Riedl "An operator interaction framework for visualization systems" Proceedings IEEE Symposium on Information Visualization (Cat. No. 98TB1002pp. 63-70 1998.
P. Pirolli S. Card "The sensemaking process and leverage points for analyst technology as identified through cognitive task analysis" Proceedings of international conference on intelligence analysis vol. 5 pp. 2-4 2005.
B. Lee C. Plaisant C. S. Parr J.-D. Fekete N. Henry "Task taxonomy for graph visualization" Proceedings of the 2006 AVI workshop on BEyond time and errors: novel evaluation methods for information visualization pp. 1-5 2006.
M. Brehmer T. Munzner "A multi-level typology of abstract visualization tasks" IEEE Transactions on Visualization and Computer Graphics vol. 19 no. 12 pp. 2376-22013.
H. Lam M. Tory T. Munzner "Bridging from goals to tasks with design study analysis reports" IEEE Trans. Visual Comput. Graphics vol. 24 no. 1 pp. 435-2018.
R. Amar J. Eagan J. Stasko "Low-level components of analytic activity in information visualization" IEEE Symposium on Information Visualization 2005. INFOVIS 2005 pp. 111-2005.
D. A. Szafir "Modeling color difference for visualization design" IEEE Trans. Visual Comput. Graphics vol. 24 no. 1 pp. 392-2018.
A. Sarikaya M. Gleicher "Scatterplots: Tasks data and designs" IEEE Trans. Visual Comput. Graphics vol. 24 no. 1 pp. 402-2018.
A. Srinivasan J. Stasko "Natural language interfaces for data analysis with visualization: Considering what has and could be asked" Proceedings of EuroVis vol. 17 no. 2017 pp. 55-59.
Y. Chen J. Yang W. Ribarsky "Toward effective insight management in visual analytics systems" 2009 IEEE Pacific Visualization Symposium pp. 49-56 2009.
D. Skau L. Harrison R. Kosara "An evaluation of the impact of visual embellishments in bar charts" in Computer Graphics Forum Wiley Online Library vol. 34 no. 3 pp. 221-2015.
D. Albers M. Correll M. Gleicher "Task-driven evaluation of aggregation in time series visualization" Proceedings of the SIGCHI Conference on Human Factors in Computing Systems pp. 551-2014.
J. Heer N. Kong M. Agrawala "Sizing the horizon: the effects of chart size and layering on the graphical perception of time series visualizations" Proceedings of the SIGCHI conference on human factors in computing systems pp. 1303-12009.
M. Siegrist "The use or misuse of three-dimensional graphs to represent lower-dimensional data" Behaviour & Information Technology vol. 15 no. 2 pp. 96-1996.
I. Spence S. Lewandowsky "Displaying proportions and percentages" Applied Cognitive Psychology vol. 5 no. 1 pp. 61-77 1991.
D. Toker C. Conati G. Carenini M. Haraty "Towards adaptive information visualization: on the influence of user characteristics" International Conference on User Modeling Adaptation and Personalization pp. 274-2012.
M. Correll M. Gleicher "Error bars considered harmful: Exploring alternate encodings for mean and error" IEEE Trans. Visual Comput. Graphics vol. 20 no. 12 pp. 2142-22014.
J. Hullman X. Qiao M. Correll A. Kale M. Kay "In pursuit of error: A survey of uncertainty visualization evaluation" IEEE Trans. Visual Comput. Graphics vol. 25 no. 1 pp. 903-913 2019.
M. Okabe K. Ito How to make figures and presentations that are friendly to color blind people University of Tokyo 2002.
H. Wickham L. Stryjewski "40 years of boxplots" Am. Statistician 2011.
R. A. Amar J. T. Stasko "Knowledge precepts for design and evaluation of information visualizations" IEEE Transactions on Visualization and Computer Graphics vol. 11 no. 4 pp. 432-2005.
M. Correll M. Li G. Kindlmann C. Scheidegger "Looks good to me: Visualizations as sanity checks" IEEE Trans. Visual Comput. Graphics vol. 25 no. 1 pp. 830-2019.
R. A. Fisher "On the interpretation of X2 from contingency tables and the calculation of p" Journal of the Royal Statistical Society vol. 85 no. 1 pp. 87-94 1922.
J. M. Chambers W. S. Cleveland B. Kleiner P. A. Tukey Graphical Methods for Data Analysis Pacific Grove Calif:Chapman and Hall/Cole Publishing Company Jan. 1983.
E. R. Tufte The Visual Display of Quantitative Information Cheshire Conn:Graphics Pr Jan. 2001.
S. Few Now You See It: Simple Visualization Techniques for Quantitative Analysis Oakland Calif:Analytics Press Apr. 2009.
A. Cairo The Truthful Art: Data Charts and Maps for Communication New Riders Feb. 2016.
S. Gnanamgari Information presentation through default displays may 1981.
J. Mackinlay "Automating the design of graphical presentations of relational information" ACM Transactions On Graphics vol. 5 no. 2 pp. 110-1986.
P. Hanrahan "Vizql: a language for query analysis and visualization" Proceedings of the 2006 ACM SIGMOD international conference on Management of data pp. 721-2006.
S. F. Roth J. Mattis "Data characterization for intelligent graphics presentation" Proceedings of the SIGCHI Conference on Human Factors in Computing Systems pp. 193-1990.
B. Shneiderman "The eyes have it: A task by data type taxonomy for information visualizations" in The Craft of Information Visualization Elsevier pp. 364-2003.
F. B. Viegas M. Wattenberg F. van Ham J. Kriss M. McKeon "Manyeyes: a site for visualization at internet scale" IEEE Trans. Visual Comput. Graphics vol. 13 no. 6 pp. 1121-12007.
K. Wongsuphasawat D. Moritz A. Anand J. Mackinlay B. Howe J. Heer "Voyager: Exploratory analysis via faceted browsing of visualization recommendations" IEEE Trans. Visual Comput. Graphics vol. 22 no. 1 pp. 649-2016.
A. Satyanarayan D. Moritz K. Wongsuphasawat J. Heer "Vega-lite: A grammar of interactive graphics" IEEE Trans. Visual Comput. Graphics vol. 23 no. 1 pp. 341-2017.
A. Key B. Howe D. Perry C. Aragon "Vizdeck: self-organizing dashboards for visual analytics" Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data pp. 681-2012.
M. Vartak S. Huang T. Siddiqui S. Madden A. Parameswaran "Towards visualization recommendation systems" ACM SIGMOD Record vol. 45 no. 4 pp. 34-39 2017.
T. A. F. de Sousa S. D. J. Barbosa "Sistema de recomendação para apoiar a construcao de gráficos com dados estatísticos" Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems pp. 168-2013.
B. Ondov N. Jardine N. Elmqvist S. Franconeri "Face to face: Evaluating visual comparison" IEEE Trans. Visual Comput. Graphics vol. 25 no. 1 pp. 861-871 2019.
B. Saket A. Endert C. Demiralp "Task-based effectiveness of basic visualizations" IEEE Trans. Visual Comput. Graphics 2018.
C. Ware Information visualization: perception for design Elsevier 2012.
J. Bertin W. J. Berg H. Wainer Semiology of graphics: diagrams networks maps University of Wisconsin press Madison 1983.
W. S. Cleveland R. McGill "Graphical perception: Theory experimentation and application to the development of graphical methods" Journal of the American statistical association vol. 79 no. pp. 531-1984.
J. Heer M. Bostock "Crowdsourcing graphical perception: using mechanical turk to assess visualization design" Proceedings of the SIGCHI conference on human factors in computing systems pp. 203-2010.
J. Mackinlay P. Hanrahan C. Stolte "Show me: Automatic presentation for visual analysis" IEEE Trans. Visual Comput. Graphics vol. 13 no. 6 pp. 1137-12007.
S. Lee S.-H. Kim B. C. Kwon "Vlat: Development of a visualization literacy assessment test" IEEE Trans. Visual Comput. Graphics vol. 23 no. 1 pp. 551-2017.
Y. Kim J. Heer "Assessing effects of task and data distribution on the effectiveness of visual encodings" in Computer Graphics Forum Wiley Online Library vol. 37 no. 3 pp. 157-2018.
V. F. de Santana F. M. de Moraes B. S. R. de Souza "Investigating treemap visualization in inverted scale" Proceedings of the 14th Brazilian Symposium on Human Factors in Computing Systems pp. 34 2015.
V. F. de Santana R. A. de Paula C. S. Pinhanez "Modeling task deviations as eccentricity distribution peaks" Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems pp. 36 2017.
H.-J. Schulz T. Nocke M. Heitzler H. Schumann "A design space of visualization tasks" IEEE Transactions on Visualization and Computer Graphics vol. 19 no. 12 pp. 2366-22013.
S. Wehrend C. Lewis "A problem-oriented classification of visualization techniques" Proceedings of the First IEEE Conference on Visualization: Visualization 90 pp. 139-1990.
M. X. Zhou S. K. Feiner "Visual task characterization for automated visual discourse synthesis" CHI 1998.
S. Kerpedjiev G. Carenini N. Green J. Moore S. Roth "Saying it in graphics: from intentions to visualizations" Proceedings IEEE Symposium on Information Visualization (Cat. No. 98TB1002pp. 97-1998.
E. H.-h. Chi J. T. Riedl "An operator interaction framework for visualization systems" Proceedings IEEE Symposium on Information Visualization (Cat. No. 98TB1002pp. 63-70 1998.
P. Pirolli S. Card "The sensemaking process and leverage points for analyst technology as identified through cognitive task analysis" Proceedings of international conference on intelligence analysis vol. 5 pp. 2-4 2005.
B. Lee C. Plaisant C. S. Parr J.-D. Fekete N. Henry "Task taxonomy for graph visualization" Proceedings of the 2006 AVI workshop on BEyond time and errors: novel evaluation methods for information visualization pp. 1-5 2006.
M. Brehmer T. Munzner "A multi-level typology of abstract visualization tasks" IEEE Transactions on Visualization and Computer Graphics vol. 19 no. 12 pp. 2376-22013.
H. Lam M. Tory T. Munzner "Bridging from goals to tasks with design study analysis reports" IEEE Trans. Visual Comput. Graphics vol. 24 no. 1 pp. 435-2018.
R. Amar J. Eagan J. Stasko "Low-level components of analytic activity in information visualization" IEEE Symposium on Information Visualization 2005. INFOVIS 2005 pp. 111-2005.
D. A. Szafir "Modeling color difference for visualization design" IEEE Trans. Visual Comput. Graphics vol. 24 no. 1 pp. 392-2018.
A. Sarikaya M. Gleicher "Scatterplots: Tasks data and designs" IEEE Trans. Visual Comput. Graphics vol. 24 no. 1 pp. 402-2018.
A. Srinivasan J. Stasko "Natural language interfaces for data analysis with visualization: Considering what has and could be asked" Proceedings of EuroVis vol. 17 no. 2017 pp. 55-59.
Y. Chen J. Yang W. Ribarsky "Toward effective insight management in visual analytics systems" 2009 IEEE Pacific Visualization Symposium pp. 49-56 2009.
D. Skau L. Harrison R. Kosara "An evaluation of the impact of visual embellishments in bar charts" in Computer Graphics Forum Wiley Online Library vol. 34 no. 3 pp. 221-2015.
D. Albers M. Correll M. Gleicher "Task-driven evaluation of aggregation in time series visualization" Proceedings of the SIGCHI Conference on Human Factors in Computing Systems pp. 551-2014.
J. Heer N. Kong M. Agrawala "Sizing the horizon: the effects of chart size and layering on the graphical perception of time series visualizations" Proceedings of the SIGCHI conference on human factors in computing systems pp. 1303-12009.
M. Siegrist "The use or misuse of three-dimensional graphs to represent lower-dimensional data" Behaviour & Information Technology vol. 15 no. 2 pp. 96-1996.
I. Spence S. Lewandowsky "Displaying proportions and percentages" Applied Cognitive Psychology vol. 5 no. 1 pp. 61-77 1991.
D. Toker C. Conati G. Carenini M. Haraty "Towards adaptive information visualization: on the influence of user characteristics" International Conference on User Modeling Adaptation and Personalization pp. 274-2012.
M. Correll M. Gleicher "Error bars considered harmful: Exploring alternate encodings for mean and error" IEEE Trans. Visual Comput. Graphics vol. 20 no. 12 pp. 2142-22014.
J. Hullman X. Qiao M. Correll A. Kale M. Kay "In pursuit of error: A survey of uncertainty visualization evaluation" IEEE Trans. Visual Comput. Graphics vol. 25 no. 1 pp. 903-913 2019.
M. Okabe K. Ito How to make figures and presentations that are friendly to color blind people University of Tokyo 2002.
H. Wickham L. Stryjewski "40 years of boxplots" Am. Statistician 2011.
R. A. Amar J. T. Stasko "Knowledge precepts for design and evaluation of information visualizations" IEEE Transactions on Visualization and Computer Graphics vol. 11 no. 4 pp. 432-2005.
M. Correll M. Li G. Kindlmann C. Scheidegger "Looks good to me: Visualizations as sanity checks" IEEE Trans. Visual Comput. Graphics vol. 25 no. 1 pp. 830-2019.
R. A. Fisher "On the interpretation of X2 from contingency tables and the calculation of p" Journal of the Royal Statistical Society vol. 85 no. 1 pp. 87-94 1922.
J. M. Chambers W. S. Cleveland B. Kleiner P. A. Tukey Graphical Methods for Data Analysis Pacific Grove Calif:Chapman and Hall/Cole Publishing Company Jan. 1983.
E. R. Tufte The Visual Display of Quantitative Information Cheshire Conn:Graphics Pr Jan. 2001.
S. Few Now You See It: Simple Visualization Techniques for Quantitative Analysis Oakland Calif:Analytics Press Apr. 2009.
A. Cairo The Truthful Art: Data Charts and Maps for Communication New Riders Feb. 2016.
Publicado
28/10/2019
Como Citar
RODRIGUES, Ariane M. B. ; BARBOSA, Gabriel; LOPES, Hélio; BARBOSA, Simone D. J. .
Comparing the effectiveness of visualizations of different data distributions. In: CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 32. , 2019, Rio de Janeiro.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2019
.
DOI: https://doi.org/10.5753/sibgrapi.2019.9804.
