UsabilityZero: Can a bad user experience teach well?
Abstract
Interfaces with good usability help their users complete more tasks in less time and with less effort, which gives them greater satisfaction. Given the vast array of options available to users today, usability is an important interface feature that may lead to the commercial success or failure of a software system. Despite its importance, few educational tools are available to help usability teachers and students. Knowing how to measure interface usability is one of the basic concepts that students should learn when they study the theme. This paper presents UsabilityZero, a web application to support the teaching of usability concepts to undergraduate students. By using UsabilityZero, students interact with a system displaying a reduced usability interface and, later, with the same system exhibiting an increased usability interface. Considering the use of UsabilityZero by 64 students, the differences between the interface with reduced and increased usability were: (i) 61.5% decrease in the number of clicks; (ii) 62.2% decrease in the time to perform tasks; (iii) 92.9% effectiveness increase; and (iv) a 277.3% satisfaction increase. During their experience with UsabilityZero, students learn how to measure efficiency, effectiveness, and satisfaction of user interfaces. After using the application, Information Systems and Computer Science students who had never been in touch with the subject could identify key usability aspects. The students’ perception of efficiency, effectiveness, and satisfaction as usability measures was higher than 80%. Also, they could identify some usability criteria and understand how measurements change when some of them are present in the interface design. As a result, over 92% of these students said they recognized the importance of usability to the quality of a software product, and 79% declared that their experience with the application would contribute to their professional lives.
References
V. Basili, A. Trendowicz, M. Kowalczyk, J. Heidrich, C. Seaman, J. Münch, and D. Rombach. 2014. Aligning Organizations Through Measurement: The GQM+Strategies Approach. Springer.
J.M. Christian Bastien and Dominique L. Scapin. 1993. Ergonomic criteria for the evaluation of human-computer interfaces. Technical Report RT-0156. INRIA. 79 pages. https://hal.inria.fr/inria-00070012
Walter de Abreu Cybis, Adriana Holtz Betiol, and Richard Faust. 2010. Ergonomia e Usabilidade - Conhecimentos, Métodos e Aplicações (2 ed.). Novatec Editora, São Paulo.
ISO 9241-110. 2006. ISO 9241-110:2006 Ergonomics of Human-System Interaction – Part 110: Dialogue Principles. Technical Report. International Organization for Standardization.
Adriano Luiz de Souza Lima and Fabiane Barreto Vavassori Benitti. 2019. Let’s Talk About Tools and Approaches for Teaching HCI. In Proc. of the 21st International Conference on Human-Computer Interaction, Panayiotis Zaphiris and Andri Ioannou (Eds.). Springer International Publishing, Orlando, USA, 155–170.
Jakob Nielsen. 1995. 10 Usability Heuristics for User Interface Design. https://www.nngroup.com/articles/ten-usability-heuristics/
J. A. Polack-Wahl. 2004. Teaching HCI in Software Engineering. In Proc. of the 34th Annual Frontiers in Education (FIE 2004). IEEE, Savannah, EUA, F1C–31–6 Vol. 2. https://doi.org/10.1109/FIE.2004.1408564
Ben Shneiderman. 2016. The Eight Golden Rules of Interface Design. https://www.cs.umd.edu/users/ben/goldenrules.html
