Are Generic UX Evaluation Techniques Enough? A study on the UX Evaluation of the Edmodo Learning Management System
Resumo
As technology evolves and new interaction patterns emerge, User eXperience (UX) is becoming more important. Although several UX evaluation techniques have been proposed, there is no enough evidence regarding their adequacy in the e-learning context. This paper presents an analysis of two UX evaluation techniques applied to the Edmodo Learning Management System. We performed a study with 34 students to evaluate the UX of Edmodo and the perceptions of the techniques. Results showed that Edmodo provided a positive UX. However, around 41% of the students reported that they were not able to fully evaluate their UX using the techniques, indicating a need for improvement.
Palavras-chave:
User Experience, UX Evaluation, Learning Management System, Edmodo, Distance Learning
Referências
Ardito, C., Costabile, M. F., De Marsico, M., Lanzilotti, R., Levialdi, S., Roselli, T. and Rossano, V. (2006). An approach to usability evaluation of e-learning applications. In Universal Access in the Information Society Journal, v. 4, n. 3, p. 270-283.
Davis, F. D., Bagozzi, R. P. and Warshaw, P. R. (1989). User acceptance of computer technology: A comparison of two theoretical models. In Management Science, v. 35, n. 8, p. 982-1003.
Harrati, N.; Bouchrika, I.; Tari, A. and Ladjailia, A. (2016). Exploring user satisfaction for e-learning systems via usage-based metrics and system usability scale analysis. In Computers in Human Behavior Journal, v. 61, p. 463-471.
Hassenzahl, M. (2003) “The thing and I: Understanding the relationship between user and product”, In: Funology: From Usability to Enjoyment, Edited by Blythe, M., Overbeeke, C., Monk, A., Wright, P., Springer Netherlands, p. 31-42.
ISO 9241-210 (2010). Ergonomics of human-system interaction - Part 210: Human-centred design for interactive systems.
Laugwitz, B., Held, T. and Schrepp, M. (2008) “Construction and evaluation of a user experience questionnaire”, In: HCI and Usability for Education and Work, Edited by Andreas Holzinger, Springer-Verlag Berlin Heidelberg, p. 63-76.
Mtebe, J. S. and Kissaka, M. M. (2015). Heuristics for evaluating usability of Learning Management Systems in Africa. In IST-Africa 2015 Conference Proceedings, Lilongwe, p. 1-13.
Nakamura, W. T., Oliveira, E. H. T. and Conte, T. (2017a). Usability and User Experience evaluation of Learning Management Systems: A systematic mapping study. In Proceedings of the 19th International Conference on Enterprise Information Systems (ICEIS 2017), v. 3, p. 97-109.
Nakamura, W. T., Marques, L. C., Rivero, L., Oliveira, E. H. T., Conte, T. (2017b) “Support material to the UX Evaluation of Edmodo LMS”, TR-USES-2017-0013, USES Research Group Technical Report, [link].
Rivero, L. and Conte, T. (2017). A systematic mapping study on research contributions on UX evaluation technologies. In Proceedings of the 16th Brazilian Symposium on Human Factors in Computing Systems (IHC 2017), Joinville, Brazil.
Sullivan, G. M. and Artino Jr, A. R. (2013). Analyzing and interpreting data from Likert-type scales. In Journal of Graduate Medical Education, v. 5, n. 4, p. 541-542.
Van Der Linden, J. and Van De Leemput, C. (2015). Observatory of students’ uses of computer-based tools. In Psychologie Française Journal, v. 60, p. 145-157.
Van Schaik, P. and Ling, J. (2011). An integrated model of interaction experience for information retrieval in a Web-based encyclopedia. In Interacting with Computers, v. 23, p. 18-32.
Zaharias, P. and Pappas, C. (2016). Quality management of Learning Management Systems: A User Experience perspective. In Current Issues in Emerging eLearning, v. 3, p. 60-83.
Davis, F. D., Bagozzi, R. P. and Warshaw, P. R. (1989). User acceptance of computer technology: A comparison of two theoretical models. In Management Science, v. 35, n. 8, p. 982-1003.
Harrati, N.; Bouchrika, I.; Tari, A. and Ladjailia, A. (2016). Exploring user satisfaction for e-learning systems via usage-based metrics and system usability scale analysis. In Computers in Human Behavior Journal, v. 61, p. 463-471.
Hassenzahl, M. (2003) “The thing and I: Understanding the relationship between user and product”, In: Funology: From Usability to Enjoyment, Edited by Blythe, M., Overbeeke, C., Monk, A., Wright, P., Springer Netherlands, p. 31-42.
ISO 9241-210 (2010). Ergonomics of human-system interaction - Part 210: Human-centred design for interactive systems.
Laugwitz, B., Held, T. and Schrepp, M. (2008) “Construction and evaluation of a user experience questionnaire”, In: HCI and Usability for Education and Work, Edited by Andreas Holzinger, Springer-Verlag Berlin Heidelberg, p. 63-76.
Mtebe, J. S. and Kissaka, M. M. (2015). Heuristics for evaluating usability of Learning Management Systems in Africa. In IST-Africa 2015 Conference Proceedings, Lilongwe, p. 1-13.
Nakamura, W. T., Oliveira, E. H. T. and Conte, T. (2017a). Usability and User Experience evaluation of Learning Management Systems: A systematic mapping study. In Proceedings of the 19th International Conference on Enterprise Information Systems (ICEIS 2017), v. 3, p. 97-109.
Nakamura, W. T., Marques, L. C., Rivero, L., Oliveira, E. H. T., Conte, T. (2017b) “Support material to the UX Evaluation of Edmodo LMS”, TR-USES-2017-0013, USES Research Group Technical Report, [link].
Rivero, L. and Conte, T. (2017). A systematic mapping study on research contributions on UX evaluation technologies. In Proceedings of the 16th Brazilian Symposium on Human Factors in Computing Systems (IHC 2017), Joinville, Brazil.
Sullivan, G. M. and Artino Jr, A. R. (2013). Analyzing and interpreting data from Likert-type scales. In Journal of Graduate Medical Education, v. 5, n. 4, p. 541-542.
Van Der Linden, J. and Van De Leemput, C. (2015). Observatory of students’ uses of computer-based tools. In Psychologie Française Journal, v. 60, p. 145-157.
Van Schaik, P. and Ling, J. (2011). An integrated model of interaction experience for information retrieval in a Web-based encyclopedia. In Interacting with Computers, v. 23, p. 18-32.
Zaharias, P. and Pappas, C. (2016). Quality management of Learning Management Systems: A User Experience perspective. In Current Issues in Emerging eLearning, v. 3, p. 60-83.
Publicado
30/10/2017
Como Citar
NAKAMURA, Walter T.; MARQUES, Leonardo C.; RIVERO, Luis; DE OLIVEIRA, Elaine H. T.; CONTE, Tayana.
Are Generic UX Evaluation Techniques Enough? A study on the UX Evaluation of the Edmodo Learning Management System. In: SIMPÓSIO BRASILEIRO DE INFORMÁTICA NA EDUCAÇÃO (SBIE), 28. , 2017, Recife/PE.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2017
.
p. 1007-1016.
DOI: https://doi.org/10.5753/cbie.sbie.2017.1007.
