HCI Evaluation Methods in the context of Educational Serious Games: A Systematic Mapping

• Taynara Cerigueli Dutra Santa Catarina State University http://orcid.org/0000-0002-4744-566X
• Diego Fellipe Tondorf Santa Catarina State University https://orcid.org/0000-0003-3465-3299
• Thiago A. Zils Santa Catarina State University https://orcid.org/0000-0003-2983-0633
• André E. G. Ferreira Santa Catarina State University https://orcid.org/0000-0002-2429-1661
• Isabela Gasparini Santa Catarina State University https://orcid.org/0000-0002-8094-9261
• Marcelo da Silva Hounsell Santa Catarina State University https://orcid.org/0000-0002-9700-0909
• Eleandro Maschio Federal University of Technology – Paraná http://orcid.org/0000-0001-5910-9391

DOI: https://doi.org/10.5753/sbie.2021.217450

Abstract

This work presents a Systematic Literature Mapping to identify howeducational serious digital games have been evaluated, by verifying evaluationmethods, criteria, context, and types of games used. A total of 1221 paperswere obtained, which after applying objective and subjective filters, resulted in48 selected papers. It was found that the majority used investigation methodssuch as questionnaires, to verify elements such as learning, motivation, anduser experience. Furthermore, regarding the subjects, the vast majority aimsat evaluating games with elementary school students. Finally, as for controldevices, there are similarities between mouse, keyboard, and touchscreen.

Keywords: Evaluation methods, educational serious games, systematic mapping

References

Anastasiadis, T., Lampropoulos, G., e Siakas, K. (2018). Digital game-based learning and serious games in education. International Journal of Advances in Scientific Research and Engineering, 4(12):139–144.

Barbosa, S. D. J., Silva, B. S. d., Silveira, M. S., Gasparini, I., Darin, T., e Barbosa, G. D. J. (2021). Interação Humano-Computador e Experiência do Usuário. Auto publicação.

Bloom, B. S. (1956). Taxonomy of educational objectives: The classification of educational goals by a committee of college and university examiners. McKay.

Buchinger, D., de Siqueira Cavalcanti, G. A., e da Silva Hounsell, M. (2014). Mecanismos de busca acadêmica: uma análise quantitativa. Revista Brasileira de Computação Aplicada, 6(1):108–120.

Cascini, D. e Campos, S. (2015). Avaliação de jogos educacionais multiusuários: Uma revisão sistemática da literatura. In Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação-SBIE), volume 26, page 519.

Costa, A. L. B., Bonifácio, B. A., de Souza, B. P., e Fernandes, P. S. (2018). Applying teaching methods as requirements to develop games to assist children with learning disabilities: A case study. In 2018 XLIV Latin American Computer Conference (CLEI), pages 353–360. IEEE.

Derryberry, A. (2007). Serious games: online games for learning.

Grove, F. D., Bourgonjon, J., e Looy, J. V. (2012). Digital games in the classroom? a contextual approach to teachers’ adoption intention of digital games in formal education. Computers in Human Behavior, 28(6):2023–2033.

Hix, D. e Hartson, H. R. (1993). Developing user interfaces: ensuring usability through product & process. John Wiley & Sons, Inc.

Nielsen, J. (1994). Heuristic evaluation. Usability inspection methods.

Peixoto, D. C. C., Resende, R. F., e Pádua, C. I. P. (2014). Evaluating software engineering simulation games: The ugalco framework. In 2014 IEEE Frontiers in Education Conference (FIE) Proceedings, pages 1–9.

Petersen, K., Feldt, R., Mujtaba, S., e Mattsson, M. (2008). Systematic mapping studies in software engineering. In 12th International Conference on Evaluation and Assessment in Software Engineering (EASE) 12, pages 1–10.

Prensky, M. (2003). Digital game-based learning. Computers in Entertainment (CIE), 1(1):21–21.

Prieto, L. M., Trevisan, M. d. C. B., Danezi, M. I., e Falkembach, G. M. (2005). Uso das tecnologias digitais em atividades didáticas nas séries iniciais. RENOTE-Revista Novas Tecnologias na Educação, 3(1).

Ramos, D. K., da Silva, G. A., e Macedo, C. C. (2020). Jogos digitais e emoções: um estudo exploratório com crianças. Revista Pedagógica, 22:1–21.

Silva, T. S. e Silveira, M. S. (2008). Antecipando a avaliação de ihc: verificação de diretrizes a partir de modelos. In Proceedings of the VIII Brazilian Symposium on Human Factors in Computing Systems, pages 248–251.

Tarouco, L. M. R., Roland, L. C., Fabre, M.-C. J. M., e Konrath, M. L. P. (2004). Jogos educacionais. RENOTE: revista novas tecnologias na educação [recurso eletrônico]. Porto Alegre, RS.

Wangenheim, C. G. v., Barbosa, H., e Reolon, M. (2017). Heurísticas para avaliação de jogos educativos digitais – revisão sistemática de literatura. relatório técnico incod/gqs.05.2017.p.

Yuliana, I., Octavia, L. P., Sudarmilah, E., e Matahari, M. (2019). Introducing computational thinking concept learning in building cognitive capacity and character for elementary student. In 2019 19th International Symposium on Communications and Information Technologies (ISCIT), pages 549–554. IEEE.