Evaluating an Educational Game for Teaching Artificial Intelligence - Which Evaluation Methodology to Choose?

  • Thamyla Lima Universidade Federal do Maranhão
  • Alex Barradas Filho Universidade Federal do Maranhão
  • Allan K. Barros Universidade Federal do Maranhão
  • Davi Viana Universidade Federal do Maranhão
  • João B. Bottentuit Junior Universidade Federal do Maranhão
  • Luis Rivero Universidade Federal do Maranhão

Abstract


Serious games represent a teaching strategy that allows the addition of entertainment with educational elements. To assess the impact that serious games have on computer students, the literature provides a variety of assessment methods. In this paper, a comparative analysis between evaluation methods was carried out, identifying trends, positive and negative points, as well as aspects to be improved. Subsequently, three evaluation methods were selected and applied to students at UFMA to evaluate a game for teaching artificial intelligence. The results obtained were compared, analyzed and discussed according to the dimensions covered by each method.

Keywords: serious games, evaluation, assessment methods

References

BATTISTELLA, P. E., & VON WANGENHEIM, C. G. (2020, January). Caracterização do Público-Alvo de Jogos Educacionais na área da Computação. In Anais do XXIV Workshop sobre Educação em Computação (pp. 21-30). SBC.

COLLINS, A.; HALVERSON, R. The second educational revolution: rethinking education in the age of technology.Journal of Computer Assisted Learning, vol 26, p. 18-27, 2010.

FU, F. L.; SU, R. C.; YU, S. C. Egameflow: A scale to measure learners’ enjoyment of e-learning games. Computers & Education, v. 52, p. 101–112, 2009.

GIANNAKOS, M. N. Enjoy and learn with educational games: Examining factors affecting learning performance. Computers & Education, v. 68, p. 429–439, 2013.

LIMA, T.; MENEZES, R.; BARRADAS FILHO, A. O.; SANTOS, D.; BOTTENTUIT JUNIOR, J. B. Edubot: um estudo prático de aprendizagem baseada em problemas no contexto de agentes inteligentes e jogos sérios. Tecnologias na Educação, v. 27, p. 6, 2018.

PETRI, G., CALDERÓN, A., VON WANGENHEIM, C. G., BORGATTO, A. F., & RUIZ, M. (2018, July). Benefícios dos jogos não-digitais no ensino de computação. In Anais do XXVI Workshop sobre Educação em Computação. SBC.

PETRI, G.; VON WANGENHEIM, C. G.; BORGATTO, A. F. A large-scale evaluation of a model for the evaluation of games for teaching software engineering. IEEE/ACM 39th International Conference on Software Engineering: Software Engineering Education and Training Track (ICSE-SEET), p. 180–189, 2017.
Published
2020-06-30
LIMA, Thamyla; BARRADAS FILHO, Alex ; BARROS, Allan K.; VIANA, Davi ; BOTTENTUIT JUNIOR, João B. ; RIVERO , Luis . Evaluating an Educational Game for Teaching Artificial Intelligence - Which Evaluation Methodology to Choose?. In: WORKSHOP ON COMPUTING EDUCATION (WEI), 28. , 2020, Cuiabá. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2020 . p. 66-70. ISSN 2595-6175. DOI: https://doi.org/10.5753/wei.2020.11131.