A Game Learning Analytics strategy to assess level design in an educational game

• Douglas Melo Universidade do Estado do Amazonas
• Rafaela Melo State University of Amazonas
• João Ricardo Serique Bernardo Universidade do Estado do Amazonas
• Marcela Pessoa State University of Amazonas https://orcid.org/0000-0002-3064-5585
• Luis Cuevas Rodríguez Universidade do Estado do Amazonas
• Fernanda Pires State University of Amazonas https://orcid.org/0000-0002-8180-9850

DOI: https://doi.org/10.5753/cbie.sbie.2020.622

Abstract

This paper aims to evaluate the level design of an educational game called "Robô Euroi" using Game Learning Analytics (GLA) techniques, with its own flexible data capture structure. An application of the game was run with 71 people of different ages, where the data generated by the players were captured and later analyzed using the Python programming language. The results show the benefits of capturing and analyzing applied data, good acceptance by the target audience, and a challenging potential for the game.

Keywords: Game Learning Analytics, Computational thinking, educational game

References

Alonso-Fernández, C., Calvo-Morata, A., Freire, M., Martínez-Ortiz, I., and Fernández-Manjón, B. (2019a). Applications of data science to game learning analytics data: Asystematic literature review.Computers & Education, 141:103612.


Alonso-Fernández, C., Cano, A. R., Calvo-Morata, A., Freire, M., Martínez-Ortiz, I., andFernández-Manjón, B. (2019b). Lessons learned applying learning analytics to assess serious games. Computers in Human Behavior, 99:301–309.


Djaouti, D., Alvarez, J., Jessel, J.-P., and Rampnoux, O. (2011). Origins of serious games. In Serious games and edutainment applications, pages 25–43. Springer.


Freire, M., Serrano-Laguna, Á., Manero, B., Martínez-Ortiz, I., Moreno-Ger, P., and Fernández-Manjón, B. (2016). Game learning analytics: learning analytics for serious games. In Learning, design, and technology, pages 1–29. Springer Nature Switzerland AG.


Girard, C., Ecalle, J., and Magnan, A. (2013). Serious games as new educational tools: how effective are they? a meta-analysis of recent studies. Journal of computer assisted learning, 29(3):207–219.


Hicks, D., Eagle, M., Rowe, E., Asbell-Clarke, J., Edwards, T., and Barnes, T. (2016). Using game analytics to evaluate puzzle design and level progression in a serious game. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, pages 440–448.


Kang, J., Liu, M., and Qu, W. (2017). Using gameplay data to examine learning behavior patterns in a serious game.Computers in Human Behavior, 72:757–770.


Kevan, J. M. and Ryan, P. R. (2016). Experience api: Flexible, decentralized and activity-centric data collection.Technology, knowledge and learning, 21(1):143–149.


Melo, D., de Sousa Pires, F. G., Melo, R., and J ́unior, R. J. d. R. S. (2018a). Robô Euroi: Game de estratégia matemática para exercitar o pensamento computacional. In Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação-SBIE), volume 29, page 685.


Melo, D., Junior, R. J. d. R. S., Duarte, J., and de Sousa Pires, F. G. (2018b). Robô euroi: Estratégias matemáticas para desenvolver o pensamento computacional. In Anais dos Workshops do Congresso Brasileiro de Informática na Educação , volume 7, page 242.


Pires, F., Pessoa, M., Ferreira, R., Bernardo, J. R., and de Lima, F. M. (2020). O livro do conhecimento: um serious game educacional para aprendizagem de ortografia da língua portuguesa. Revista Brasileira de Informática na Educação, 28:436.


Plass, J. L., Homer, B. D., and Kinzer, C. K. (2015). Foundations of game-based learning. Educational Psychologist, 50(4):258–283.


Van Eck, R. (2006). Digital game-based learning: It’s not just the digital natives who are restless. EDUCAUSE review, 41(2):16.


Wallner, G. and Kriglstein, S. (2013). Visualization-based analysis of gameplay data–a review of literature. Entertainment Computing, 4(3):143–155.