Systematic Literature Review about learning assessment methods, techniques and criteria in socio-interactionist serious games
Abstract
Assessing the student is important to understand how the teaching-learning process occurs. In educational games, some methods are used to help in this evaluation, however, just a few consider humanistic pedagogical approaches. In socio-interactionist educational approach, creativity, interaction and the student's socio-historical-cultural context are valued, therefore, the evaluation of socio-interactionist games distances itself from behaviorist practices. This systematic review was carried out in order to understand the methods, techniques, criteria, frameworks and/or algorithms that can be used for the evaluation of socio-interactionist educational games.
Keywords:
Serious Games, Learning Assessment, Sociointeractionism, Systematic Review
References
Ahmed, K. M. and Al Dhubaib, B. (2011). Zotero: A bibliographic assistant to researcher. Journal of Pharmacology and Pharmacotherapeutics, 2(4):303.
Asbell-Clarke, J., Rowe, E., and Sylvan, E. (2013). Assessment design for emergent game-based learning. In CHI’13 Extended Abstracts on Human Factors in Computing Systems, pages 679–684.
Baron, H. B., Salinas, S. C., and Crespo, R. G. (2014). An approach to assessment of video game-based learning using structural equation model. In 2014 9th Iberian conference on information systems and technologies (CISTI), pages 1–6. IEEE.
Brereton, P., Kitchenham, B. A., Budgen, D., Turner, M., and Khalil, M. (2007). Lessons from applying the systematic literature review process within the software engineering domain. Journal of systems and software, 80(4):571–583.
Conrad, S., Clarke-Midura, J., and Klopfer, E. (2014). A framework for structuring learning assessment in a massively multiplayer online educational game: Experiment centered design. International Journal of Game-Based Learning (IJGBL), 4(1):37–59.
de Lima, R. M., de Medeiros Santos, A., Neto, F. M. M., de Sousa Neto, A. F., Leão, F. C. P., de Macedo, F. T., and de Paula Canuto, A. M. (2016). A 3d serious game for medical students training in clinical cases. In 2016 ieee international conference on serious games and applications for health (segah), pages 1–9. IEEE.
Del Blanco, A., Torrente, J., Marchiori, E. J., Martínez-Ortiz, I., Moreno-Ger, P., and Fernandez-Manjon, B. (2010). Easing assessment of game-based learning with and lams. In Proceedings of the second ACM international workshop on Multimedia technologies for distance leaning, pages 25–30.
Falakmasir, M. H., González-Brenes, J. P., Gordon, G. J., and DiCerbo, K. E. (2016). A data-driven approach for inferring student proficiency from game activity logs. In Proceedings of the Third (2016) ACM Conference on Learning@ Scale, pages 341–349.
Georgiadis, K., Faber, T., and Westera, W. (2019a). Bolstering stealth assessment in serious games. In International Conference on Games and Learning Alliance, pages 211–220. Springer.
Georgiadis, K., van Lankveld, G., Bahreini, K., and Westera, W. (2018). Accommodating stealth assessment in serious games: Towards developing a generic tool. In 2018 10th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games), pages 1–4. IEEE.
Georgiadis, K., van Lankveld, G., Bahreini, K., and Westera, W. (2019b). Learning analytics should analyse the learning: proposing a generic stealth assessment tool. In 2019 IEEE Conference on Games (CoG), pages 1–8. IEEE.
Georgiadis, K., van Lankveld, G., Bahreini, K., and Westera, W. (2019c). Reinforcing stealth assessment in serious games. In International Conference on Games and Learning Alliance, pages 512–521. Springer.
Harpstead, E., Myers, B. A., and Aleven, V. (2013). In search of learning: facilitating data analysis in educational games. In Proceedings of the SIGCHI conference on human factors in computing systems, pages 79–88.
Kam, M., Kumar, A., Jain, S., Mathur, A., and Canny, J. (2009). Improving literacy in rural india: Cellphone games in an after-school program. In 2009 International Conference on Information and Communication Technologies and Development (ICTD), pages 139–149. IEEE.
Kam, M., Ramachandran, D., Devanathan, V., Tewari, A., and Canny, J. (2007). Localized iterative design for language learning in underdeveloped regions: the pace framework. In Proceedings of the SIGCHI conference on Human factors in computing systems, pages 1097–1106.
Keele, S. et al. (2007). Guidelines for performing systematic literature reviews in software engineering. Technical report, Citeseer.
Min, W., Frankosky, M. H., Mott, B. W., Rowe, J. P., Smith, A., Wiebe, E., Boyer, K. E., and Lester, J. C. (2019). Deepstealth: Game-based learning stealth assessment with deep neural networks. IEEE Transactions on Learning Technologies, 13(2):312–325.
Mislevy, R. J. and Haertel, G. D. (2006). Implications of evidence-centered design for educational testing. Educational measurement: issues and practice, 25(4):6–20.
Moreno-Ger, P., Burgos, D., Sierra, J. L., and Manjón, B. F. (2007). A game-based adaptive unit of learning with ims learning design and. In European Conference on Technology Enhanced Learning, pages 247–261. Springer.
Mota, L. F. and Pimentel, E. P. (2017). Environment for students performance monitoring through a digital game for teaching mathematics. In 2017 Twelfth Latin American Conference on Learning Technologies (LACLO), pages 1–4. IEEE.
Nyamsuren, E., Van der Vegt, W., and Westera, W. (2017). Automated adaptation and assessment in serious games: A portable tool for supporting learning. In Advances in computer games, pages 201–212. Springer.
Rowe, E., Asbell-Clarke, J., Baker, R. S., Eagle, M., Hicks, A. G., Barnes, T. M., Brown, R. A., and Edwards, T. (2017). Assessing implicit science learning in digital games. Computers in Human Behavior, 76:617–630.
Thomas, P., Labat, J.-M., Muratet, M., and Yessad, A. (2012). How to evaluate competencies in game-based learning systems automatically? In International Conference on Intelligent Tutoring Systems, pages 168–173. Springer.
Vygotsky, L. S. (1997). The collected works of LS Vygotsky: Problems of the theory and history of psychology, volume 3. Springer Science & Business Media.
Asbell-Clarke, J., Rowe, E., and Sylvan, E. (2013). Assessment design for emergent game-based learning. In CHI’13 Extended Abstracts on Human Factors in Computing Systems, pages 679–684.
Baron, H. B., Salinas, S. C., and Crespo, R. G. (2014). An approach to assessment of video game-based learning using structural equation model. In 2014 9th Iberian conference on information systems and technologies (CISTI), pages 1–6. IEEE.
Brereton, P., Kitchenham, B. A., Budgen, D., Turner, M., and Khalil, M. (2007). Lessons from applying the systematic literature review process within the software engineering domain. Journal of systems and software, 80(4):571–583.
Conrad, S., Clarke-Midura, J., and Klopfer, E. (2014). A framework for structuring learning assessment in a massively multiplayer online educational game: Experiment centered design. International Journal of Game-Based Learning (IJGBL), 4(1):37–59.
de Lima, R. M., de Medeiros Santos, A., Neto, F. M. M., de Sousa Neto, A. F., Leão, F. C. P., de Macedo, F. T., and de Paula Canuto, A. M. (2016). A 3d serious game for medical students training in clinical cases. In 2016 ieee international conference on serious games and applications for health (segah), pages 1–9. IEEE.
Del Blanco, A., Torrente, J., Marchiori, E. J., Martínez-Ortiz, I., Moreno-Ger, P., and Fernandez-Manjon, B. (2010). Easing assessment of game-based learning with and lams. In Proceedings of the second ACM international workshop on Multimedia technologies for distance leaning, pages 25–30.
Falakmasir, M. H., González-Brenes, J. P., Gordon, G. J., and DiCerbo, K. E. (2016). A data-driven approach for inferring student proficiency from game activity logs. In Proceedings of the Third (2016) ACM Conference on Learning@ Scale, pages 341–349.
Georgiadis, K., Faber, T., and Westera, W. (2019a). Bolstering stealth assessment in serious games. In International Conference on Games and Learning Alliance, pages 211–220. Springer.
Georgiadis, K., van Lankveld, G., Bahreini, K., and Westera, W. (2018). Accommodating stealth assessment in serious games: Towards developing a generic tool. In 2018 10th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games), pages 1–4. IEEE.
Georgiadis, K., van Lankveld, G., Bahreini, K., and Westera, W. (2019b). Learning analytics should analyse the learning: proposing a generic stealth assessment tool. In 2019 IEEE Conference on Games (CoG), pages 1–8. IEEE.
Georgiadis, K., van Lankveld, G., Bahreini, K., and Westera, W. (2019c). Reinforcing stealth assessment in serious games. In International Conference on Games and Learning Alliance, pages 512–521. Springer.
Harpstead, E., Myers, B. A., and Aleven, V. (2013). In search of learning: facilitating data analysis in educational games. In Proceedings of the SIGCHI conference on human factors in computing systems, pages 79–88.
Kam, M., Kumar, A., Jain, S., Mathur, A., and Canny, J. (2009). Improving literacy in rural india: Cellphone games in an after-school program. In 2009 International Conference on Information and Communication Technologies and Development (ICTD), pages 139–149. IEEE.
Kam, M., Ramachandran, D., Devanathan, V., Tewari, A., and Canny, J. (2007). Localized iterative design for language learning in underdeveloped regions: the pace framework. In Proceedings of the SIGCHI conference on Human factors in computing systems, pages 1097–1106.
Keele, S. et al. (2007). Guidelines for performing systematic literature reviews in software engineering. Technical report, Citeseer.
Min, W., Frankosky, M. H., Mott, B. W., Rowe, J. P., Smith, A., Wiebe, E., Boyer, K. E., and Lester, J. C. (2019). Deepstealth: Game-based learning stealth assessment with deep neural networks. IEEE Transactions on Learning Technologies, 13(2):312–325.
Mislevy, R. J. and Haertel, G. D. (2006). Implications of evidence-centered design for educational testing. Educational measurement: issues and practice, 25(4):6–20.
Moreno-Ger, P., Burgos, D., Sierra, J. L., and Manjón, B. F. (2007). A game-based adaptive unit of learning with ims learning design and. In European Conference on Technology Enhanced Learning, pages 247–261. Springer.
Mota, L. F. and Pimentel, E. P. (2017). Environment for students performance monitoring through a digital game for teaching mathematics. In 2017 Twelfth Latin American Conference on Learning Technologies (LACLO), pages 1–4. IEEE.
Nyamsuren, E., Van der Vegt, W., and Westera, W. (2017). Automated adaptation and assessment in serious games: A portable tool for supporting learning. In Advances in computer games, pages 201–212. Springer.
Rowe, E., Asbell-Clarke, J., Baker, R. S., Eagle, M., Hicks, A. G., Barnes, T. M., Brown, R. A., and Edwards, T. (2017). Assessing implicit science learning in digital games. Computers in Human Behavior, 76:617–630.
Thomas, P., Labat, J.-M., Muratet, M., and Yessad, A. (2012). How to evaluate competencies in game-based learning systems automatically? In International Conference on Intelligent Tutoring Systems, pages 168–173. Springer.
Vygotsky, L. S. (1997). The collected works of LS Vygotsky: Problems of the theory and history of psychology, volume 3. Springer Science & Business Media.
Published
2022-11-16
How to Cite
FELLOWS, Rodrigo Dobbin; BRAGA, Juliana Cristina; DOTTA, Silvia Cristina.
Systematic Literature Review about learning assessment methods, techniques and criteria in socio-interactionist serious games. In: BRAZILIAN SYMPOSIUM ON COMPUTERS IN EDUCATION (SBIE), 33. , 2022, Manaus.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2022
.
p. 528-539.
DOI: https://doi.org/10.5753/sbie.2022.225236.
