Evaluation of Educational Games for Japanese Language Learning: A proposal based on heuristics
Abstract
The evaluation of Computer-Assisted Language Learning (CALL) tools can be carried out from the perspective of different aspects, and there’s still no proposal from the literature for the evaluation of CALL games from the perspective of an optimal experience. Therefore, this work proposes a set of 32 heuristics for the evaluation of educational games for Japanese Language Learning (JCALL). Furthermore, the heuristics are applied in the evaluation of a JCALL educational game in order to verify their usefulness. Findings show the heuristics provide qualified support in the evaluation, and can be applied in the redesign of JCALL educational games, in order to optimize optimal player experience.
Keywords:
CALL, JCALL, japanese
References
Csikszentmihalyi, M. (1975) “Beyond Boredom and Anxiety”, Josey-Bass.
Csikszentmihalyi, M. (1990) “Flow: The Psychology of Optimal Experience”, Harper & Row.
Csikszentmihalyi, M. (1993) “The Evolving Self: A Psychology for the Third Millennium”, Harper Collins Publishers.
Hubbard, P. (1988) “An Integrated Framework for CALL Coursew are Evaluation.” CALICO Journal, p. 51-72.
Hubbar d, P. (2006) “Evaluatin g CALL Software.” In: Calling on CALL: From Theory and Research to New Directions in Foreign Language Teaching.” CAL ICO, 5.
Hubbard, P. (2011) “Evaluation of Courseware and Websites.” In: Present and Future Promises of CALL: From Theory and Research to New Directions in Language Teaching, 407-440.
Kim, H. e Kwo n, Y. (2012) “Exploring Smartphone Applications for Effective Mobile-Assisted Language Learning.” Multimedia-Assisted Language Learning, v. 15, n. 1, p. 31-57.
Marciano, J.N., Ferreira, A.L.S., Correia, A.C.C., Miranda, L.C. e Miranda, E.E.C. (2013 a) “Karuchā Ships Invaders: Cultural Issues on the Design/Development of a Japanese CALL Game made by/to Brazilians.” In: XII Simpósio Brasileiro de Jogos e Entretenimento Digital (SBGames’13), p. 172-180.
Marciano, J.N., Miranda, E.E.C. e Miranda, L.C. (2014 a) “Applying the Method for Evaluation of Motivational Aspects on Karucha Ships Invaders Educational Game with Brazilian Students of Japanese.” In: XX Workshop de Informática na Escola (WIE ’14), p. 66-75.
Marciano, J.N., Miranda, L.C. e Miranda, E.E.C. (2014 b) “Evaluating Multiple Aspects of Educational Computer Gam es: Literature Review and Case Study.” International Journal of Computer Games Technology, v. 2014, p. 1-12.
Marciano, J.N., Miranda, L.C. e Miranda, E.E.C. (2013 b) “Japanese CALL Web Tools: Identifying and Evaluating their Multimedia Behaviour in Android OS.” In: 25th World Conference on Educational Media and Technology (EdMedia ’13), p. 1087-1096.
Marciano, J.N., Miranda, L.C. e Miranda, E.E.C. (2012) “Japanese Language Learning Supported by Computational Tools: State of the Art and Challenges for the Lati n America Community.” In: XXXVIII Conferencia Latinoamericana en Informática (CLEI ’12), p. 1-10.
Marciano, J.N., Miranda, L.C., Miranda, E.E.C. e Oliveira, P.T.R. (2016) “Karucha Ships Invaders em Sala de Aula: Relato de Experiência do Uso do Jogo Educacional por Estudantes de Japonês do IFRN.” In: XXII Workshop de Informática na Escola (WIE ’16), p. 555-564.
Marciano, J.N., Miranda, L.C., Miranda, E.E.C. e Pereira, R. (2013 c) “Android MALL Apps for Japanese Language: Identifying and Eliciting Interface/Interaction Requirements through the Semiotic Framework.” In: XXXIX Conferencia Latinoamericana en Informática (CLEI ’13), p. 1-11.
Marciano, J.N., Oliveira, J.B.C., Menezes, B.C., Miranda, L.C. e Miranda, E.E.C. (2015) “Katakana Star Samurai: A Mobile Tool to Support Learning of a Basic Japanese Alphabet.” In: XLI Conferencia Latinoamericana en Informática (CLEI ’15), p. 517-524.
Marques, F.A.R. e Miranda, L.C. (2018 a) “Assessment of Lexical Acquisition of a Student with High Japanese Language Proficiency: An Analysis based on Nihongo Kotoba Shiken.” In: XIII Conferência Latino-americana de Tecnologias de Aprendizagem (LACLO ’18), p. 216-223.
Marques, F.A.R. e Miranda, L.C. (2018b) “Nihongo Kotoba Shiken: A Computerized Exam of Japanese Lexical Proficiency.” In: XLIV Conferência Latino-americana de Informática (CLEI ’18), p. 398-407.
Marques, F.A.R., Miranda, L.C., Menezes, B.C., Miranda, E.E.C. e Marciano, J.N. (2015 a) “Karuta Kanji: Jogo Educacional para Estudar e Praticar Vocabulário com Kanj is da Língua Japonesa.” In: XLI Conferencia Latinoamericana en Informática (CLEI’15), p. 504-516.
Marques, F.P.R., Menezes, B.C., Miranda, L.C., Miranda, E.E.C. e Marcian o, J.N. (2015b) “Sumo Sensei: Design, Implementação e Teste com Usuários de uma Ferramenta Móvel para Apoiar o Estudo de Kanjis Básicos.” In: XLI Conferencia Latino americana en Informática (CLEI ’15), p. 492-503.
Marques, F.P. R. e Miranda, L.C. (2022) “Design de Jogo e Experiência de Fluxo: Reflexão e Desafios na Perspectiva da Teoria do Fluxo.” In: XXI Simpósio Brasileiro de Jogos e Entretenimento Digital (SBGames ’22), p. 1-10.
Torat, B. (2000) “Computer-Assisted Language Learning: An Overview.” Silpakorn University International Journal, v. 1, n. 1, p. 130-153.
Csikszentmihalyi, M. (1990) “Flow: The Psychology of Optimal Experience”, Harper & Row.
Csikszentmihalyi, M. (1993) “The Evolving Self: A Psychology for the Third Millennium”, Harper Collins Publishers.
Hubbard, P. (1988) “An Integrated Framework for CALL Coursew are Evaluation.” CALICO Journal, p. 51-72.
Hubbar d, P. (2006) “Evaluatin g CALL Software.” In: Calling on CALL: From Theory and Research to New Directions in Foreign Language Teaching.” CAL ICO, 5.
Hubbard, P. (2011) “Evaluation of Courseware and Websites.” In: Present and Future Promises of CALL: From Theory and Research to New Directions in Language Teaching, 407-440.
Kim, H. e Kwo n, Y. (2012) “Exploring Smartphone Applications for Effective Mobile-Assisted Language Learning.” Multimedia-Assisted Language Learning, v. 15, n. 1, p. 31-57.
Marciano, J.N., Ferreira, A.L.S., Correia, A.C.C., Miranda, L.C. e Miranda, E.E.C. (2013 a) “Karuchā Ships Invaders: Cultural Issues on the Design/Development of a Japanese CALL Game made by/to Brazilians.” In: XII Simpósio Brasileiro de Jogos e Entretenimento Digital (SBGames’13), p. 172-180.
Marciano, J.N., Miranda, E.E.C. e Miranda, L.C. (2014 a) “Applying the Method for Evaluation of Motivational Aspects on Karucha Ships Invaders Educational Game with Brazilian Students of Japanese.” In: XX Workshop de Informática na Escola (WIE ’14), p. 66-75.
Marciano, J.N., Miranda, L.C. e Miranda, E.E.C. (2014 b) “Evaluating Multiple Aspects of Educational Computer Gam es: Literature Review and Case Study.” International Journal of Computer Games Technology, v. 2014, p. 1-12.
Marciano, J.N., Miranda, L.C. e Miranda, E.E.C. (2013 b) “Japanese CALL Web Tools: Identifying and Evaluating their Multimedia Behaviour in Android OS.” In: 25th World Conference on Educational Media and Technology (EdMedia ’13), p. 1087-1096.
Marciano, J.N., Miranda, L.C. e Miranda, E.E.C. (2012) “Japanese Language Learning Supported by Computational Tools: State of the Art and Challenges for the Lati n America Community.” In: XXXVIII Conferencia Latinoamericana en Informática (CLEI ’12), p. 1-10.
Marciano, J.N., Miranda, L.C., Miranda, E.E.C. e Oliveira, P.T.R. (2016) “Karucha Ships Invaders em Sala de Aula: Relato de Experiência do Uso do Jogo Educacional por Estudantes de Japonês do IFRN.” In: XXII Workshop de Informática na Escola (WIE ’16), p. 555-564.
Marciano, J.N., Miranda, L.C., Miranda, E.E.C. e Pereira, R. (2013 c) “Android MALL Apps for Japanese Language: Identifying and Eliciting Interface/Interaction Requirements through the Semiotic Framework.” In: XXXIX Conferencia Latinoamericana en Informática (CLEI ’13), p. 1-11.
Marciano, J.N., Oliveira, J.B.C., Menezes, B.C., Miranda, L.C. e Miranda, E.E.C. (2015) “Katakana Star Samurai: A Mobile Tool to Support Learning of a Basic Japanese Alphabet.” In: XLI Conferencia Latinoamericana en Informática (CLEI ’15), p. 517-524.
Marques, F.A.R. e Miranda, L.C. (2018 a) “Assessment of Lexical Acquisition of a Student with High Japanese Language Proficiency: An Analysis based on Nihongo Kotoba Shiken.” In: XIII Conferência Latino-americana de Tecnologias de Aprendizagem (LACLO ’18), p. 216-223.
Marques, F.A.R. e Miranda, L.C. (2018b) “Nihongo Kotoba Shiken: A Computerized Exam of Japanese Lexical Proficiency.” In: XLIV Conferência Latino-americana de Informática (CLEI ’18), p. 398-407.
Marques, F.A.R., Miranda, L.C., Menezes, B.C., Miranda, E.E.C. e Marciano, J.N. (2015 a) “Karuta Kanji: Jogo Educacional para Estudar e Praticar Vocabulário com Kanj is da Língua Japonesa.” In: XLI Conferencia Latinoamericana en Informática (CLEI’15), p. 504-516.
Marques, F.P.R., Menezes, B.C., Miranda, L.C., Miranda, E.E.C. e Marcian o, J.N. (2015b) “Sumo Sensei: Design, Implementação e Teste com Usuários de uma Ferramenta Móvel para Apoiar o Estudo de Kanjis Básicos.” In: XLI Conferencia Latino americana en Informática (CLEI ’15), p. 492-503.
Marques, F.P. R. e Miranda, L.C. (2022) “Design de Jogo e Experiência de Fluxo: Reflexão e Desafios na Perspectiva da Teoria do Fluxo.” In: XXI Simpósio Brasileiro de Jogos e Entretenimento Digital (SBGames ’22), p. 1-10.
Torat, B. (2000) “Computer-Assisted Language Learning: An Overview.” Silpakorn University International Journal, v. 1, n. 1, p. 130-153.
Published
2022-10-24
How to Cite
MARQUES, Fábio Phillip Rocha; MIRANDA, Leonardo Cunha de.
Evaluation of Educational Games for Japanese Language Learning: A proposal based on heuristics. In: EDUCATION TRACK – FULL PAPERS - BRAZILIAN SYMPOSIUM ON COMPUTER GAMES AND DIGITAL ENTERTAINMENT (SBGAMES), 21. , 2022, Natal/RN.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2022
.
p. 1009-1018.
DOI: https://doi.org/10.5753/sbgames_estendido.2022.226124.
