Adaptação e Investigação Psicométrica do Gameful Experience Questionnaire (GAMEFULQUEST) em Português Brasileiro
Resumo
O Gameful Experience Questionnaire é um instrumento de autorrelato para medir a experiencia lúdica, que se tornou um dos métodos mais populares para analisar as experiencias lúdicas dos indivíduos em ambientes educacionais gamificados. No entanto, não existe uma versão em português brasileiro deste instrumento, o que limita sua utilização no Brasil. Diante desse desafio, realizamos uma adaptação transcultural do instrumento. Para esse processo, conduzimos um estudo psicométrico de métodos mistos (i.e., qualitativos e quantitativos) (N = 384) organizado em seis etapas (i.e., i) tradução, ii) síntese, iii) avaliação por especialistas, iv) avaliação pelo público-alvo, v) aplicação do instrumento adaptado e vi) validação (i.e., Análise Fatorial Confirmatória)). Os resultados indicam que a adaptação transcultural foi realizada de forma eficiente, permitindo, assim, o uso do instrumento no Brasil.
Palavras-chave:
Gamificação, Gamefulquest, Adaptação transcultural, Instrumento de auto-relato, Questionário
Referências
Altmeyer, M., Zenuni, B., Spelt, H., Jegen, T., Lessel, P., and Kruger, A. (2022). Do hexad user types matter? effects of (non-) personalized gamification on task performance and user experience in an image tagging task. Proceedings of the ACM on Human-Computer Interaction, 6(CHI PLAY):1–27.
Bandalos, D. L. (2014). Relative performance of categorical diagonally weighted least squares and robust maximum likelihood estimation. Structural Equation Modeling: a multidisciplinary journal, 21(1):102–116.
Bassanelli, S., Vasta, N., Bucchiarone, A., and Marconi, A. (2022). Gamification for behavior change: A scientometric review. Acta Psychologica, 228:103657.
Beaton, D. E., Bombardier, C., Guillemin, F., and Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(24):3186–3191.
Bentler, P. M. (1995). EQS structural equations program manual, volume 6. Multivariate software Encino, CA.
Borsa, J. C., Damásio, B. F., and Bandeira, D. R. (2012). Cross-cultural adaptation and validation of psychological instruments: Some considerations. Paideia (Ribeirão Preto), 22:423–432.
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd Edition). Routledge.
Council, B. (2014). Learning English in Brazil: understanding the aims and expectations of the Brazilian emerging middle classes. São Paulo: British Council.
Field, A. (2013). Discovering statistics using IBM SPSS statistics. sage.
Finney, S. J., DiStefano, C., and Kopp, J. P. (2016). Overview of estimation methods and preconditions for their application with structural equation modeling. Principles and methods of test construction: Standards and recent advances, pages 135–165.
Goyal, A. K., Bakshi, J., Panda, N. K., Kapoor, R., Vir, D., Kumar, K., Aneja, P., Singh, B., Gupta, M., and Walia, S. S. (2021). A hybrid method for the cross-cultural adaptation of self-report measures. International Journal of Applied Positive Psychology, 6:45–54.
Guillemin, F., Bombardier, C., and Beaton, D. (1993). Cross-cultural adaptation of healthrelated quality of life measures: literature review and proposed guidelines. Journal of Clinical Epidemiology, 46(12):1417–1432.
Hamari, J. (2019). Gamification, chapter Gamification, pages 1–3. The Blackwell Encyclopedia of Sociology.
Hamari, J. and Koivisto, J. (2014). Measuring flow in gamification: Dispositional flow scale-2. Computers in Human Behavior, 40:133–143.
Hamari, J., Koivisto, J., and Sarsa, H. (2014). Does gamification work?–a literature review of empirical studies on gamification. In 2014 47th Hawaii international conference on system sciences, pages 3025–3034. Ieee.
Hayashi, K., Bentler, P. M., and Yuan, K.-H. (2011). 7 - structural equation modeling. In Rao, C., Miller, J., and Rao, D., editors, Essential Statistical Methods for Medical Statistics, pages 202–234. North-Holland, Boston.
Högberg, J., Hamari, J., and Wästlund, E. (2019). Gameful experience questionnaire (gamefulquest): an instrument for measuring the perceived gamefulness of system use. User Modeling and User-Adapted Interaction, 29(3):619–660.
Hooper, D., Coughlan, J., and Mullen, M. (2008). Equation modelling: Guidelines for determining model fit. Electronic Journal of Business Research Methods, 6(1):53–60.
Hu, L.-t. and Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural equation modeling: a multidisciplinary journal, 6(1):1–55.
IBM Corp. (2020). IBM SPSS Statistics for Windows (Version 27.0) [Computer software].
Issabek, A., Oliveira, W., Hamari, J., and Bogdanchikov, A. (2023). Understanding the effects of gender, age, and cultural orientation on users’ flow experience during the use of a gameful educational system. In 2023 IEEE International Conference on Advanced Learning Technologies (ICALT), pages 124–126. IEEE.
JASP Team (2024). JASP (Version 0.18.3)[Computer software].
Koivisto, J. and Hamari, J. (2019). The rise of motivational information systems: A review of gamification research. International journal of information management, 45:191–210.
Kung, F. Y., Kwok, N., and Brown, D. J. (2018). Are attention check questions a threat to scale validity? Applied Psychology, 67(2):264–283.
Levine, T. R. (2005). Confirmatory factor analysis and scale validation in communication research. Communication Research Reports, 22(4):335–338.
Likert, R. (1932). A technique for the measurement of attitudes. Archives of psychology.
Macey, J., Hamari, J., and Adam, M. (2024). A conceptual framework for understanding and identifying gamblified experiences. Computers in Human Behavior, 152:108087.
Oliveira da Silva Junior, L., Oliveira, W., and Hamari, J. (2024a). Adaptation and psychometric investigation of the gameful experience questionnaire (gamefulquest) in brazilian portuguese. Scientific Reports, 14(1):17190.
Oliveira da Silva Junior, L., Oliveira, W., Hamari, J., Rosa Hatugai, M., and Dantas, P. (2024b). The effects of gamification on students’ gameful experience according to their gender: A quasi-experimental study. In 2024 IEEE Frontiers in Education Conference (FIE), pages 1–9. IEEE.
Orçan, F. (2018). Exploratory and confirmatory factor analysis: which one to use first? Journal of Measurement and Evaluation in Education and Psychology, 9(4):414–421.
Park, S. and Kim, S. (2022). Identifying world types to deliver gameful experiences for sustainable learning in the metaverse. Sustainability, 14(3):1361.
Radhakrishnan, U., Chinello, F., and Koumaditis, K. (2023). Investigating the effectiveness of immersive vr skill training and its link to physiological arousal. Virtual Reality, 27(2):1091–1115.
Razali, N. M., Wah, Y. B., et al. (2011). Power comparisons of shapiro-wilk, kolmogorovsmirnov, lilliefors and anderson-darling tests. Journal of statistical modeling and analytics, 2(1):21–33.
Santos, A. C. G., Muramatsu, P. K., Oliveira, W., Hamari, J., Joaquim, S., and Isotani, S. (2023a). Psychometric investigation of the gamification hexad user types scale with brazilian portuguese adolescents speakers. Scientific reports, 13(1):1–10.
Santos, A. C. G., Oliveira, W., Altmeyer, M., Hamari, J., and Isotani, S. (2022). Psychometric investigation of the gamification hexad user types scale in brazilian portuguese. Scientific reports, 12(1):1–11.
Santos, A. C. G., Oliveira, W., Hamari, J., Joaquim, S., and Isotani, S. (2023b). The consistency of gamification user types: A study on the change of preferences over time. Proceedings of the ACM on Human-Computer Interaction, 7(CHI PLAY):1253– 1281.
Santos, A. C. G., Oliveira, W., Hamari, J., Rodrigues, L., Toda, A. M., Palomino, P. T., and Isotani, S. (2021). The relationship between user types and gamification designs. User modeling and user-adapted interaction, 31(5):907–940.
Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., and King, J. (2006). Reporting structural equation modeling and confirmatory factor analysis results: A review. The Journal of educational research, 99(6):323–338.
Shapiro, S. S. and Wilk, M. (1965). An analysis of variance test for normality (complete samples). Biometrika, 52(3/4):591–611.
Vidergor, H. E. (2021). Effects of digital escape room on gameful experience, collaboration, and motivation of elementary school students. Computers & Education, 166:104156.
Bandalos, D. L. (2014). Relative performance of categorical diagonally weighted least squares and robust maximum likelihood estimation. Structural Equation Modeling: a multidisciplinary journal, 21(1):102–116.
Bassanelli, S., Vasta, N., Bucchiarone, A., and Marconi, A. (2022). Gamification for behavior change: A scientometric review. Acta Psychologica, 228:103657.
Beaton, D. E., Bombardier, C., Guillemin, F., and Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(24):3186–3191.
Bentler, P. M. (1995). EQS structural equations program manual, volume 6. Multivariate software Encino, CA.
Borsa, J. C., Damásio, B. F., and Bandeira, D. R. (2012). Cross-cultural adaptation and validation of psychological instruments: Some considerations. Paideia (Ribeirão Preto), 22:423–432.
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd Edition). Routledge.
Council, B. (2014). Learning English in Brazil: understanding the aims and expectations of the Brazilian emerging middle classes. São Paulo: British Council.
Field, A. (2013). Discovering statistics using IBM SPSS statistics. sage.
Finney, S. J., DiStefano, C., and Kopp, J. P. (2016). Overview of estimation methods and preconditions for their application with structural equation modeling. Principles and methods of test construction: Standards and recent advances, pages 135–165.
Goyal, A. K., Bakshi, J., Panda, N. K., Kapoor, R., Vir, D., Kumar, K., Aneja, P., Singh, B., Gupta, M., and Walia, S. S. (2021). A hybrid method for the cross-cultural adaptation of self-report measures. International Journal of Applied Positive Psychology, 6:45–54.
Guillemin, F., Bombardier, C., and Beaton, D. (1993). Cross-cultural adaptation of healthrelated quality of life measures: literature review and proposed guidelines. Journal of Clinical Epidemiology, 46(12):1417–1432.
Hamari, J. (2019). Gamification, chapter Gamification, pages 1–3. The Blackwell Encyclopedia of Sociology.
Hamari, J. and Koivisto, J. (2014). Measuring flow in gamification: Dispositional flow scale-2. Computers in Human Behavior, 40:133–143.
Hamari, J., Koivisto, J., and Sarsa, H. (2014). Does gamification work?–a literature review of empirical studies on gamification. In 2014 47th Hawaii international conference on system sciences, pages 3025–3034. Ieee.
Hayashi, K., Bentler, P. M., and Yuan, K.-H. (2011). 7 - structural equation modeling. In Rao, C., Miller, J., and Rao, D., editors, Essential Statistical Methods for Medical Statistics, pages 202–234. North-Holland, Boston.
Högberg, J., Hamari, J., and Wästlund, E. (2019). Gameful experience questionnaire (gamefulquest): an instrument for measuring the perceived gamefulness of system use. User Modeling and User-Adapted Interaction, 29(3):619–660.
Hooper, D., Coughlan, J., and Mullen, M. (2008). Equation modelling: Guidelines for determining model fit. Electronic Journal of Business Research Methods, 6(1):53–60.
Hu, L.-t. and Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural equation modeling: a multidisciplinary journal, 6(1):1–55.
IBM Corp. (2020). IBM SPSS Statistics for Windows (Version 27.0) [Computer software].
Issabek, A., Oliveira, W., Hamari, J., and Bogdanchikov, A. (2023). Understanding the effects of gender, age, and cultural orientation on users’ flow experience during the use of a gameful educational system. In 2023 IEEE International Conference on Advanced Learning Technologies (ICALT), pages 124–126. IEEE.
JASP Team (2024). JASP (Version 0.18.3)[Computer software].
Koivisto, J. and Hamari, J. (2019). The rise of motivational information systems: A review of gamification research. International journal of information management, 45:191–210.
Kung, F. Y., Kwok, N., and Brown, D. J. (2018). Are attention check questions a threat to scale validity? Applied Psychology, 67(2):264–283.
Levine, T. R. (2005). Confirmatory factor analysis and scale validation in communication research. Communication Research Reports, 22(4):335–338.
Likert, R. (1932). A technique for the measurement of attitudes. Archives of psychology.
Macey, J., Hamari, J., and Adam, M. (2024). A conceptual framework for understanding and identifying gamblified experiences. Computers in Human Behavior, 152:108087.
Oliveira da Silva Junior, L., Oliveira, W., and Hamari, J. (2024a). Adaptation and psychometric investigation of the gameful experience questionnaire (gamefulquest) in brazilian portuguese. Scientific Reports, 14(1):17190.
Oliveira da Silva Junior, L., Oliveira, W., Hamari, J., Rosa Hatugai, M., and Dantas, P. (2024b). The effects of gamification on students’ gameful experience according to their gender: A quasi-experimental study. In 2024 IEEE Frontiers in Education Conference (FIE), pages 1–9. IEEE.
Orçan, F. (2018). Exploratory and confirmatory factor analysis: which one to use first? Journal of Measurement and Evaluation in Education and Psychology, 9(4):414–421.
Park, S. and Kim, S. (2022). Identifying world types to deliver gameful experiences for sustainable learning in the metaverse. Sustainability, 14(3):1361.
Radhakrishnan, U., Chinello, F., and Koumaditis, K. (2023). Investigating the effectiveness of immersive vr skill training and its link to physiological arousal. Virtual Reality, 27(2):1091–1115.
Razali, N. M., Wah, Y. B., et al. (2011). Power comparisons of shapiro-wilk, kolmogorovsmirnov, lilliefors and anderson-darling tests. Journal of statistical modeling and analytics, 2(1):21–33.
Santos, A. C. G., Muramatsu, P. K., Oliveira, W., Hamari, J., Joaquim, S., and Isotani, S. (2023a). Psychometric investigation of the gamification hexad user types scale with brazilian portuguese adolescents speakers. Scientific reports, 13(1):1–10.
Santos, A. C. G., Oliveira, W., Altmeyer, M., Hamari, J., and Isotani, S. (2022). Psychometric investigation of the gamification hexad user types scale in brazilian portuguese. Scientific reports, 12(1):1–11.
Santos, A. C. G., Oliveira, W., Hamari, J., Joaquim, S., and Isotani, S. (2023b). The consistency of gamification user types: A study on the change of preferences over time. Proceedings of the ACM on Human-Computer Interaction, 7(CHI PLAY):1253– 1281.
Santos, A. C. G., Oliveira, W., Hamari, J., Rodrigues, L., Toda, A. M., Palomino, P. T., and Isotani, S. (2021). The relationship between user types and gamification designs. User modeling and user-adapted interaction, 31(5):907–940.
Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., and King, J. (2006). Reporting structural equation modeling and confirmatory factor analysis results: A review. The Journal of educational research, 99(6):323–338.
Shapiro, S. S. and Wilk, M. (1965). An analysis of variance test for normality (complete samples). Biometrika, 52(3/4):591–611.
Vidergor, H. E. (2021). Effects of digital escape room on gameful experience, collaboration, and motivation of elementary school students. Computers & Education, 166:104156.
Publicado
04/11/2024
Como Citar
SILVA JUNIOR, Luiz Oliveira da; OLIVEIRA, Wilk.
Adaptação e Investigação Psicométrica do Gameful Experience Questionnaire (GAMEFULQUEST) em Português Brasileiro. In: CONCURSO ALEXANDRE DIRENE (CTD-IE) - TRABALHOS DE CONCLUSÃO DE CURSO - CONGRESSO BRASILEIRO DE INFORMÁTICA NA EDUCAÇÃO (CBIE), 13. , 2024, Rio de Janeiro/RJ.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2024
.
p. 94-106.
DOI: https://doi.org/10.5753/cbie_estendido.2024.243459.
