CT Puzzle Test: Towards an interactive assessment of computational thinking
Abstract
Assessing Computational Thinking (CT) is essential to understand the benefits it can bring to Basic Education. However, most evaluative methods analyze static codes and not the thinking process that occurred during problem solving. This work seeks to fill this gap by presenting an assessment tool based on puzzles, called CT Puzzle Test. The process of assessing the validity of the instrument has already covered the stages of apparent validity, content validity and convergent validity, where it obtained a moderate correlation (p = 0.62) with the Computational Thinking Test instrument. The CT Puzzle Test has evolved to become a platform that allows the creation and application of PC tests based on puzzles.
Keywords:
Computational Thinking, Interactive Assessment, Puzzle
References
BLIKSTEIN, P. O pensamento computacional e a reinvenção do computador na educação. 2008. Disponível em: http://www.blikstein.com/paulo/documents/online/ol_pensamento_ computacional.html. Acesso em: 29 setembro 2020.
BOCCONI, S. et al. Developing computational thinking in compulsory education-implications for policy and practice. Join Research Center (European Commission). Sevilha. 2016.
BRACKMANN, Christian Puhlmann. Desenvolvimento do pensamento computacional através de atividades desplugadas na educação básica. 2017. Tese (Programa de Pós-Graduação em Informática na Educação) – Universidade Federal do Rio Grande do Sul, Porto Alegre, Rio Grande do Sul.
BRENNAN, K.; RESNICK, M. New frameworks for studying and assessing the development of computational thinking. In: Proceedings of the 2012 annual meeting of the American Educational Research Association, Vancouver, Canada. 2012.
CALBUSCH, L. CT Puzzle Test: Instrumento para Avaliação do Pensamento Computacional de Jovens de 14 a 17 Anos. Dissertação (Mestrado em Computação Aplicada) – Universidade do Vale do Itajaí. No prelo, 2020.
CARTELLI, A.; DAGIENE, V.; FUTSCHEK, G. Bebras Contest and Digital Competence Assessment. Current Trends and Future Practices for Digital Literacy and Competence. [s.l.]: IGI Global, 2012.
COUTO, N. E. R. Impacto da implantação de uma disciplina de pensamento computacional em estudantes. Dissertação (Mestrado em Computação Aplicada) – Universidade do Vale do Itajaí. 2018.
DAGIENE, V.; FUTSCHEK, G. Bebras International Contest on Informatics and Computer Literacy: Criteria for Good Tasks. Lecture Notes in Computer Science. [s.l.]: Springer Berlin Heidelberg, 2008. p
DAGIENE, V.; STUPURIENE, G. Informatics education based on solving attractive tasks through a contest. In: KEY COMPETENCIES IN INFORMATICS AND ICT, 2014, Potsdam. Preliminary Proceedings. Potsdam: University Of Potsdam, 2014.
FALKNER, N.; SOORIAMURTHI, R.; MICHALEWICZ, Z. Puzzle-Based Learning for Engineering and Computer Science. Computer, v. 43, n. 4, p. 20–28, abr. 2010.
FEUERSTEIN, R. The Feuerstein Instrumental Enrichment Program. Jerusalem: ICELP Publications, 2006.
GONÇALVES, F. Um instrumento para diagnóstico do pensamento computacional. 2015. 128 f. Dissertação - Mestrado em Computação Aplicada, Universidade do Vale do Itajaí, 2015.
GOUWS, L. A.; BRADSHAW, K.; WENTWORTH, P. Computational thinking in educational activities. Proceedings of the 18th ACM conference on Innovation and technology in computer science education - ITiCSE ’13. Anais... In: THE 18TH ACM CONFERENCE. ACM Press, 2013.
GROVER, S. Systems of assessments for deeper learning of computational thinking in k-12. In: Annual meeting of the American Educational Research Association, Chicago: 2015.
HOGAN, T. Introdução À Prática de Testes Psicológicos. Rio de Janeiro: Ltc, 2006.
KALELIOGLU, F.; GULBAHAR, Y.; KUKUL, V. A Framework for Computational Thinking Based on a Systematic Research Review. Baltic Journal Of Modern Computing. Letônia, 2016.
MAIORANA, F.; GIORDANO, D.; MORELLI, R. Quizly: A live coding assessment platform for App Inventor. In: 2015 IEEE BLOCKS AND BEYOND WORKSHOP (BLOCKS AND BEYOND), out. 2015. Anais [..]. [s.l.]: IEEE, out. 2015.
MORENO-LEÓN, J.; ROBLES, G.; ROMÁN-GONZÁLEZ, M. Dr. Scratch: Automatic Analysis of Scratch Projects to Assess and Foster Computational Thinking. Revista de Educación A Distancia, Espanha, v. 10, n. 46, p.1-23, set. 2015.
MÜHLING, A.; RUF, A.; HUBWIESER, P. Design and First Results of a Psychometric Test for Measuring Basic Programming Abilities. In: THE WORKSHOP IN PRIMARY AND SECONDARY COMPUTING EDUCATION. Anais [...]. [s.l.]: ACM Press, 2015.
PAPERT, S. Teaching children thinking. MIT Artificial Intelligence Laboratory. Memo no. 2247, Logo Memo no. 2. Cambridge. 1971.
ROMÁN-GONZÁLEZ, M. Computational thinking test: Design guidelines and content validation. In: Proceedings of the 7th Annual International Conference on Education and New Learning Technologies (EDULEARN), 2015, Barcelona. Proceedings.. Barcelona: IATED, 2015.
ROMÁN-GONZÁLEZ, M.; MORENO-LEÓN, J.; ROBLES, G. Complementary Tools for Computational Thinking Assessment. Proceedings of International Conference on Computational Thinking Education 2017. Hong Kong: The Education University of Hong Kong, jun. 2017.
ROMÁN-GONZÁLEZ, M.; PÉREZ-GONZÁLEZ, J.-C.; JIMÉNEZ-FERNÁNDEZ, C. Which cognitive abilities underlie computational thinking? Criterion validity of the Computational Thinking Test. Computers in Human Behavior, v. 72. 2017b.
ROMÁN-GONZÁLEZ, M.; MORENO-LEÓN, J.; ROBLES, G. Combining Assessment Tools for a Comprehensive Evaluation of Computational Thinking Interventions. Computational Thinking Education. [s.l.]: Springer Singapore, 2019.
SEITER, L.; FOREMAN, B. Modeling the learning progressions of computational thinking of primary grade students. In: THE NINTH ANNUAL INTERNATIONAL ACM CONFERENCE, 2013, San Diego. Anais [..]. San Diego: ACM Press, 2013.
WANGENHEIM, C. et al. CodeMaster - Automatic Assessment and Grading of App Inventor and Snap! Programs. Informatics in Education, v. 17, n. 1, 14 abr. 2018.
WEINTROP, D.; WILENSKY, U. Using Commutative Assessments to Compare Conceptual Understanding in Blocks-based and Text-based Programs. In: THE ELEVENTH ANNUAL INTERNATIONAL CONFERENCE, 2015. Anais [...]. [s.l.]: ACM Press, 2015.
WING, J. M. Computational thinking. Communications of the ACM, v. 49, n. 3, p. 33, 1 mar. 2006.
BOCCONI, S. et al. Developing computational thinking in compulsory education-implications for policy and practice. Join Research Center (European Commission). Sevilha. 2016.
BRACKMANN, Christian Puhlmann. Desenvolvimento do pensamento computacional através de atividades desplugadas na educação básica. 2017. Tese (Programa de Pós-Graduação em Informática na Educação) – Universidade Federal do Rio Grande do Sul, Porto Alegre, Rio Grande do Sul.
BRENNAN, K.; RESNICK, M. New frameworks for studying and assessing the development of computational thinking. In: Proceedings of the 2012 annual meeting of the American Educational Research Association, Vancouver, Canada. 2012.
CALBUSCH, L. CT Puzzle Test: Instrumento para Avaliação do Pensamento Computacional de Jovens de 14 a 17 Anos. Dissertação (Mestrado em Computação Aplicada) – Universidade do Vale do Itajaí. No prelo, 2020.
CARTELLI, A.; DAGIENE, V.; FUTSCHEK, G. Bebras Contest and Digital Competence Assessment. Current Trends and Future Practices for Digital Literacy and Competence. [s.l.]: IGI Global, 2012.
COUTO, N. E. R. Impacto da implantação de uma disciplina de pensamento computacional em estudantes. Dissertação (Mestrado em Computação Aplicada) – Universidade do Vale do Itajaí. 2018.
DAGIENE, V.; FUTSCHEK, G. Bebras International Contest on Informatics and Computer Literacy: Criteria for Good Tasks. Lecture Notes in Computer Science. [s.l.]: Springer Berlin Heidelberg, 2008. p
DAGIENE, V.; STUPURIENE, G. Informatics education based on solving attractive tasks through a contest. In: KEY COMPETENCIES IN INFORMATICS AND ICT, 2014, Potsdam. Preliminary Proceedings. Potsdam: University Of Potsdam, 2014.
FALKNER, N.; SOORIAMURTHI, R.; MICHALEWICZ, Z. Puzzle-Based Learning for Engineering and Computer Science. Computer, v. 43, n. 4, p. 20–28, abr. 2010.
FEUERSTEIN, R. The Feuerstein Instrumental Enrichment Program. Jerusalem: ICELP Publications, 2006.
GONÇALVES, F. Um instrumento para diagnóstico do pensamento computacional. 2015. 128 f. Dissertação - Mestrado em Computação Aplicada, Universidade do Vale do Itajaí, 2015.
GOUWS, L. A.; BRADSHAW, K.; WENTWORTH, P. Computational thinking in educational activities. Proceedings of the 18th ACM conference on Innovation and technology in computer science education - ITiCSE ’13. Anais... In: THE 18TH ACM CONFERENCE. ACM Press, 2013.
GROVER, S. Systems of assessments for deeper learning of computational thinking in k-12. In: Annual meeting of the American Educational Research Association, Chicago: 2015.
HOGAN, T. Introdução À Prática de Testes Psicológicos. Rio de Janeiro: Ltc, 2006.
KALELIOGLU, F.; GULBAHAR, Y.; KUKUL, V. A Framework for Computational Thinking Based on a Systematic Research Review. Baltic Journal Of Modern Computing. Letônia, 2016.
MAIORANA, F.; GIORDANO, D.; MORELLI, R. Quizly: A live coding assessment platform for App Inventor. In: 2015 IEEE BLOCKS AND BEYOND WORKSHOP (BLOCKS AND BEYOND), out. 2015. Anais [..]. [s.l.]: IEEE, out. 2015.
MORENO-LEÓN, J.; ROBLES, G.; ROMÁN-GONZÁLEZ, M. Dr. Scratch: Automatic Analysis of Scratch Projects to Assess and Foster Computational Thinking. Revista de Educación A Distancia, Espanha, v. 10, n. 46, p.1-23, set. 2015.
MÜHLING, A.; RUF, A.; HUBWIESER, P. Design and First Results of a Psychometric Test for Measuring Basic Programming Abilities. In: THE WORKSHOP IN PRIMARY AND SECONDARY COMPUTING EDUCATION. Anais [...]. [s.l.]: ACM Press, 2015.
PAPERT, S. Teaching children thinking. MIT Artificial Intelligence Laboratory. Memo no. 2247, Logo Memo no. 2. Cambridge. 1971.
ROMÁN-GONZÁLEZ, M. Computational thinking test: Design guidelines and content validation. In: Proceedings of the 7th Annual International Conference on Education and New Learning Technologies (EDULEARN), 2015, Barcelona. Proceedings.. Barcelona: IATED, 2015.
ROMÁN-GONZÁLEZ, M.; MORENO-LEÓN, J.; ROBLES, G. Complementary Tools for Computational Thinking Assessment. Proceedings of International Conference on Computational Thinking Education 2017. Hong Kong: The Education University of Hong Kong, jun. 2017.
ROMÁN-GONZÁLEZ, M.; PÉREZ-GONZÁLEZ, J.-C.; JIMÉNEZ-FERNÁNDEZ, C. Which cognitive abilities underlie computational thinking? Criterion validity of the Computational Thinking Test. Computers in Human Behavior, v. 72. 2017b.
ROMÁN-GONZÁLEZ, M.; MORENO-LEÓN, J.; ROBLES, G. Combining Assessment Tools for a Comprehensive Evaluation of Computational Thinking Interventions. Computational Thinking Education. [s.l.]: Springer Singapore, 2019.
SEITER, L.; FOREMAN, B. Modeling the learning progressions of computational thinking of primary grade students. In: THE NINTH ANNUAL INTERNATIONAL ACM CONFERENCE, 2013, San Diego. Anais [..]. San Diego: ACM Press, 2013.
WANGENHEIM, C. et al. CodeMaster - Automatic Assessment and Grading of App Inventor and Snap! Programs. Informatics in Education, v. 17, n. 1, 14 abr. 2018.
WEINTROP, D.; WILENSKY, U. Using Commutative Assessments to Compare Conceptual Understanding in Blocks-based and Text-based Programs. In: THE ELEVENTH ANNUAL INTERNATIONAL CONFERENCE, 2015. Anais [...]. [s.l.]: ACM Press, 2015.
WING, J. M. Computational thinking. Communications of the ACM, v. 49, n. 3, p. 33, 1 mar. 2006.
Published
2020-11-24
How to Cite
RAABE, André; VIANA, Cassiano; CALBUSCH, Leonardo.
CT Puzzle Test: Towards an interactive assessment of computational thinking. In: BRAZILIAN SYMPOSIUM ON COMPUTERS IN EDUCATION (SBIE), 31. , 2020, Online.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2020
.
p. 1683-1692.
DOI: https://doi.org/10.5753/cbie.sbie.2020.1683.
