Parameterized and automated assessment on an introductory programming course

• Francisco de Assis Zampirolli UFABC http://orcid.org/0000-0002-7707-1793
• Paulo Henrique Pisani Universidade Federal do ABC (UFABC) http://orcid.org/0000-0002-5231-6766
• João Marcelo Josko Federal University of ABC http://orcid.org/0000-0002-8654-5866
• Guiou Kobayashi Universidade Federal do ABC
• Francisco Fraga Universidade Federal do ABC (UFABC) http://orcid.org/0000-0002-4895-807X
• Denise Goya Universidade Federal do ABC http://orcid.org/0000-0003-0852-6456
• Heitor Rodrigues Savegnago Federal University of ABC

DOI: https://doi.org/10.5753/cbie.sbie.2020.1573

Resumo

The generation of individualized exams can contribute to a more reliable assessment of the students. Manually performing this procedure may not be feasible, even more on a large scale. An alternative to deal with it is the automatic generation of questions. This paper discusses an innovative solution to simplify test generation and correction through parameterized questions in the context of a four-month Introduction to Programming course under a blended- learning (IP-BL) approach. It combines the open-source tool MCTest with Moodle and VPL plugin to generate and also automatically evaluate parameterized programming language questions. We applied an intervention based on this solution in two IP-BL groups (a total of 171 enrolled students) using Java.

Referências

Alemán, J. L. F. (2010). Automated assessment in a programming tools course. IEEE Transactions on Education, 54(4):576–581.


Bez, J. L., Ferreira, C. E., and Tonin, N. (2013/08). Uri online judge academic: A tool for professors. In Proceedings of the 2013 International Conference on Advanced ICT and Education, pages 744–747. Atlantis Press.


de Campos, C. P. ; Ferreira, C. E. (2004). Boca: A support system for programming contests. In Brazilian Workshop on Education in Computing.


Demir, O., Soysal, A., Arslan, A., Yu ̈rekli, B., and Yılmazel, O. (2010). Automatic grading system for programming homework. Computer Science Education: Innovation and Technology, CSEIT.


DuFrene, A. (https://digitalcommons.calpoly.edu/cscsp/95 (accessed June 23, 2020)). Automatic Generation and Grading of Programming Exercises.


Galan, D., Heradio, R., Vargas, H., Abad, I., and Cerrada, J. A. (2019). Automated assessment of computer programming practices: The 8-years uned experience. IEEE Access, 7:130113–130119.


Gordillo, A. (2019). Effect of an instructor-centered tool for automatic assessment of programming assignments on students’ perceptions and performance. Sustainability, 11(20):5568.


Hagiya, M., Fukuda, K., Tanabe, Y., and Saito, T. (2019). Automatically generating programming questions corresponding to rubrics using assertions and invariants. In Tatnall, A. and Mavengere, N., editors, Sustainable ICT, Education and Learning, pages 89–98. Springer International Publishing.


Radosevic, D., Orehovacki, T., and Stapic, Z. (2010). Automatic on-line generation of student’s exercises in teaching programming. In Central European Conference on Information and Intelligent Systems, CECIIS.


Rodriguez-del Pino, J. C., Rubio Royo, E., and Hernandez Figueroa, Z. (2012). A virtual programming lab for moodle with automatic assessment and anti-plagiarism features. Conference: International Conference on e-Learning, e-Business, Enterprise Information Systems, & e-Government.


Rubio-Sanchez, M., Kinnunen, P., Pareja-Flores, C., and Velazquez-Iturbide, A. (2014). Student perception and usage of an automated programming assessment tool. Computers in Human Behavior, 31:453–460.


Staubitz, T., Teusner, R., and Meinel, C. (2017). Towards a repository for open autogradable programming exercises. In 2017 IEEE 6th International Conference on Teaching, Assessment, and Learning for Engineering (TALE), pages 66–73. IEEE.


Venero, M. F. and Mena-Chalco, J. (2019). Ensino de programação avançada incentivando a metacognição: uma experiência positiva usando Moodle+VPL. In Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educacção SBIE), volume 30, page 279.


Wang, T., Su, X., Ma, P., Wang, Y., and Wang, K. (2011). Ability-training-oriented automated assessment in introductory programming course. Computers & Education, 56(1):220–226.


Zampirolli, F., Teubl, F., and Batista, V. (2019). Online generator and corrector of parametric questions in hard copy useful for the elaboration of thousands of individualized exams. In CSEDU (1), pages 352–359.