Use of ChatBots in Programming Education: A Scoping Review

• João Victor Barroso Alves Universidade Federal do Ceará
• Yanna Torres Gonçalves Universidade Federal do Ceará
• Henrique Barbosa Silva Universidade Federal do Ceará

DOI: https://doi.org/10.5753/sbie.2024.242473

Resumo

Proficiency in programming languages is essential across various sectors. As technology advances, AI-driven chatbots are increasingly recognized for their potential in education. This paper presents a scoping review of chatbots in programming education, examining existing research to identify benefits, challenges, and user perceptions. Findings reveal positive impacts on learning and widespread student adoption. However, gaps exist, such as limited focus on teachers' perspectives and issues with student engagement and accessibility.

Referências

Adamopoulou, E. and Moussiades, L. (2020). An overview of chatbot technology. In Ma glogiannis, I., Iliadis, L., and Pimenidis, E., editors, Artificial Intelligence Applications and Innovations, pages 373–383, Cham. Springer International Publishing

Banié, B., Konecki, M., and Konecki, M. (2023). Pair programming education aided by chatgpt. In 2023 46th MIPRO ICT and Electronics Convention (MIPRO), pages 911–915.

Butgereit, L. and Egu, A. G. (2023). Using gpt-4 to tutor java programming in amharic. In 2023 First International Conference on the Advancements of Artificial Intelligence in African Context (AAIAC), pages 1–5.

Chan, W. K., Yu, Y. T., Keung, J. W., and Lee, V. C. (2023). Toward ai-assisted exercise creation for first course in programming through adversarial examples of ai models. In 2023 IEEE 35th International Conference on Software Engineering Education and Training (CSEE&T), pages 132–136.

Dermeval, D., Coelho, J. A. P. d. M., and Bittencourt, I. I. (2020). Mapeamento sistemático e revisão sistemática da literatura em informática na educação. In Jaques, P. A., Siqueira, S., Bittencourt, I., and Pimentel, M., editors, Metodologia de Pesquisa Científica em Informática na Educação: Abordagem Quantitativa. SBC, Porto Alegre.

Dos Santos, O. L. and Cury, D. (2023). Challenging the confirmation bias: Using chatgpt as a virtual peer for peer instruction in computer programming education. In 2023 IEEE Frontiers in Education Conference (FIE), pages 1–7.

Haindl, P. and Weinberger, G. (2024). Students’ experiences of using chatgpt in an un dergraduate programming course. IEEE Access, 12:43519–43529.

Hajj, J. A. and Sah, M. (2023). Assessing the impact of chatgpt in a php programming course. In 2023 7th International Symposium on Innovative Approaches in Smart Tech nologies (ISAS), pages 1–10.

Hanifi, K., Cetin, O., and Yilmaz, C. (2023). On chatgpt: Perspectives from software en gineering students. In 2023 IEEE 23rd International Conference on Software Quality, Reliability, and Security (QRS), pages 196–205.

Hu, M., Assadi, T., and Mahroeian, H. (2023). Explicitly introducing chatgpt into first year programming practice: Challenges and impact. In 2023 IEEE International Con ference on Teaching, Assessment and Learning for Engineering (TALE), pages 1–6.

Jin, H., Lee, S., Shin, H., and Kim, J. (2024). Teach ai how to code: Using large language models as teachable agents for programming education. In Proceedings of the CHI Conference on Human Factors in Computing Systems, CHI ’24, New York, NY, USA. Association for Computing Machinery.

Kazemitabaar, M., Ye, R., Wang, X., Henley, A. Z., Denny, P., Craig, M., and Grossman, T. (2024). Codeaid: Evaluating a classroom deployment of an llm-based program ming assistant that balances student and educator needs. In Proceedings of the CHI Conference on Human Factors in Computing Systems, CHI ’24, New York, NY, USA. Association for Computing Machinery.

Kitchenham, B. and Charters, S. (2007). Guidelines for performing systematic literature reviews in software engineering. Technical Report EBSE 2007-001, Keele University and Durham University Joint Report.

Labadze, L., Grigolia, M., and Machaidze, L. (2023). Role of ai chatbots in educa tion: systematic literature review. International Journal of Educational Technology in Higher Education, 20(1):56.

Liao, J., Zhong, L., Zhe, L., Xu, H., Liu, M., and Xie, T. (2024). Scaffolding computa tional thinking with chatgpt. IEEE Transactions on Learning Technologies, 17:1668 1682.

Liu, R., Zenke, C., Liu, C., Holmes, A., Thornton, P., and Malan, D. J. (2024). Teaching cs50 with ai: Leveraging generative artificial intelligence in computer science edu cation. In Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1, SIGCSE 2024, page 750–756, New York, NY, USA. Association for Computing Machinery.

Padilla, J. R. C., Montefalcon, M. D. L., and Hernandez, A. A. (2023). Language ai in programming: A case study of chatgpt in higher eduation using natural language processing. In 2023 IEEE 11th Conference on Systems, Process & Control (ICSPC), pages 276–281.

Spasié, A. J. and Jankovié, D. S. (2023). Using chatgpt standard prompt engineering techniques in lesson preparation: Role, instructions and seed-word prompts. In 2023 58th International Scientific Conference on Information, Communication and Energy Systems and Technologies (ICEST), pages 47–50.

Speth, S., Meißner, N., and Becker, S. (2023). Investigating the use of ai-generated ex ercises for beginner and intermediate programming courses: A chatgpt case study. In 2023 IEEE 35th International Conference on Software Engineering Education and Training (CSEE&T), pages 142–146.

Vicari, R. M. (2021). Influências das tecnologias da inteligência artificial no ensino. Estudos Avançados, 35:73–84.

Wang, T., Díaz, D. V., Brown, C., and Chen, Y. (2023). Exploring the role of ai assis tants in computer science education: Methods, implications, and instructor perspec tives. In 2023 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pages 92–102.

Yilmaz, R. and Karaoglan Yilmaz, F. G. (2023). The effect of generative artificial intelli gence (ai)-based tool use on students’ computational thinking skills, programming self efficacy and motivation. Computers and Education: Artificial Intelligence, 4:100147.

Zhang, K. and Aslan, A. B. (2021). Ai technologies for education: Recent research & future directions. Computers and Education: Artificial Intelligence, 2:100025.