Analysis of the Use of Generative AI Tools in Programming Education: Perspectives from Information Systems Students

• Teresinha Letícia da Silva UFRGS
• Kajiana Nuernberg Sartor Vidotto UFRGS
• Liane Margarida Rockenbach Tarouco UFRGS
• Patrícia Fernanda da Silva UFRGS

DOI: https://doi.org/10.5753/wei.2025.9236

Abstract

This study investigates the impact of generative AI tools on programming learning, analyzing their effectiveness, benefits, limitations, and possible effects on student motivation and performance. Data were collected from 55 students in the Information Systems course, through questionnaires that assessed frequency of use, perceptions, and challenges faced. The results indicate that most students consider AI important, especially for answering questions, accelerating code writing, and correcting errors. However, challenges such as incorrect information and possible dependence on technology were pointed out. In addition, 54.6% of students reported increased motivation, and 81.9% perceived improved performance. Despite the benefits, the research highlights the need for balanced use to avoid negative impacts on learning.

References

BARDIN, Laurence. Análise de conteúdo (Tradução Luís Antero Reto). São Paulo, Brasil: Edições, v. 70, 2016.

BECKER, Brett A. et al. Programming Is Hard - Or at Least It Used to Be: Educational Opportunities and Challenges of AI Code Generation. In: SIGCSE 2023: THE 54TH ACM TECHNICAL SYMPOSIUM ON COMPUTER SCIENCE EDUCATION, 2023, Toronto ON Canada. Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1. Toronto ON Canada: ACM, 2023. p. 500–506. Disponível em: [link].

COELHO, Luciano Figueiredo et al. Influência e percepções do ChatGPT na aprendizagem de programação: um estudo de caso na Faculdade Senac Palhoça. CONTRIBUCIONES A LAS CIENCIAS SOCIALES, [s. l.], v. 17, n. 1, p. 5819–5829, 2024. Disponível em: [link].

CHEN, Xieling et al. Two Decades of Artificial Intelligence in Education: Contributors, Collaborations, Research Topics, Challenges, and Future Directions. Educational Technology & Society, [s. l.], v. 25, n. 1, 2022.

DENNY, Paul et al. Desirable Characteristics for AI Teaching Assistants in Programming Education. In: ITICSE 2024: INNOVATION AND TECHNOLOGY IN COMPUTER SCIENCE EDUCATION, 2024, Milan Italy. Proceedings of the 2024 on Innovation and Technology in Computer Science Education V. 1. Milan Italy: ACM, 2024. p. 408–414. Disponível em: [link].

ECKERDAL, Anna ; THUNÉ, Michael. Novice Java Programmers’ Conceptions of “Object” and “Class”, and Variation Theory. In Proceedings of the 10th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education (Caparica, Portugal) (ITiCSE ’05). ACM, NY NY, USA, 89–93. DOI: 10.1145/1067445.1067473, 2005.

HOLMES, Wayne; BIALIK, Maya; FADEL, Charles. Artificial intelligence in education. In: STÜCKELBERGER, Christoph; DUGGAL, Pavan (org.). Data ethics: building trust: how digital technologies can serve humanity. [S. l.]: Globethics Publications, 2023. p. 621–653. Disponível em: [link].

HUSAIN, Anas. Potentials of ChatGPT in Computer Programming: Insights from Programming Instructors. Journal of Information Technology Education: Research, v. 23, p. 002, 2024. Disponível em: [link].

KASNECI, Enkelejda et al. ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, [s. l.], v. 103, p. 102274, 2023. Disponível em: [link]. Acesso em: 23 set. 2024.

LAU, Sam; GUO, Philip. From “Ban It Till We Understand It” to “Resistance is Futile”: How University Programming Instructors Plan to Adapt as More Students Use AI Code Generation and Explanation Tools such as ChatGPT and GitHub Copilot. In: Proceedings of the 2023 ACM Conference on International Computing Education Research V.1. Chicago IL USA: ACM, 2023, p. 106–121. Disponível em: [link].

LEPP, Marina; KAIMRE, Joosep. Does generative AI help in learning programming: Students’ perceptions, reported use and relation to performance. Computers in Human Behavior Reports, [s. l.], v. 18, p. 100642, 2025. Disponível em: [link].

LO, Chung Kwan. What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature. Education Sciences, [s. l.], v. 13, n. 4, p. 410, 2023. Disponível em: [link].

SÁNCHEZ-GORDÓN, Mary et al. Educating Augmented Programmers. Computer, [s. l.], v. 56, n. 12, p. 100–104, 2023. Disponível em: [link].

SARKAR, A., GORDON, A. D., NEGREANU, C., POELITZ, C., RAGAVAN, S. S., ZORN, B. What is it like to program with artificial intelligence?, 2022. DOI: 10.48550/ARXIV.2208.06213

SILVA JUNIOR, Silvino Marques Da et al. ChatGPT no auxílio da aprendizagem de programação: Um estudo de caso. In: SIMPÓSIO BRASILEIRO DE INFORMÁTICA NA EDUCAÇÃO, 2023, Brasil. Anais do XXXIV Simpósio Brasileiro de Informática na Educação (SBIE 2023). Brasil: Sociedade Brasileira de Computação - SBC, 2023. p. 1375–1384. Disponível em: [link].

SILVA, T. L. da; VIDOTTO, K. N. S.; TAROUCO, L. M. R.; SILVA, P. F. da. Inteligência artificial generativa no ensino de programação: um mapeamento sistemático da literatura. RENOTE, Porto Alegre, v. 22, n. 1, p. 262–272, 2024. DOI: 10.22456/1679-1916.141553. Disponível em: [link].

SHEARD, Judy et al. Instructor Perceptions of AI Code Generation Tools - A Multi-Institutional Interview Study. In: Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1. Portland OR USA: ACM, 2024, p. 1223–1229. Disponível em: [link].

SOBRAL, S. “30 Years Of CS1: Programming Languages Evolution”. 9197–9205. 2019. DOI: 10.21125/iceri.2019.2214. 2019.

THOMPSON, Errol, Whalley, Jacqueline, Lister, Raymond, and Simon, Beth. Code Classification as a Learning and Assessment Exercise for Novice Programmers. In 19th Annual Conference of the National Advisory Committee on Computing Qualifications (NACCQ 2006). National Advisory Committee on Computing Qualifications, Wellington, New Zealand, 291–298, 2006.

VAITHILINGAM, P.; ZHANG, T.; GLASSMAN, E. L. Expectation vs. Experience: Evaluating the Usability of Code Generation Tools Powered by Large Language Models. In: CHI ’22: CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2022, New Orleans LA USA. CHI Conference on Human Factors in Computing Systems Extended Abstracts. New Orleans LA USA: ACM, 2022. p. 1–7. Disponível em: [link].