Use of ChatGPT in the Educational Context: A Systematic Literature Review

• Daniela Marques University of São Paulo / Federal Institute of São Paulo https://orcid.org/0000-0003-1360-6434
• Marcelo Morandini University of São Paulo https://orcid.org/0000-0001-5402-9544

DOI: https://doi.org/10.5753/sbie.2024.242535

Abstract

The Artificial Intelligence area has been evolving rapidly. The Large Language Model, which uses algorithms to generate and produce texts, has become part of the daily lives of thousands of people after the ChatGPT launch, a product that uses this technology. Several areas were impacted by its use, including education. However, since it is a new technology, it is necessary to know how the LLM is being used and what guidelines have already been identified in the educational context. This paper presents a systematic review of the literature to identify practices carried out using the Large Language Model about this technology, showing methodologies used and reflections on the results found.

Keywords: LLM, AI, educational

References

Čavojský, M., Bugár, G., Kormaník, T., and Hasin, M. (2023). Exploring the capabilities and possible applications of large language models for education. In 2023 21st International Conference on Emerging eLearning Technologies and Applications (ICETA), pages 91–98.

Bubaš, G., Babić, S., and Čižmešija, A. (2023). Usability and user experience related perceptions of university students regarding the use of bing chat search engine and ai chatbot: Preliminary evaluation of assessment scales. In 2023 IEEE 21st Jubilee International Symposium on Intelligent Systems and Informatics (SISY), pages 607-612.

Budiu, R., Liu, F., Cionca, E., and Zhang, A. (2024). Information Foraging with Ge nerative AI: A Study of 3 Chatbots. [link]. Acessado em 24/06/2024.

Buselic, V. (2023). Teaching information literacy and critical thinking skills in Chatgpt time. In 2023 International Conference on Computing, Networking, Telecommunicati ons Engineering Sciences Applications (CoNTESA), pages 14–20.

Chan, M. M., Amado-Salvatierra, H. R., Hernandez-Rizzardini, R., and De La Roca, M. (2023). The potential role of AI-based chatbots in engineering education experiences from a teaching perspective. In 2023 IEEE Frontiers in Education Conference (FIE), pages 1–5.

Cobos, M. and Cherres, H. (2023). School evaluation and artificial intelligence. In 2023 IEEE 3rd International Conference on Advanced Learning Technologies on Education Research (ICALTER), pages 1–4.

Dos Santos, O. L. and Cury, D. (2023). Challenging the confirmation bias: Using Chatgpt as a virtual peer for peer instruction in computer programming education. In 2023 IEEE Frontiers in Education Conference (FIE), pages 1–7.

Elsayed, S. (2023). Towards mitigating Chatgpt’s negative impact on education: Optimizing question design through bloom’s taxonomy. In 2023 IEEE Region 10 Symposium (TENSYMP), pages 1–6.

Gumina, S., Dalton, T., and Gerdes, J. (2023). Teaching it software fundamentals: Strate gies and techniques for inclusion of large language models: Strategies and techniques for inclusion of large language models. In Proceedings of the 24th Annual Conference on Information Technology Education, SIGITE ’23, page 60–65, New York, NY, USA. Association for Computing Machinery.

Kitchenham, B. (2004). Procedures for Performing Systematic Reviews. NICTA, Keele University, Lyme. Technical Report 0400011T.1.

Kovačević, D. (2023). Use of Chatgpt in esp teaching process. In 2023 22nd International Symposium INFOTEH-JAHORINA (INFOTEH), pages 1–5.

Liu, M. and M’Hiri, F. (2024). Beyond traditional teaching: Large language models as simulated teaching assistants in computer science. In Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1, SIGCSE 2024, page 743–749, New York, NY, USA. Association for Computing Machinery.

Martínez-Téllez, R. and Camacho-Zuñiga, C. (2023). Enhancing mathematics education through AI chatbots in a flipped learning environment. In 2023 World Engineering Education Forum-Global Engineering Deans Council (WEEF-GEDC), pages 1–8.

Ouaazki, A., Bergram, K., and Holzer, A. (2023). Leveraging chatgpt to enhance computational thinking learning experiences. In 2023 IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE), pages 1–7.

Petrovska, O., Clift, L., Moller, F., and Pearsall, R. (2024). Incorporating generative AI into software development education. In Proceedings of the 8th Conference on Computing Education Practice, CEP ’24, page 37–40, New York, NY, USA. Association for Computing Machinery.

Prasad, P. and Sane, A. (2024). A self-regulated learning framework using generative AI and its application in CS educational intervention design. In Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1, SIGCSE 2024, page 1070–1076, New York, NY, USA. Association for Computing Machinery.

Prather, J., Denny, P., Leinonen, J., Becker, B. A., Albluwi, I., Craig, M., Keuning, H., Kiesler, N., Kohn, T., Luxton-Reilly, A., MacNeil, S., Petersen, A., Pettit, R., Reeves, B. N., and Savelka, J. (2023). The robots are here: Navigating the generative AI revolution in computing education. In Proceedings of the 2023 Working Group Reports on Innovation and Technology in Computer Science Education, ITiCSE-WGR ’23, page 108–159, New York, NY, USA. Association for Computing Machinery.

Rai, A. (2024). Generative AI: A beginner’s guide. [link]. Acessado em 24/06/2024.

Singh, P., Phutela, N., Grover, P., Sinha, D., and Sinha, S. (2023). Student’s perception of Chatgpt. In 2023 International Conference on Electrical, Communication and Computer Engineering (ICECCE), pages 1–6.

Tolk, A., Barry, P., Loper, M. L., Rabadi, G., Scherer, W. T., and Yilmaz, L. (2023). Chances and challenges of Chatgpt and similar models for education in ms. In 2023 Winter Simulation Conference (WSC), pages 3332–3346.

UNESCO(2023). Guidance for generative AI in education and research. UNESCO.

Wang, T., Díaz, D. V., Brown, C., and Chen, Y. (2023). Exploring the role of AI assistants in computer science education: Methods, implications, and instructor perspectives. In 2023 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pages 92–102.

Yinping, Z. and Yongxin, Z. (2023). Research on Chatgpt’s strategy to promote the digital transformation of education. In 2023 26th ACIS International Winter Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD-Winter), pages 28–31.

Zhong, J. and Zheng, Y. (2023). Identifying the impact of human-AI co-creation on students’ creativity development: a conceptual framework. In 2023 3rd International Conference on Educational Technology (ICET), pages 66–70.

Čavojský, M., Bugár, G., Kormaník, T., and Hasin, M. (2023). Exploring the capabilities and possible applications of large language models for education. In 2023 21st International Conference on Emerging eLearning Technologies and Applications (ICETA), pages 91–98.