Soundtracks for educational games with Generative Artificial Intelligence: an empirical study

• Fabrizio Honda UEA
• Jeniffer Macena UEA
• Isabela Amora UEA
• Endrenrique Soares UEA
• Marcela Pessoa UEA
• Fernanda Pires UEA

DOI: https://doi.org/10.5753/sbgames.2025.10313

Resumo

Introduction: Soundtracks (music) play an important role in educational games, helping to keep the player in a state of flow. However, many educational game developers do not have the expertise to create soundtracks, and it is not always possible to find free and non-copyrighted materials that are suitable for the artifacts created. Objective: This paper presents an empirical study on using Generative Artificial Intelligence to create soundtracks for educational games. Three AI models were used to achieve this goal (MusicFX, Riffusion, and Suno AI), which generated music for three different educational games. Steps: The research was carried out through steps that involve selecting models and games, construction of the prompt, and analysis/collection of data. Results: The results of the evaluation with students/computer professionals and educational game developers indicate promising results in the generation of music, mainly regarding the ability to create quality soundtracks that match the games, but also reservations regarding repetitive elements, generic sounds, slow rhythm, etc.

Palavras-chave: Music, Education, Games, Artificial Intelligence, Soundtracks

Referências

Alves, L. R. G. e. o. (2010). Jogos eletrônicos e educações: como os games podem ajudar no processo de aprendizagem. Editora Papirus.

Amaral, G., Baffa, A., Briot, J.-P., Feijó, B., e Furtado, A. (2022). An adaptive music generation architecture for games based on the deep learning transformer model. In 2022 21st Brazilian Symposium on Computer Games and Digital Entertainment (SBGames), pages 1–6. IEEE.

Battistella, P., von Wangenheim, C., e Fernandes, J. M. (2014). Como jogos educacionais são desenvolvidos? uma revisão sistemática da literatura. In Anais do XXII Workshop sobre Educação em Computação, pages 159–168. SBC.

Cao, H., Tan, C., Gao, Z., Xu, Y., Chen, G., Heng, P.-A., e Li, S. Z. (2024). A survey on generative diffusion models. IEEE Transactions on Knowledge and Data Engineering.

Caroux, L. e Pujol, M. (2024). Player enjoyment in video games: A systematic review and meta-analysis of the effects of game design choices. International Journal of Human–Computer Interaction, 40(16):4227–4238.

Csikszentmihalyi, M. (1990). Flow: The Psychology of Optimal Experience. Harper & Row, New York.

Donahue, C., Mao, H. H., Li, Y. E., Cottrell, G. W., e McAuley, J. (2019). Lakhnes: Improving multi-instrumental music generation with cross-domain pre-training. arXiv preprint arXiv:1907.04868.

Evans, R. (2018). An investigation into the effect of music on immersion in video games.

Fernandes, R. (2010). Brincar na pré-escola: o jogo como proposta de trabalho pedagógico. Editora Vozes.

Genesio, N. O. S., de Oliveira, A. M., Oliveira, E. W., e Valle, P. H. D. (2024). Panorama de estudos sobre jogos educacionais digitais em educação em computação. In Workshop sobre Educação em Computação (WEI), pages 737–749. SBC.

Guedes, U. e Mello, A. (2024). Conflito de estrelas: Adaptando um jogo educativo analógico para o meio digital. In Anais do XXXV Simpósio Brasileiro de Informática na Educação, pages 870–883, Porto Alegre, RS, Brasil. SBC.

Honda, F., Pires, F., Pessoa, M., e Maia, J. (2022). Cadê minha pizza? um jogo para exercitar matemática e pensamento computacional através de grafos. In Simpósio Brasileiro de Jogos e Entretenimento Digital (SBGames), pages 876–885. SBC.

Honda, F., Pires, F., Pessoa, M., e Oliveira, E. H. (2023). Automigos: learning design para ludificação de autômatos finitos determinísticos. In Workshop sobre Educação em Computação (WEI), pages 545–556. SBC.

Huang, Q., Park, D. S., Wang, T., Denk, T. I., Ly, A., Chen, N., Zhang, Z., Zhang, Z., Yu, J., Frank, C., et al. (2023). Noise2music: Text-conditioned music generation with diffusion models. arXiv preprint arXiv:2302.03917.

IBM (2023). Ai hallucinations. [link]. Accessed: 2025-04-20.

Jovanovic, M. e Campbell, M. (2022). Generative artificial intelligence: Trends and prospects. Computer, 55(10):107–112.

Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023). Chatgpt for good? on opportunities and challenges of large language models for education. Learning and individual differences, 103:102274.

Levy, L. (2015). The effects of background music on video game play performance, behavior, and experience in extraverts and introverts. Accessed on: April 21, 2025.

Lima, W. G. d., de Freitas, A. R. R., e de Lima, T. F. M. (2021). Design e desenvolvimento de um jogo sério para educaçao musical. In Simpósio Brasileiro de Jogos e Entretenimento Digital (SBGames), pages 417–426. SBC.

Linek, S. B., Marte, B., e Albert, D. (2011). Background music in educational games: Motivational appeal and cognitive impact. In Ifenthaler, D., Eseryel, D. S., e Ge, X., editors, Computer Games and Instruction, pages 259–270. IGI Global.

Liu, H., Wang, Z., Hong, H., Feng, Y., Yu, J., Diao, H., Xu, Y., e Zhang, K. (2024). Metabgm: Dynamic soundtrack transformation for continuous multi-scene experiences with ambient awareness and personalization. arXiv preprint arXiv:2409.03844.

Marrinan, T., Akram, P., Gurmessa, O., e Shishkin, A. (2024). Leveraging ai to generate audio for user-generated content in video games. arXiv preprint arXiv:2404.17018.

Minaee, S., Mikolov, T., Nikzad, N., Chenaghlu, M., Socher, R., Amatriain, X., e Gao, J. (2024). Large language models: A survey. arXiv preprint arXiv:2402.06196.

Pires, F. G. d. S. (2021). Thinkted lab, um caso de aprendizagem criativa em computação no nível superior.

Pires, F. G. d. S., Queroga, J. d. S., Pessoa, M. S. P., e Melo, R. (2018). A viagem: Um jogo para explorar o território brasileiro. In Brazilian Symposium on Computers in Education (Simposio Brasileiro de Informatica na Educacao-SBIE), volume 29, page 705.

Plass, J. L., Homer, B. D., e Kinzer, C. K. (2015). Foundations of game-based learning. Educational Psychologist, 50(4):258–283.

Plass, J. L. e Kaplan, U. (2016). Emotional design in digital media for learning. In Emotions, technology, design, and learning, pages 131–161. Elsevier.

Schneider, F., Kamal, O., Jin, Z., e Schölkopf, B. (2023). Mo\ˆ usai: Text-to-music generation with long-context latent diffusion. arXiv preprint arXiv:2301.11757.

Sengar, S. S., Hasan, A. B., Kumar, S., e Carroll, F. (2024). Generative artificial intelligence: a systematic review and applications. Multimedia Tools and Applications, pages 1–40.

Silva, P. d. S. M. d. (2025). Playful approach: stimuli to mental learning processes in early years. Accessed on: April 21, 2025.

Ye, Q., Axmed, M., Pryzant, R., e Khani, F. (2023). Prompt engineering a prompt engineer. arXiv preprint arXiv:2311.05661.

Yuan, R., Lin, H., Wang, Y., Tian, Z., Wu, S., Shen, T., Zhang, G., Wu, Y., Liu, C., Zhou, Z., et al. (2024). Chatmusician: Understanding and generating music intrinsically with llm. arXiv preprint arXiv:2402.16153.