Enhancing Game Development with Generative Artificial Intelligence Technologies: A Case Study of UNDO

• Eduardo Barroso Nunes UNIFOR http://orcid.org/0009-0001-9330-6628
• Maria Andréia Formico Rodrigues UNIFOR https://orcid.org/0000-0003-1181-2971

DOI: https://doi.org/10.5753/sbgames_estendido.2024.240951

Resumo

This paper explores the use of Generative AI technologies in game development through the case study of the serious game UNDO, which integrates time-travel and environmental education. Players engage in recycling tasks to correct past environmental mistakes. By utilizing advanced AI technologies like ChatGPT-3.5, ChatGPT-4, GitHub Copilot, DALL-E 2, DALL-E 3, Midjourney, AudioLM, AIVA, SOUNDRAW, and ElevenLabs within Unity3D, UNDO demonstrates the potential of Generative AIs to enhance narrative, visuals, and audio. These tools facilitate content creation, enhance production efficiency, and reduce repetitive tasks, while still requiring human oversight for refinement. This study demonstrates Generative AI's effectiveness in enriching the game development process.

Palavras-chave: Generative AIs, Serious Game, Environmental Preservation, Recycling

Referências

Agostinelli, A., Denk, T. I., Borsos, Z., Engel, J., Verzetti, M., Caillon, A., Huang, Q., Jansen, A., Roberts, A., Tagliasacchi, M., Sharifi, M., Zeghidour, N., e Frank, C. (2023). MusicLM: Generating music from text. [link]. Acesso em: 10 de jan. de 2024.

AIVA Technologies (2020). AIVA – The AI composing emotional soundtrack music. [link]. Acesso em: 10 de jan. de 2024.

Barbosa, R. G. e Rodrigues, M. A. F. (2006). Supporting guided navigation in mobile virtual environments. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology, pages 220–226.

Bogomolny, E. (2022). Rhymates. [link]. Acesso em: 28 de mai. de 2024.

Borsos, Z., Marinier, R., Vincent, D., Kharitonov, E., Pietquin, O., Sharifi, M., Roblek, D., Teboul, O., Grangier, D., Tagliasacchi, M., et al. (2023). AudioLM: A language modeling approach to audio generation. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 31:2523–2533.

Carvalho, V. M. e Rodrigues, M. A. F. (2023). Investigating and comparing the perceptions of voice interaction in digital games: Opportunities for health and wellness applications. In 2023 IEEE 11th International Conference on Serious Games and Applications for Health (SeGAH), pages 1–8. IEEE.

ElevenLabs (2022). Prime Voice AI. [link]. Acesso em: 23 de abr. de 2024.

GitHub (2021). GitHub Copilot: Your AI pair programmer. [link]. Acesso em: 20 de mai. de 2024.

Hai-Jew, S. (2023). CrAIyon: Putting an art-making AI through its paces. C2C Digital Magazine, 1(18):10. Last Visited: 2023-04-20.

Holz, D. (2022). Midjourney. [link]. Acesso em: 20 de abr. de 2024.

Huang, J. e Huang, K. (2023). ChatGPT in Gaming Industry. In Beyond AI: ChatGPT, Web3, and the Business Landscape of Tomorrow, pages 243–269. Springer.

Image-Line Software (2023). Fruit Loops Studio. [link]. Acesso em: 10 de abr. de 2024.

LAION (2022). Open Assistant. [link]. Acesso em: 10 de mar. de 2024.

Lin, C.-H., Gao, J., Tang, L., Takikawa, T., Zeng, X., Huang, X., Kreis, K., Fidler, S., Liu, M.-Y., e Lin, T.-Y. (2023). Magic3D: High-resolution text-to-3D content creation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 300–309.

Mehdi, Y. (2023). Reinventing search with a new AI-powered Microsoft Bing and Edge: Your copilot for the web. [link]. Acesso em: 10 de mar. de 2024.

NVIDIA Corporation (2021). NVIDIA Canvas. Computer Software. [link]. Acesso em: 15 de mai. de 2024.

OpenAI (2023). DALL-E 3. Computer Software. [link]. Acesso em: 15 de fev. de 2024.

OpenAI (2024). ChatGPT – Conversation with an AI language model. [link]. Acesso em: 10 de jul. de 2024.

Rodrigues, M. A. F., Macedo, D. V., Serpa, Y. R., e Serpa, Y. R. (2015). Beyond fun: an interactive and educational 3D traffic rules game controlled by non-traditional devices. In Proceedings of the 30th Annual ACM Symposium on Applied Computing, pages 239–246.

Rombach, R., Blattmann, A., Lorenz, D., Esser, P., e Ommer, B. (2022). High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10684–10695.

Schell, J. (2008). The Art of Game Design: A book of lenses. CRC press.

Serpa, Y. R., Nogueira, M. B., Rocha, H., Macedo, D. V., e Rodrigues, M. A. F. (2020). An interactive simulation-based game of a manufacturing process in heavy industry. Entertainment Computing, 34:100343.

Serpa, Y. R. e Rodrigues, M. A. F. (2022). Human and machine collaboration for painting game assets with Deep Learning. Entertainment Computing, 43:100497.

Silva, W. B. e Rodrigues, M. A. F. (2009). A lightweight 3D visualization and navigation system on handheld devices. In Proceedings of the 24th ACM Symposium on Applied Computing, pages 162–166.

SOUNDRAW, Inc. (2024). SOUNDRAW – AI Music Generator. Computer Software. [link]. Acesso em: 20 de mai. de 2024.

Takahashi, K. (2021). AICommand: ChatGPT integration with Unity Editor. [link]. Acesso em: 22 de mai. de 2024.

Tamulur (2022). Spiritual Voice Chat with a ChatGPT-driven Monk. [link]. Acesso em: 10 de mar. de 2024.

Taye, M. M. (2023). Understanding of Machine Learning with Deep Learning: Architectures, workflow, applications and future directions. Computers, 12(5):91.

Treanor, M., Zook, A., Eladhari, M. P., Togelius, J., Smith, G., Cook, M., Thompson, T., Magerko, B., Levine, J., e Smith, A. (2015). AI-based game design patterns.