“You’ve Got the Music in You, Don’t You?" Designing Emotionally Engaging Musical Visualizations
Resumo
Integrating music and visualization in video games is crucial in enhancing emotional storytelling and immersion. Despite the recognized power of music to evoke emotions, the deliberate combination of music and visual elements to convey specific emotions in video games remains underexplored. This study addresses this gap by proposing a set of design principles to improve the emotional impact of musical visualizations in video games. They were applied and evaluated in two visualizations, and the results showed greater alignment with the intended emotional communication. Our findings give game developers practical insights to create more emotionally engaging visual experiences.
Palavras-chave:
Musical Visualization, Emotions, Design Principles, Game Design
Referências
Bauer, R. and Suter, B. (2021). Narrative Mechanics: Strategies and Meanings in Games and Real Life, pages 91–110.
Collins, K. (2013). Playing with sound: a theory of interacting with sound and music in video games. MIT press.
Cowen, A. S., Fang, X., Sauter, D., and Keltner, D. (2020). What music makes us feel: At least 13 dimensions organize subjective experiences associated with music across different cultures. Proceedings of the National Academy of Sciences, 117(4):1924-1934.
Dickey, M. (2006). Game design narrative for learning: Appropriating adventure game design narrative devices and techniques for the design of interactive learning environments. Educational Technology Research and Development, 54:245–263.
Hooper, G. (2018). Sounding the Story: Music in Videogame Cutscenes, pages 115–141. Springer International Publishing, Cham.
Joosten, E., van Lankveld, G., and Spronck, P. (2012). Influencing player emotions using colors. Journal of Intelligent Computing, 3:76–86.
Miller, J., Narayan, U., Hantsbarger, M., Cooper, S., and El-Nasr, M. S. (2019). Expertise and engagement: re-designing citizen science games with players’ minds in mind. Proceedings of the 14th International Conference on the Foundations of Digital Games.
Miranda, D., Li, C., and Darin, T. (2021). Ues-br: Translation and cross-cultural adaptation of the user engagement scale for brazilian portuguese. Proceedings of the ACM on Human-Computer Interaction, 5:1–22.
Peerdeman, P. (2010). Sound and music in games by peter peerdeman. In Sound and Music in Games by Peter Peerdeman.
Pereira, D. and Chambel, T. (2023). Enhancing emotional awareness and regulation in movies and music based on personality. Proceedings of the 2023 ACM International Conference on Interactive Media Experiences.
Pereira Nunes, C. and Darin, T. (2024). Cross-cultural adaptation of the intrinsic motivation inventory task evaluation questionnaire into brazilian portuguese. pages 1–11.
Pillai, J. S., Ismail, A., and Charles, H. P. (2017). Grammar of vr storytelling: Visual cues. In Proceedings of the Virtual Reality International Conference Laval Virtual 2017, VRIC ’17, New York, NY, USA. Association for Computing Machinery.
Pokharel, R. (2020). Exploring the different roles and aspects of music. Molung Educational Frontier, pages 125–133.
Pouris, M. and Fels, D. I. (2012). Creating an entertaining and informative music visualization. In International Conference on Computers for Handicapped Persons, pages 451–458. Springer.
Ryan, R. M. and Deci, E. L. (2017). Self-determination theory: Basic psychological needs in motivation, development, and wellness. Guilford publications.
Ryan, R. M., Rigby, C. S., and Przybylski, A. (2006). The motivational pull of video games: A self-determination theory approach. Motivation and emotion, 30:344–360.
Stewart, R., Kudumakis, P., and Sandler, M. (2010). Interactive music applications and standards. pages 20–30.
Collins, K. (2013). Playing with sound: a theory of interacting with sound and music in video games. MIT press.
Cowen, A. S., Fang, X., Sauter, D., and Keltner, D. (2020). What music makes us feel: At least 13 dimensions organize subjective experiences associated with music across different cultures. Proceedings of the National Academy of Sciences, 117(4):1924-1934.
Dickey, M. (2006). Game design narrative for learning: Appropriating adventure game design narrative devices and techniques for the design of interactive learning environments. Educational Technology Research and Development, 54:245–263.
Hooper, G. (2018). Sounding the Story: Music in Videogame Cutscenes, pages 115–141. Springer International Publishing, Cham.
Joosten, E., van Lankveld, G., and Spronck, P. (2012). Influencing player emotions using colors. Journal of Intelligent Computing, 3:76–86.
Miller, J., Narayan, U., Hantsbarger, M., Cooper, S., and El-Nasr, M. S. (2019). Expertise and engagement: re-designing citizen science games with players’ minds in mind. Proceedings of the 14th International Conference on the Foundations of Digital Games.
Miranda, D., Li, C., and Darin, T. (2021). Ues-br: Translation and cross-cultural adaptation of the user engagement scale for brazilian portuguese. Proceedings of the ACM on Human-Computer Interaction, 5:1–22.
Peerdeman, P. (2010). Sound and music in games by peter peerdeman. In Sound and Music in Games by Peter Peerdeman.
Pereira, D. and Chambel, T. (2023). Enhancing emotional awareness and regulation in movies and music based on personality. Proceedings of the 2023 ACM International Conference on Interactive Media Experiences.
Pereira Nunes, C. and Darin, T. (2024). Cross-cultural adaptation of the intrinsic motivation inventory task evaluation questionnaire into brazilian portuguese. pages 1–11.
Pillai, J. S., Ismail, A., and Charles, H. P. (2017). Grammar of vr storytelling: Visual cues. In Proceedings of the Virtual Reality International Conference Laval Virtual 2017, VRIC ’17, New York, NY, USA. Association for Computing Machinery.
Pokharel, R. (2020). Exploring the different roles and aspects of music. Molung Educational Frontier, pages 125–133.
Pouris, M. and Fels, D. I. (2012). Creating an entertaining and informative music visualization. In International Conference on Computers for Handicapped Persons, pages 451–458. Springer.
Ryan, R. M. and Deci, E. L. (2017). Self-determination theory: Basic psychological needs in motivation, development, and wellness. Guilford publications.
Ryan, R. M., Rigby, C. S., and Przybylski, A. (2006). The motivational pull of video games: A self-determination theory approach. Motivation and emotion, 30:344–360.
Stewart, R., Kudumakis, P., and Sandler, M. (2010). Interactive music applications and standards. pages 20–30.
Publicado
07/10/2024
Como Citar
CASTRO, Mariana; REINBOLD, Isabelle; NUNES, Caio; DARIN, Ticianne.
“You’ve Got the Music in You, Don’t You?" Designing Emotionally Engaging Musical Visualizations. In: WORKSHOP SOBRE INTERAÇÃO E PESQUISA DE USUÁRIOS NO DESENVOLVIMENTO DE JOGOS (WIPLAY), 3. , 2024, Brasília/DF.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2024
.
p. 87-98.
DOI: https://doi.org/10.5753/wiplay.2024.245474.
