Challenges to generate musical visualizations
Resumo
The technological acceleration of recent years has allowed for significant advances in data processing and the study of Music, an art with richly expressive and communicative information. In this article, we bring reports of experiences and contributions in the treatment of musical data extracted from digital MIDI and sound files, for the development of systems that generate musical visualizations.
Palavras-chave:
Digital Sound Processing, Music Analysis and Synthesis, Realtime Interactive Systems
Referências
José Fornari. Da música à musicologia, January 2019.
Giordano Cabral and Robert Willey. Analyzing Harmonic Progressions with HarmIn: the Music of Antônio Carlos Jobim. page 12, 2007.
Gabriel Dias Cantareira, Luis Gustavo Nonato, and Fernando V. Paulovich. MoshViz: A Detail+Overview Approach to Visualize Music Elements. IEEE Trans. Multimedia, 18(11):2238–2246, November 2016.
Mateus Bastos da Silva. Da Capo: Uma exploração das representações da música, 2019.
Ethan Hein. Designing the Drum Loop: A constructivist iOS rhythm tutorial system for beginners. PhD thesis, Steinhardt School of Culture, Education, and Human Development, New York University, 2013.
Delfina Malandrino, Donato Pirozzi, and Rocco Zaccagnino. Visualization and music harmony: Design, implementation, and evaluation. In 2018 22nd International Conference Information Visualisation (IV), pages 498–503, Fisciano, Italy, July 2018. IEEE.
Jarbas Jacomé. Sistemas Interativos de Tempo Real para Processamento Audiovisual Integrado, 2007.
Julian Scordato. Composing with Iannix. In Proceedings of the Fifth Conference on Computation, Communication, Aesthetics and X., volume V, page 389, Lisboa, Portugal, 2017.
Eero Tarasti. Los signos en la historia de la música, historia de la semiótica musical. Semiótica Musical, pages 15–71., 2008.
Michael Scott Cuthbert and Christopher Ariza. music21: A Toolkit for Computer-Aided Musicology and Symbolic Music Data. page 7, 2010. 18th Brazilian Symposium on Computer Music - SBCM 2021
Joe Futrelle and J. Stephen Downie. Interdisciplinary Research Issues in Music Information Retrieval. Journal of New Music Research, 32(2):121–131, June 2003.
Bozena Kostek. Perception-based data processing in acoustics: applications to music information retrieval and psychophysiology of hearing, volume 3. Springer Science & Business Media, 2005.
Miller Puckette et al. Pure data: another integrated computer music environment. Proceedings of the second intercollege computer music concerts, pages 37–41, 1996.
Peter Brinkmann, Peter Kirn, Richard Lawler, Chris McCormick, Martin Roth, and Hans-Christoph Steiner. Embedding pure data with libpd. In Proceedings of the Pure Data Convention, volume 291. Citeseer, 2011.
Dan Wilcox. Pdparty: An ios computer music platform using libpd. In Proceedings of the Pure Data Convention, 2016.
Peter Brinkmann, Dan Wilcox, Tal Kirshboim, Richard Eakin, and Ryan Alexander. Libpd: Past, present, and future of embedding pure data. In Proceedings of the Pure Data Convention, 2016.
Markus Konrad and Klaus Jung. Analysis of audio synthesis possibilities on mobile devices using the Apple iPhone and iPad. PhD thesis, Ph. D. Thesis, HTW Berlin, 2011.
Joe Hathway. Creating a digital musical instrument for children’s education and expression. 2021.
Leonardo Porto Passos, Leonardo Arruda, and José Fornari. Pure data for pure audio games.
Olivier Lartillot, Petri Toiviainen, and Tuomas Eerola. A matlab toolbox for music information retrieval. In Data analysis, machine learning and applications, pages 261– 268. Springer, 2008.
David Miles Huber. The MIDI manual. Sams, 1991.
André Machado. Tradutor de arquivos MIDI para texto utilizando linguagem funcional CLEAN. PhD thesis, Universidade Federal de Uberlândia, Uberlândia, 2001.
ANDRÉ AMORIM and JOHANNES KJELLBERG. A step out of the grid-interaction with touch-based alternative rhythm programming layouts in drum machine user interfaces. 2020.
Scott Wilson. Patterning: The iPad drum machine that wants us to think in circles, 2015.
Marco Filipe Ganança Vieira. Interactive music visualization: implementation, realization and evaluation. PhD thesis, 2014.
Stephen Malinowski. Music animation machine renderers, 2012.
Van Huynh and David Comberg. MusicVis a web application for visualizing sound., 2017.
Albert S. Bregman and Stephen McAdams. Auditory Scene Analysis: The Perceptual Organization of Sound. The Journal of the Acoustical Society of America, 95(2), February 1994.
Gregor Strle e Matev vz Pesek e M. Marolt. Towards useraware music information retrieval: Emotional and color perception of music. In Emotions and Personality in Personalized Serviços, 2017.
John Walker. MIDICSV, 2004.
Giordano Cabral and Robert Willey. Analyzing Harmonic Progressions with HarmIn: the Music of Antônio Carlos Jobim. page 12, 2007.
Gabriel Dias Cantareira, Luis Gustavo Nonato, and Fernando V. Paulovich. MoshViz: A Detail+Overview Approach to Visualize Music Elements. IEEE Trans. Multimedia, 18(11):2238–2246, November 2016.
Mateus Bastos da Silva. Da Capo: Uma exploração das representações da música, 2019.
Ethan Hein. Designing the Drum Loop: A constructivist iOS rhythm tutorial system for beginners. PhD thesis, Steinhardt School of Culture, Education, and Human Development, New York University, 2013.
Delfina Malandrino, Donato Pirozzi, and Rocco Zaccagnino. Visualization and music harmony: Design, implementation, and evaluation. In 2018 22nd International Conference Information Visualisation (IV), pages 498–503, Fisciano, Italy, July 2018. IEEE.
Jarbas Jacomé. Sistemas Interativos de Tempo Real para Processamento Audiovisual Integrado, 2007.
Julian Scordato. Composing with Iannix. In Proceedings of the Fifth Conference on Computation, Communication, Aesthetics and X., volume V, page 389, Lisboa, Portugal, 2017.
Eero Tarasti. Los signos en la historia de la música, historia de la semiótica musical. Semiótica Musical, pages 15–71., 2008.
Michael Scott Cuthbert and Christopher Ariza. music21: A Toolkit for Computer-Aided Musicology and Symbolic Music Data. page 7, 2010. 18th Brazilian Symposium on Computer Music - SBCM 2021
Joe Futrelle and J. Stephen Downie. Interdisciplinary Research Issues in Music Information Retrieval. Journal of New Music Research, 32(2):121–131, June 2003.
Bozena Kostek. Perception-based data processing in acoustics: applications to music information retrieval and psychophysiology of hearing, volume 3. Springer Science & Business Media, 2005.
Miller Puckette et al. Pure data: another integrated computer music environment. Proceedings of the second intercollege computer music concerts, pages 37–41, 1996.
Peter Brinkmann, Peter Kirn, Richard Lawler, Chris McCormick, Martin Roth, and Hans-Christoph Steiner. Embedding pure data with libpd. In Proceedings of the Pure Data Convention, volume 291. Citeseer, 2011.
Dan Wilcox. Pdparty: An ios computer music platform using libpd. In Proceedings of the Pure Data Convention, 2016.
Peter Brinkmann, Dan Wilcox, Tal Kirshboim, Richard Eakin, and Ryan Alexander. Libpd: Past, present, and future of embedding pure data. In Proceedings of the Pure Data Convention, 2016.
Markus Konrad and Klaus Jung. Analysis of audio synthesis possibilities on mobile devices using the Apple iPhone and iPad. PhD thesis, Ph. D. Thesis, HTW Berlin, 2011.
Joe Hathway. Creating a digital musical instrument for children’s education and expression. 2021.
Leonardo Porto Passos, Leonardo Arruda, and José Fornari. Pure data for pure audio games.
Olivier Lartillot, Petri Toiviainen, and Tuomas Eerola. A matlab toolbox for music information retrieval. In Data analysis, machine learning and applications, pages 261– 268. Springer, 2008.
David Miles Huber. The MIDI manual. Sams, 1991.
André Machado. Tradutor de arquivos MIDI para texto utilizando linguagem funcional CLEAN. PhD thesis, Universidade Federal de Uberlândia, Uberlândia, 2001.
ANDRÉ AMORIM and JOHANNES KJELLBERG. A step out of the grid-interaction with touch-based alternative rhythm programming layouts in drum machine user interfaces. 2020.
Scott Wilson. Patterning: The iPad drum machine that wants us to think in circles, 2015.
Marco Filipe Ganança Vieira. Interactive music visualization: implementation, realization and evaluation. PhD thesis, 2014.
Stephen Malinowski. Music animation machine renderers, 2012.
Van Huynh and David Comberg. MusicVis a web application for visualizing sound., 2017.
Albert S. Bregman and Stephen McAdams. Auditory Scene Analysis: The Perceptual Organization of Sound. The Journal of the Acoustical Society of America, 95(2), February 1994.
Gregor Strle e Matev vz Pesek e M. Marolt. Towards useraware music information retrieval: Emotional and color perception of music. In Emotions and Personality in Personalized Serviços, 2017.
John Walker. MIDICSV, 2004.
Publicado
24/10/2021
Como Citar
MOURA, Rute; CABRAL, Giordano; ABREU, Jáder; CUNHA, Mychelline; ALMEIDA, Horhanna.
Challenges to generate musical visualizations. In: SIMPÓSIO BRASILEIRO DE COMPUTAÇÃO MUSICAL (SBCM), 18. , 2021, Recife.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2021
.
p. 129-135.
DOI: https://doi.org/10.5753/sbcm.2021.19437.
