Mapping, Triggering, Scoring, and Procedural Paradigms of Machine Listening Application in Live-Electronics Compositions
Resumo
Since the advent of real-time computer music environments, composers have increasingly incorporated DSP analysis, synthesis, and processing algorithms in their creative practices. Those processes became part of interactive systems that use real-time computational tools in musical compositions that explore diverse techniques to generate, spatialize, and process instrumental/vocal sounds. Parallel to the development of these tools and the expansion of DSP methods, new techniques focused on sound/musical information extraction became part of the tools available for music composition. In this context, this article discusses the creative use of Machine Listening and Musical Information Retrieval techniques applied in the composition of live-electronics works. By pointing out some practical applications and creative approaches, we aim to circumscribe, in a general way, the strategies for employing Machine Listening and Music Information Retrieval techniques observed in a set of live-electronics pieces, categorizing four compositional approaches: namely, mapping, triggering, scoring, and procedural paradigms of application of machine listening techniques in the context of live-electronics music compositions.
Palavras-chave:
Computer Music and Creative processes, Music Information Retrieval, Real-time Interactive Systems
Referências
Nick Collins. Automatic Composition of Electroacoustic Art Music Utilizing Machine Listening. Computer Music Journal, 36(3):8–23, September 2012.
Nick Collins. Machine Listening in SuperCollider. In The SuperCollider book. MIT Press, Cambridge, Mass, 2011.
Albert S. Bregman. Auditory Scene Analysis. The MIT Press, 1990. Publisher: The MIT Press.
István Winkler, Susan Denham, Robert Mill, Tamás M. Bőhm, and Alexandra Bendixen. Multistability in auditory stream segregation: a predictive coding view. Philosophical Transactions of the Royal Society B: Biological Sciences, 367(1591):1001–1012, April 2012.
Alexander Gutschalk and Andrew R. Dykstra. Functional imaging of auditory scene analysis. Hearing Research, 307:98–110, 2014. Place: Netherlands Publisher: Elsevier Science.
Robert Rowe. Interactive music systems: machine listening and composing. MIT press, Cambridge, 1993.
Joe Futrelle and J. Downie. Interdisciplinary Research Issues in Music Information Retrieval: ISMIR 2000. Journal of New Music Research, 32:121–131, June 2003.
Eduardo Reck Miranda and Marcelo Wanderley. New Digital Musical Instruments: Control And Interaction Beyond the Keyboard. A-R Editions, Inc., Middleton, Wis, 1st edition edition, July 2006.
Song Wang, Marcelo Wanderley, and Gary Scavone. The Study of Mapping Strategies Between the Excitators of the Single-Reed Woodwind and the Bowed String. In Proceedings of the 7th Conference on Sound and Music Technology (CSMT), pages 107–119. Springer, January 2020.
Adriano Claro Monteiro. Criação e performance musical no contexto dos instrumentos musicais digitais. PhD thesis, 2012. Accepted: 2018-08-20T07:47:37Z Publisher: [s.n.].
Gabriel Rimoldi. Metaflauta: uma abordagem ecológica aplicada ao design e processos criativos a partir de um instrumento expandido. PhD thesis, 2018. Accepted: 201809-04T18:43:32Z Publisher: [s.n.].
Andy Hunt, Yo Dd, Marcelo Wanderley, and Matthew Paradis. The Importance of Parameter Mapping in Electronic Instrument Design. Journal of New Music Research, 32, May 2002.
Fernando Iazzetta. Meaning in Musical Gesture. In Trends in Gestural Control of Music [CD-ROM], pages 259–268. IRCAM, January 2000.
Hélena Regius and Joakim Langer. Kung Kalle av Kurrekurreduttön. Fórum Bokförlaget, 2002.
Anna Einarsson. Singing the body electric - Understanding the role of embodiment in performing and composing interactive music. PhD thesis, Lund University Royal Collegeof Music Stockholm, October 2017.
Anders Friberg, Erwin Schoonderwaldt, and Patrik Juslin. CUEX: An Algorithm for Automatic Extraction of Expressive Tone Parameters in Music Performance from Acoustic Signals. Acta Acustica united with Acustica, 93:411–420, May 2007.
Anna Einarsson and Anders Friberg. Using Singing Voice Vibrato as a Control Parameter in a Chamber Opera. In 41st International Computer Music Conference, pages 18– 21, University of North Texas, September 2015.
Alain de Cheveigné and Hideki Kawahara. YIN, a fundamental frequency estimator for speech and music. The Journal of the Acoustical Society of America, 111(4):1917– 1930, April 2002.
Mark Johnson. The Body in the Mind: The Bodily Basis of Meaning, Imagination, and Reason. University of Chicago Press, 1ª edição edition, January 2013.
Mikhail Malt and Marta Gentilucci. Real Time Vowel Tremolo Detection Using Low Level Audio Descriptors. arXiv:1511.07008 [cs], November 2015. arXiv: 1511.07008.
Miller Puckette, Theodore Apel, and David Zicarelli. Realtime audio analysis tools for Pd and MSP. In Proceedings of International Computer Music Conference, São Francisco, October 1998.
Arshia Cont. Antescofo: Anticipatory Synchronization and control of Interactive parameters in Computer Music. In Proceedings of International Computer Music Conference, Belfast, 2008.
Philippe Manoury. La note et le son, 1990.
Andrew May. Philippe’s Manoury Jupiter. In Analytical Methods of Electroacoustic Music, pages 145–185. Routledge, December 2005. 196
Mikhail Malt. Khorwa: A musical experience with ’autonomous agents’. In ICMC, 2004.
José Miguel Fernandez, Jean-Louis Giavitto, and Pierre Donat-Bouillud. AntesCollider: Control and Signal Processing in the Same Score. June 2019.
José H. P. Velloso. Representação, intuição e contato na composição com algoritmos. Master’s thesis, Universidade Estadual de Campinas, Campinas, 2009.
Joel Chadabe. Interactive Composing: An Overview. Computer Music Journal, 8(1):22–27, 1984. Publisher: The MIT Press.
Philippe Manoury. Sur la synthèse 3F, 2020.
Nick Collins. Machine Listening in SuperCollider. In The SuperCollider book. MIT Press, Cambridge, Mass, 2011.
Albert S. Bregman. Auditory Scene Analysis. The MIT Press, 1990. Publisher: The MIT Press.
István Winkler, Susan Denham, Robert Mill, Tamás M. Bőhm, and Alexandra Bendixen. Multistability in auditory stream segregation: a predictive coding view. Philosophical Transactions of the Royal Society B: Biological Sciences, 367(1591):1001–1012, April 2012.
Alexander Gutschalk and Andrew R. Dykstra. Functional imaging of auditory scene analysis. Hearing Research, 307:98–110, 2014. Place: Netherlands Publisher: Elsevier Science.
Robert Rowe. Interactive music systems: machine listening and composing. MIT press, Cambridge, 1993.
Joe Futrelle and J. Downie. Interdisciplinary Research Issues in Music Information Retrieval: ISMIR 2000. Journal of New Music Research, 32:121–131, June 2003.
Eduardo Reck Miranda and Marcelo Wanderley. New Digital Musical Instruments: Control And Interaction Beyond the Keyboard. A-R Editions, Inc., Middleton, Wis, 1st edition edition, July 2006.
Song Wang, Marcelo Wanderley, and Gary Scavone. The Study of Mapping Strategies Between the Excitators of the Single-Reed Woodwind and the Bowed String. In Proceedings of the 7th Conference on Sound and Music Technology (CSMT), pages 107–119. Springer, January 2020.
Adriano Claro Monteiro. Criação e performance musical no contexto dos instrumentos musicais digitais. PhD thesis, 2012. Accepted: 2018-08-20T07:47:37Z Publisher: [s.n.].
Gabriel Rimoldi. Metaflauta: uma abordagem ecológica aplicada ao design e processos criativos a partir de um instrumento expandido. PhD thesis, 2018. Accepted: 201809-04T18:43:32Z Publisher: [s.n.].
Andy Hunt, Yo Dd, Marcelo Wanderley, and Matthew Paradis. The Importance of Parameter Mapping in Electronic Instrument Design. Journal of New Music Research, 32, May 2002.
Fernando Iazzetta. Meaning in Musical Gesture. In Trends in Gestural Control of Music [CD-ROM], pages 259–268. IRCAM, January 2000.
Hélena Regius and Joakim Langer. Kung Kalle av Kurrekurreduttön. Fórum Bokförlaget, 2002.
Anna Einarsson. Singing the body electric - Understanding the role of embodiment in performing and composing interactive music. PhD thesis, Lund University Royal Collegeof Music Stockholm, October 2017.
Anders Friberg, Erwin Schoonderwaldt, and Patrik Juslin. CUEX: An Algorithm for Automatic Extraction of Expressive Tone Parameters in Music Performance from Acoustic Signals. Acta Acustica united with Acustica, 93:411–420, May 2007.
Anna Einarsson and Anders Friberg. Using Singing Voice Vibrato as a Control Parameter in a Chamber Opera. In 41st International Computer Music Conference, pages 18– 21, University of North Texas, September 2015.
Alain de Cheveigné and Hideki Kawahara. YIN, a fundamental frequency estimator for speech and music. The Journal of the Acoustical Society of America, 111(4):1917– 1930, April 2002.
Mark Johnson. The Body in the Mind: The Bodily Basis of Meaning, Imagination, and Reason. University of Chicago Press, 1ª edição edition, January 2013.
Mikhail Malt and Marta Gentilucci. Real Time Vowel Tremolo Detection Using Low Level Audio Descriptors. arXiv:1511.07008 [cs], November 2015. arXiv: 1511.07008.
Miller Puckette, Theodore Apel, and David Zicarelli. Realtime audio analysis tools for Pd and MSP. In Proceedings of International Computer Music Conference, São Francisco, October 1998.
Arshia Cont. Antescofo: Anticipatory Synchronization and control of Interactive parameters in Computer Music. In Proceedings of International Computer Music Conference, Belfast, 2008.
Philippe Manoury. La note et le son, 1990.
Andrew May. Philippe’s Manoury Jupiter. In Analytical Methods of Electroacoustic Music, pages 145–185. Routledge, December 2005. 196
Mikhail Malt. Khorwa: A musical experience with ’autonomous agents’. In ICMC, 2004.
José Miguel Fernandez, Jean-Louis Giavitto, and Pierre Donat-Bouillud. AntesCollider: Control and Signal Processing in the Same Score. June 2019.
José H. P. Velloso. Representação, intuição e contato na composição com algoritmos. Master’s thesis, Universidade Estadual de Campinas, Campinas, 2009.
Joel Chadabe. Interactive Composing: An Overview. Computer Music Journal, 8(1):22–27, 1984. Publisher: The MIT Press.
Philippe Manoury. Sur la synthèse 3F, 2020.
Publicado
24/10/2021
Como Citar
OLIVEIRA, Vinicius César; PADOVANI, José Henrique.
Mapping, Triggering, Scoring, and Procedural Paradigms of Machine Listening Application in Live-Electronics Compositions. In: SIMPÓSIO BRASILEIRO DE COMPUTAÇÃO MUSICAL (SBCM), 18. , 2021, Recife.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2021
.
p. 189-196.
DOI: https://doi.org/10.5753/sbcm.2021.19445.
