A computer-based framework to analyze continuous and discontinuous textural works using psychoacoustics audio descriptors
Resumo
This paper discusses a computer-aided musical analysis methodology anchored on psychoacoustics audio descriptors. The musicological aim is to analyze compositions centered on timbre manipulations that explore sound masses and granular synthesis as their builders. Our approach utilizes two psychoacoustics models: 1) Critical Bandwidths and 2) Loudness, and two spectral features extractors: 1) Centroid and 2) Spectral Spread. A review of the literature, contextualizing the state-of-art of audio descriptors, is followed by a definition of the musicological context guiding our analysis and discussions. Further, we present results on a comparative analysis of two acousmatic pieces: Schall (1995) of Horacio Vaggione and Asperezas (2018) of Micael Antunes. As electroacoustic works, there are no scores, therefore, segmentation and the subsequent musical analysis is an important issue to be solved. Consequently, the article ends discussing the methodological implication of the computational musicology addressed here.
Palavras-chave:
Music Analysis and Synthesis, Music Information Retrieval, Music Perception, Psychoacoustics and Cognition
Referências
Rowe, R. Interactive music systems: machine listening and composing. MIT Press, 1992.
Bregman, A. S. Auditory scene analysis: The perceptual organization of sound. MIT Press, 1994.
Herrera, P. MIRages: an account of music audio extractors, semantic description and context-awareness, in the three ages of MIR. PhD Thesis, Information and Communication Technologies, Universitat Pompeu Fabra. Barcelona, 2018.
Peeters, G. A Large Set of Audio Features for Sound Description (Similarity and Classification) in the CUIDADO Project (Cuidado Project Report). Paris: Ircam, 2004.
Pereira, E. Estudos sobre uma ferramenta de classificação musical. Dissertação de Mestrado. Faculdade de Energia Elétrica e de Computação da Universidade Estadual de Campinas, 2009. Campinas: UNICAMP, 2009.
Peeters, G. et al. The Timbre Toolbox: Extracting audio descriptors from musical signals. Journal of the Acoustic Society of America, Melville, v. 130, n. 5, p. 2902-2916, November 2011.
Malt, M; JOURDAN, Emmanuel. Z. Descriptors: A Library for Real-Time Descriptors Analysis. In: SOUND AND MUSIC COMPUTING CONFERENCE, 5, 2008, Berlin. Proceedings... Berlin: Sound and Music Computing, 2008.
Malt, M; Jourdan, Emmanuel. Z. Real-Time Uses of Low Level Sound Descriptors as Event Detection Functions Using the Max/MSP Zsa.Descriptors Library. 10 In: BRAZILIAN SYMPOSIUM ON COMPUTER MUSIC, 12., 2009, Recife. Proceedings... São Paulo: USP, SBC, 2009, p. 45-56.
Rossetti, D.; Manzolli, J. De Montserrat às ressonâncias do piano: uma análise com descritores de áudio. Opus, 23(3), 193-221. 2017.
Monteiro, A. Criação e performance musical no contexto dos instrumentos musicais digitais. Dissertação de Mestrado. Instituto de Artes da Universidade Estadual de Campinas, 2012. Campinas: UNICAMP, 2012.
Simurra, Ivan; Manzolli, Jônatas. Sound Shizuku Composition: A Computer-Aided Composition System for Extended Music Techniques. MusMat Brazilian Journal of Music and Mathematics, v. 1, n. 1, p. 86-101, 2016.
Simurra, Ivan; Manzolli, Jônatas. “O azeite, a lua e o rio”: o segundo diário de bordo de uma composição a partir de descritores de áudio. Revista Música Hodie, Goias, v. 16, n. 1, p. 121-123, 2016.
Malt, M; Jourdan, E. Le “BSTD”–Une représentation graphique de la brillance et de l’écart type spectral, comme possible représentation de l’évolution du timbre sonore. In: L`ANALYSE MUSICALE AUJOURD`HUI, CRISE OU (R)ÉVOLUTION, 2009, Strasbourg. Proceedings... Strasbourg: STAM, 2009.
Bullock, J. Libxtract: a lightweight library for audio feature extraction; Proceedings of the 2007 ICMC; ICMA, Sweden, 2007.
Rossetti, D. Temporalidades, morfologias e granulações em Schall de Horacio Vaggione. Proceedings of the IV Encontro Internacional de Teoria e Análise Musical, Eitam 2017, São Paulo, SP, 2017.
Rossetti, D; Manzolli, J. Timbre emergente na música eletroacústica: Uma análise com o aporte gráfico do volume e da vivacidade espectral. Proceedings of the XXVIII Encontro da Sociedade Brasileira de Acústica. Porto Alegre, Unisinos, 2018.
Rossetti, D; Manzolli, J. Analysis of Granular Acousmatic Music: Representation of Sound Flux and Emergence. Organised Sound v. 24, n. 2, p. 1-12, 2019.
Silva, M. A., Botechia, T., Rossetti, D. Manzolli, J. Análise musical por descritores de áudio baseados em modelos psicoacústicos. Anais do Simpósio Internacional de Cognição e Artes Musicais 14. Campo Grande, MS, 2019. in press.
Parncutt, R. Harmony: A psychoacoustical approach. Vol. 19. Springer Science & Business Media, 2012.
Sethares, W. A. Tuning, timbre, spectrum, scale. Berlin: Springer Science & Business Media, 1998.
Vassilakis, P. N.; Fitz, K. SRA: A web-based research tool for spectral and roughness analysis of sound signals. In: Proceedings of the 4th Sound and Music Computing (SMC) Conference, 2007. p. 319-325.
Zwicker, E. Subdivision of the audible frequency range into critical bands (Frequenzgruppen). The Journal of the Acoustical Society of America, v.33, n.2, p.248-248, 17th Brazilian Symposium on Computer Music - SBCM 20191961.
Mackay, J. On the perception of density and stratification in granular sonic textures: An exploratory study. Journal of New Music Research, v. 13, n. 4, p. 171- 186, 1984.
Ferraz, S. Análise e Percepção Textural: Peça VII, de 10 Peças para de Gyorgy Ligeti. Cadernos de Estudo: Análise Musical, vol. 3. São Paulo, pág. 68-79, 1990.
Berry, W. Structural functions in music. Chelmsford: Courier Corporation, 1987.
Cambouropoulos, E. Tsougras, C. Auditory Streams in Ligeti's Continuum: A Theoretical and Perceptual Approach. Journal of interdisciplinary music studies, v. 3, n. 1-2, p. 119-137, 2009.
Smalley, D. Spectromorphology: explaining sound- shapes. Organised sound, Cambridge, v. 2, n. 2, p. 107- 126, 1997.
Stockhausen, K. Pontos e grupos. Im: Maconie, Robin. Stockhausen sobre a música: palestras e entrevistas compiladas por Robin Maconie. Tradução de Saulo Alencastre. São Paulo: Madras, 2009, pág. 45-50.
Ligeti, G. Neuf essais sur la musique. Genebra: Éditions Contrechamps, 2010. 17th Brazilian Symposium on Computer Music - SBCM 2019
Xenakis, I. Concerning time. Perspectives of New Music, Seattle, v. 27, n. 1, p. 84-92, 1989.
Roads, C. Microsound. MIT Press. Massachusetts. 2001.
Solomos, M. 2013. De la musique au son: l’émergence du son dans la musique des XXe-XXIe siècles. Rennes: Presses Universitaires de Rennes.
Truax, B. Musical Creativity and Complexity at the Threshold of the 21st Century. Interface v. 21, p. 29-42, 1992.
ISO, B. 226: 2003: Acoustics–Normal equal- loudness-level contours. International Organization for Standardization, v. 63, 2003.
Traunmüller, H. “Analytical expressions for the tonotopic sensory scale”, in The Journal of the Acoustical Society of America 88.1, 1990.
SILVA, M. A. Redução da Dissonância Sensorial em uma Escala Temperada Utilizando Timbres Inarmônicos: Uma Abordagem Experimental e Aplicações Artísticas. Master Dissertation, 2018. 96 p. Music post-graduation program- School of Arts and Communications, São Paulo University, São Paulo, 2018.
Bregman, A. S. Auditory scene analysis: The perceptual organization of sound. MIT Press, 1994.
Herrera, P. MIRages: an account of music audio extractors, semantic description and context-awareness, in the three ages of MIR. PhD Thesis, Information and Communication Technologies, Universitat Pompeu Fabra. Barcelona, 2018.
Peeters, G. A Large Set of Audio Features for Sound Description (Similarity and Classification) in the CUIDADO Project (Cuidado Project Report). Paris: Ircam, 2004.
Pereira, E. Estudos sobre uma ferramenta de classificação musical. Dissertação de Mestrado. Faculdade de Energia Elétrica e de Computação da Universidade Estadual de Campinas, 2009. Campinas: UNICAMP, 2009.
Peeters, G. et al. The Timbre Toolbox: Extracting audio descriptors from musical signals. Journal of the Acoustic Society of America, Melville, v. 130, n. 5, p. 2902-2916, November 2011.
Malt, M; JOURDAN, Emmanuel. Z. Descriptors: A Library for Real-Time Descriptors Analysis. In: SOUND AND MUSIC COMPUTING CONFERENCE, 5, 2008, Berlin. Proceedings... Berlin: Sound and Music Computing, 2008.
Malt, M; Jourdan, Emmanuel. Z. Real-Time Uses of Low Level Sound Descriptors as Event Detection Functions Using the Max/MSP Zsa.Descriptors Library. 10 In: BRAZILIAN SYMPOSIUM ON COMPUTER MUSIC, 12., 2009, Recife. Proceedings... São Paulo: USP, SBC, 2009, p. 45-56.
Rossetti, D.; Manzolli, J. De Montserrat às ressonâncias do piano: uma análise com descritores de áudio. Opus, 23(3), 193-221. 2017.
Monteiro, A. Criação e performance musical no contexto dos instrumentos musicais digitais. Dissertação de Mestrado. Instituto de Artes da Universidade Estadual de Campinas, 2012. Campinas: UNICAMP, 2012.
Simurra, Ivan; Manzolli, Jônatas. Sound Shizuku Composition: A Computer-Aided Composition System for Extended Music Techniques. MusMat Brazilian Journal of Music and Mathematics, v. 1, n. 1, p. 86-101, 2016.
Simurra, Ivan; Manzolli, Jônatas. “O azeite, a lua e o rio”: o segundo diário de bordo de uma composição a partir de descritores de áudio. Revista Música Hodie, Goias, v. 16, n. 1, p. 121-123, 2016.
Malt, M; Jourdan, E. Le “BSTD”–Une représentation graphique de la brillance et de l’écart type spectral, comme possible représentation de l’évolution du timbre sonore. In: L`ANALYSE MUSICALE AUJOURD`HUI, CRISE OU (R)ÉVOLUTION, 2009, Strasbourg. Proceedings... Strasbourg: STAM, 2009.
Bullock, J. Libxtract: a lightweight library for audio feature extraction; Proceedings of the 2007 ICMC; ICMA, Sweden, 2007.
Rossetti, D. Temporalidades, morfologias e granulações em Schall de Horacio Vaggione. Proceedings of the IV Encontro Internacional de Teoria e Análise Musical, Eitam 2017, São Paulo, SP, 2017.
Rossetti, D; Manzolli, J. Timbre emergente na música eletroacústica: Uma análise com o aporte gráfico do volume e da vivacidade espectral. Proceedings of the XXVIII Encontro da Sociedade Brasileira de Acústica. Porto Alegre, Unisinos, 2018.
Rossetti, D; Manzolli, J. Analysis of Granular Acousmatic Music: Representation of Sound Flux and Emergence. Organised Sound v. 24, n. 2, p. 1-12, 2019.
Silva, M. A., Botechia, T., Rossetti, D. Manzolli, J. Análise musical por descritores de áudio baseados em modelos psicoacústicos. Anais do Simpósio Internacional de Cognição e Artes Musicais 14. Campo Grande, MS, 2019. in press.
Parncutt, R. Harmony: A psychoacoustical approach. Vol. 19. Springer Science & Business Media, 2012.
Sethares, W. A. Tuning, timbre, spectrum, scale. Berlin: Springer Science & Business Media, 1998.
Vassilakis, P. N.; Fitz, K. SRA: A web-based research tool for spectral and roughness analysis of sound signals. In: Proceedings of the 4th Sound and Music Computing (SMC) Conference, 2007. p. 319-325.
Zwicker, E. Subdivision of the audible frequency range into critical bands (Frequenzgruppen). The Journal of the Acoustical Society of America, v.33, n.2, p.248-248, 17th Brazilian Symposium on Computer Music - SBCM 20191961.
Mackay, J. On the perception of density and stratification in granular sonic textures: An exploratory study. Journal of New Music Research, v. 13, n. 4, p. 171- 186, 1984.
Ferraz, S. Análise e Percepção Textural: Peça VII, de 10 Peças para de Gyorgy Ligeti. Cadernos de Estudo: Análise Musical, vol. 3. São Paulo, pág. 68-79, 1990.
Berry, W. Structural functions in music. Chelmsford: Courier Corporation, 1987.
Cambouropoulos, E. Tsougras, C. Auditory Streams in Ligeti's Continuum: A Theoretical and Perceptual Approach. Journal of interdisciplinary music studies, v. 3, n. 1-2, p. 119-137, 2009.
Smalley, D. Spectromorphology: explaining sound- shapes. Organised sound, Cambridge, v. 2, n. 2, p. 107- 126, 1997.
Stockhausen, K. Pontos e grupos. Im: Maconie, Robin. Stockhausen sobre a música: palestras e entrevistas compiladas por Robin Maconie. Tradução de Saulo Alencastre. São Paulo: Madras, 2009, pág. 45-50.
Ligeti, G. Neuf essais sur la musique. Genebra: Éditions Contrechamps, 2010. 17th Brazilian Symposium on Computer Music - SBCM 2019
Xenakis, I. Concerning time. Perspectives of New Music, Seattle, v. 27, n. 1, p. 84-92, 1989.
Roads, C. Microsound. MIT Press. Massachusetts. 2001.
Solomos, M. 2013. De la musique au son: l’émergence du son dans la musique des XXe-XXIe siècles. Rennes: Presses Universitaires de Rennes.
Truax, B. Musical Creativity and Complexity at the Threshold of the 21st Century. Interface v. 21, p. 29-42, 1992.
ISO, B. 226: 2003: Acoustics–Normal equal- loudness-level contours. International Organization for Standardization, v. 63, 2003.
Traunmüller, H. “Analytical expressions for the tonotopic sensory scale”, in The Journal of the Acoustical Society of America 88.1, 1990.
SILVA, M. A. Redução da Dissonância Sensorial em uma Escala Temperada Utilizando Timbres Inarmônicos: Uma Abordagem Experimental e Aplicações Artísticas. Master Dissertation, 2018. 96 p. Music post-graduation program- School of Arts and Communications, São Paulo University, São Paulo, 2018.
Publicado
25/09/2019
Como Citar
ANTUNES, Micael; ROSSETTI, Danilo; MANZOLLI, Jonatas.
A computer-based framework to analyze continuous and discontinuous textural works using psychoacoustics audio descriptors. In: SIMPÓSIO BRASILEIRO DE COMPUTAÇÃO MUSICAL (SBCM), 17. , 2019, São João del-Rei.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2019
.
p. 4-11.
DOI: https://doi.org/10.5753/sbcm.2019.10415.
