Development of a metronome adapted for teaching music to people with hearing disabilities
Abstract
Teaching music to people with hearing impairments is a beneficial and challenging activity that can be developed using tools. The present work aims to develop a personalized musical education solution adapted for people who are deaf or hard of hearing in the form of a mobile application. By implementing a metronome and related functions, learners can learn musical aspects such as rhythm, tempo, and meter with synchronized visual, auditory, and vibrotactile feedback. The application will allow integration with wearable devices, such as smartwatches, and will be evaluated using the Technology Acceptance Model (TAM).
References
Araújo, R. P., & Medeiros, F. P. A. (2021, November). Processo Participativo de Engenharia de Requisitos para Construção de Tecnologias Educacionais: Versão Preliminar. In Anais Estendidos do XXXII Simpósio Brasileiro de Informática na Educação (pp. 01-07). SBC.
Hupke, R., Beyer, L., Nophut, M., Preihs, S., & Peissig, J. (2019, October). Effect of a global metronome on ensemble accuracy in networked music performance. In Audio Engineering Society Convention 147. Audio Engineering Society.
Ammirante, P., Patel, A. D., & Russo, F. A. (2016). Synchronizing to auditory and tactile metronomes: A test of the auditory-motor enhancement hypothesis. Psychonomic Bulletin & Review, 23, 1882–1890.
Schmitz, A., Holloway, C., & Cho, Y. (2020). Hearing through vibrations: Perception of musical emotions by profoundly deaf people. arXiv preprint arXiv:2012.13265.
Bragança, B., Ferreira, L. A. G., & Pontelo, I. (2013). Práticas educativas e ambientes de aprendizagem escolar: Relato de três experiências. In Anais do Seminário Nacional de Educação Profissional e Tecnológica (pp. 01-07). Belo Horizonte: SENEPT.
Brown, L. L. (2012). The benefits of music education. PBS Kids for Parents.
Burn, R., et al. (2016). Adapting the music experience for the deaf: A new approach through vibrotactile feedback. In Proceedings of the International Colloquium on Musical Informatics.
Cascella, M., & AL Khalili, Y. (2019). Short term memory impairment. In StatPearls [Internet]. Treasure Island, FL: StatPearls Publishing.
Chaves, J. M. (2023). Neuroplasticidade, memória e aprendizagem: Uma relação atemporal. Revista Psicopedagógica, 40(121), 01-10.
Dávila, G. M., & Porto, J. B. (2021). Violearn: Um Protótipo Para Ensino de Teoria e Prática Musical por Violão. In Anais do XXXII Simpósio Brasileiro de Informática na Educação (pp. 462-473). SBC.
Gorder, B. V. (2024). Teaching Deaf and Hard-of-Hearing Musicians: A Guide for Secondary Choral Music Educators.
Gan, L., Huang, Y., Zhou, L., Qian, C., & Wu, X. (2015). Synchronization to a bouncing ball with a realistic motion trajectory. Scientific Reports, 5, 11974.
Lima Filho, S. M. N. de, Medeiros, F. P. A., D’Andrea, A. F., & Sousa, R. L. de. (2024). VibraSound: A mobile application for immersive musical experience for the hearing impaired. In Anais do IBERIAN CONFERENCE ON INFORMATION SYSTEMS AND TECHNOLOGIES (pp. 01-06). IEEE.
McCarthy M., & Goble, J. S. (2011). Music education, philosophy of. In Grove Music Online. DOI: 10.1093/gmo/9781561592630.article.A2093412.
Gibson, J. (2000). Music and deafness: A review of research literature. Journal of Music Therapy, 37(3), 222-241.
Haguiara-Cervellini, N. (2003). A musicalidade do surdo: Representação e estigma. São Paulo: Plexus.
Hake, R., Bürgel, M., Nguyen, N. K., Greasley, A., Müllensiefen, D., & Siedenburg, K. (2023). Development of an adaptive test of musical scene analysis abilities for normal-hearing and hearing-impaired listeners. Behavior Research Methods, 1-26.
Holmes, J. A. (2017). Expert listening beyond the limits of hearing: Music and deafness. Journal of the American Musicological Society, 70(1), 171–220.
Hupke, R., Beyer, L., Nophut, M., Preihs, S., & Peissig, J. (2019). Effect of a global metronome on ensemble accuracy in networked music performance. In Audio Engineering Society Convention 147. Audio Engineering Society.
Arthur, P., Khuu, S., & Blom, D. (2016). A preliminary study: is the metronome harmful or helpful?. Australian Journal of Music Education, 50(2), 71-82.
Karam, M., et al. (1996). Designing vibrotactile feedback for music performance. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics. [link]
King, W. R., & He, J. (2006). A meta-analysis of the technology acceptance model. Information & Management, 43(6), 740-755.
Krug, D. L., Kulibaba, R. J., Linzmeyer, D. A., Mouza, C., & Shepherd, D. C. (2023, November). Inspiring interest in computing using music: A case study on students lacking prior music education. In Anais do XXXIV Simpósio Brasileiro de Informática na Educação (pp. 1612-1624). SBC.
Martinez, S. (1987). Music therapy for deaf children: Approaches and outcomes. Journal of Music Therapy, 24(2), 65-77. [link].
Marschall, M., et al. (2020). MusicAid: Towards a collaborative experience for deaf and hearing. In Aalborg University Publications. [link].
Murphy, E. (2021). Enhancing musical experiences for the deaf: An overview of current research. In SAGE Journals. [link].
Norman, D. A. (2013) "The Design of Everyday Things." Revised and expanded edition. Basic Books.
Oapen. (2020). Open access perspectives on music and deafness. In OAPEN Library. [link].
Porflitt, F. I., & Rosas-Díaz, R. R. (2019). Behind the scene: cognitive benefits of playing a musical instrument. Executive functions, processing speed, fluid intelligence and divided attention/Detrás de la escena: beneficios cognitivos de tocar un instrumento musical. Funciones ejecutivas, velocidad de procesamiento, inteligencia fluida y atención dividida. Studies in Psychology, 40(2), 464-490.
ProQuest. (2022). Adaptive metronomes in music education. ProQuest Dissertations Publishing. [link].
Shneiderman, B. and Plaisant, C. (2004) "Designing the User Interface: Strategies for Effective Human-Computer Interaction." 4th edition. Addison-Wesley.
Silva, R. A. (2020). Educação musical para surdos: Um estudo de caso. Revista Eixo. [link].
Silva, N. M., Alves, J. F., Castro, A. B. C., & Varela, J. H. S. (2020). Educação musical de surdos: Características, barreiras e práticas exitosas. Educação e Pesquisa, 46, e221995.
Vathagavorakul, R., Gonjo, T., & Homma, M. (2024). The influence of sound waves and musical experiences on movement coordination with beats. Human Movement Science, 93, 103170.
White, D. (1976). Visual and kinesthetic learning in music education for the deaf. Journal of Music Therapy, 13(3), 151-159. [link].
Hupke, R., Beyer, L., Nophut, M., Preihs, S., & Peissig, J. (2019, October). Effect of a global metronome on ensemble accuracy in networked music performance. In Audio Engineering Society Convention 147. Audio Engineering Society.
Ammirante, P., Patel, A. D., & Russo, F. A. (2016). Synchronizing to auditory and tactile metronomes: A test of the auditory-motor enhancement hypothesis. Psychonomic Bulletin & Review, 23, 1882–1890.
Schmitz, A., Holloway, C., & Cho, Y. (2020). Hearing through vibrations: Perception of musical emotions by profoundly deaf people. arXiv preprint arXiv:2012.13265.
Bragança, B., Ferreira, L. A. G., & Pontelo, I. (2013). Práticas educativas e ambientes de aprendizagem escolar: Relato de três experiências. In Anais do Seminário Nacional de Educação Profissional e Tecnológica (pp. 01-07). Belo Horizonte: SENEPT.
Brown, L. L. (2012). The benefits of music education. PBS Kids for Parents.
Burn, R., et al. (2016). Adapting the music experience for the deaf: A new approach through vibrotactile feedback. In Proceedings of the International Colloquium on Musical Informatics.
Cascella, M., & AL Khalili, Y. (2019). Short term memory impairment. In StatPearls [Internet]. Treasure Island, FL: StatPearls Publishing.
Chaves, J. M. (2023). Neuroplasticidade, memória e aprendizagem: Uma relação atemporal. Revista Psicopedagógica, 40(121), 01-10.
Dávila, G. M., & Porto, J. B. (2021). Violearn: Um Protótipo Para Ensino de Teoria e Prática Musical por Violão. In Anais do XXXII Simpósio Brasileiro de Informática na Educação (pp. 462-473). SBC.
Gorder, B. V. (2024). Teaching Deaf and Hard-of-Hearing Musicians: A Guide for Secondary Choral Music Educators.
Gan, L., Huang, Y., Zhou, L., Qian, C., & Wu, X. (2015). Synchronization to a bouncing ball with a realistic motion trajectory. Scientific Reports, 5, 11974.
Lima Filho, S. M. N. de, Medeiros, F. P. A., D’Andrea, A. F., & Sousa, R. L. de. (2024). VibraSound: A mobile application for immersive musical experience for the hearing impaired. In Anais do IBERIAN CONFERENCE ON INFORMATION SYSTEMS AND TECHNOLOGIES (pp. 01-06). IEEE.
McCarthy M., & Goble, J. S. (2011). Music education, philosophy of. In Grove Music Online. DOI: 10.1093/gmo/9781561592630.article.A2093412.
Gibson, J. (2000). Music and deafness: A review of research literature. Journal of Music Therapy, 37(3), 222-241.
Haguiara-Cervellini, N. (2003). A musicalidade do surdo: Representação e estigma. São Paulo: Plexus.
Hake, R., Bürgel, M., Nguyen, N. K., Greasley, A., Müllensiefen, D., & Siedenburg, K. (2023). Development of an adaptive test of musical scene analysis abilities for normal-hearing and hearing-impaired listeners. Behavior Research Methods, 1-26.
Holmes, J. A. (2017). Expert listening beyond the limits of hearing: Music and deafness. Journal of the American Musicological Society, 70(1), 171–220.
Hupke, R., Beyer, L., Nophut, M., Preihs, S., & Peissig, J. (2019). Effect of a global metronome on ensemble accuracy in networked music performance. In Audio Engineering Society Convention 147. Audio Engineering Society.
Arthur, P., Khuu, S., & Blom, D. (2016). A preliminary study: is the metronome harmful or helpful?. Australian Journal of Music Education, 50(2), 71-82.
Karam, M., et al. (1996). Designing vibrotactile feedback for music performance. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics. [link]
King, W. R., & He, J. (2006). A meta-analysis of the technology acceptance model. Information & Management, 43(6), 740-755.
Krug, D. L., Kulibaba, R. J., Linzmeyer, D. A., Mouza, C., & Shepherd, D. C. (2023, November). Inspiring interest in computing using music: A case study on students lacking prior music education. In Anais do XXXIV Simpósio Brasileiro de Informática na Educação (pp. 1612-1624). SBC.
Martinez, S. (1987). Music therapy for deaf children: Approaches and outcomes. Journal of Music Therapy, 24(2), 65-77. [link].
Marschall, M., et al. (2020). MusicAid: Towards a collaborative experience for deaf and hearing. In Aalborg University Publications. [link].
Murphy, E. (2021). Enhancing musical experiences for the deaf: An overview of current research. In SAGE Journals. [link].
Norman, D. A. (2013) "The Design of Everyday Things." Revised and expanded edition. Basic Books.
Oapen. (2020). Open access perspectives on music and deafness. In OAPEN Library. [link].
Porflitt, F. I., & Rosas-Díaz, R. R. (2019). Behind the scene: cognitive benefits of playing a musical instrument. Executive functions, processing speed, fluid intelligence and divided attention/Detrás de la escena: beneficios cognitivos de tocar un instrumento musical. Funciones ejecutivas, velocidad de procesamiento, inteligencia fluida y atención dividida. Studies in Psychology, 40(2), 464-490.
ProQuest. (2022). Adaptive metronomes in music education. ProQuest Dissertations Publishing. [link].
Shneiderman, B. and Plaisant, C. (2004) "Designing the User Interface: Strategies for Effective Human-Computer Interaction." 4th edition. Addison-Wesley.
Silva, R. A. (2020). Educação musical para surdos: Um estudo de caso. Revista Eixo. [link].
Silva, N. M., Alves, J. F., Castro, A. B. C., & Varela, J. H. S. (2020). Educação musical de surdos: Características, barreiras e práticas exitosas. Educação e Pesquisa, 46, e221995.
Vathagavorakul, R., Gonjo, T., & Homma, M. (2024). The influence of sound waves and musical experiences on movement coordination with beats. Human Movement Science, 93, 103170.
White, D. (1976). Visual and kinesthetic learning in music education for the deaf. Journal of Music Therapy, 13(3), 151-159. [link].
Published
2024-11-04
How to Cite
MERSON, Samuel; STEPHAN, Lauro; MEDEIROS, Francisco; D'ANDREA, Alexandre; SOUSA, Radamir.
Development of a metronome adapted for teaching music to people with hearing disabilities. In: WORKSHOP ON COMPUTATIONAL THINKING AND INCLUSION (WPCI), 3. , 2024, Rio de Janeiro/RJ.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2024
.
p. 1-11.
DOI: https://doi.org/10.5753/wpci.2024.245178.
