Multisensory Environments in Musical Education for Deaf Students: A Design-Based Research Approach

• Cristiano da Silva Benites Inteli / UPM
• Guilherme Henrique de Oliveira Cestari Inteli / UPM
• Ismar Frango Silveira UPM

DOI: https://doi.org/10.5753/wie.2025.11730

Abstract

This study investigates the use of a multisensory computational system in the musical education of deaf children, incorporating tactile, visual, and gestural stimuli. Grounded in Design-Based Research, the study involved seven children who use LIBRAS (Língua Brasileira de Sinais) across three experimental cycles. The system integrated motion sensors, vibrotactile feedback, and visual projections. Data were collected through interviews, reflective journals, and gestural heatmaps. Thematic analysis indicated high levels of spontaneous engagement (86%), gestural authorship (71%), and collaborative interaction (78%). The findings suggest that multisensory environments enhance rhythmic awareness, foster creative authorship, and support inclusive musical practices centered on corporeality.

References

Barab, S., & Squire, K. (2004). Design-based research: Putting a stake in the ground. The Journal of the Learning Sciences, 13(1), 1–14.

Borgo, D. (2019). Music, embodiment, and the politics of affect. In: Cobussen, M., Meelberg, V., & Truax, B. (Eds.). The Routledge Companion to Sounding Art. Routledge.

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101.

Camurri, A., Mazzarino, B., Ricchetti, M., Timmers, R., & Volpe, G. (2017). Multimodal analysis of expressive gesture in music and dance performances. In: Camurri, A., & Volpe, G. (Eds.). Gesture-Based Communication in Human-Computer Interaction. Springer.

Csikszentmihalyi, M. (1996). Creativity: Flow and the Psychology of Discovery and Invention. Harper Perennial.

Dillon, T. (2016). Music, technology, and education: Critical perspectives. Routledge.

Finck, Regina. (2009). Ensinando música ao aluno surdo: Perspectivas para a ação pedagógica inclusiva. Tese (Doutorado em Educação). Universidade Federal do Rio Grande do Sul.

Godøy, R. I. (2010). Musical gestures: Sound, movement, and meaning. Routledge.

Griebeler, C. M. (2015). Educação musical e surdez: Cenas inclusivas. Dissertação (Mestrado em Música). Universidade Federal do Rio Grande do Sul.

Haguiara-Cervellini, N. (2003). A musicalidade do surdo: Representação e estigma. Plexus.

Himonides, E. (2012). The misunderstood role of digital technology in music education. British Journal of Music Education, 29(3), 343–356.

Knight, A., & Swanwick, K. (2021). Musical development and learning: The international perspective. In: The Oxford Handbook of Music Education. Oxford University Press.

Kitson, A., & Davies, M. (2007). Developing accessible music education: The use of vibrotactile feedback for the deaf. International Journal of Inclusive Education, 11(3), 285–300.

Kuntze, V. (2014). A relação do surdo com a música: representações sociais. Dissertação (Mestrado em Música). Universidade do Estado de Santa Catarina.

Leman, M. (2007). Embodied Music Cognition and Mediation Technology. MIT Press.

Lewis, D., & Chong, P. (2020). Reimagining music education for deaf and hard of hearing students. Journal of Research in Music Education, 68(2), 143–161.

Maes, P. J., Leman, M., Palmer, C., & Wanderley, M. M. (2014). Action-based effects on music perception. Frontiers in Psychology, 4, 1008.

Marshall, N., & Himonides, E. (2012). Music technology and special educational needs: A literature review. British Journal of Music Education, 29(3), 315–330.

Monelle, R. (2000). The Sense of Music: Semiotic Essays. Princeton University Press.

Nijs, L., & Leman, M. (2014). Interactive technologies in the instrumental music classroom: A longitudinal study with the Music Paint Machine. Computers & Education, 73, 40–59.

Pereira, J. M. et al. (2025) Linguagem musical como estratégia didática para alunos surdos. Cognitionis, 8(1), 1–17.

Rodrigues, M. A. (2022). Pedagogias sensoriais e tecnologias inclusivas: Perspectivas contemporâneas. Revista Brasileira de Educação Especial, 28, 123–140.

Rose, D. H., & Dalton, B. (2009). Learning to read in the digital age. Mind, Brain, and Education, 3(2), 74–83.

Rose, D. H., & Meyer, A. (2002). Teaching every student in the digital age: Universal design for learning. ASCD.

Tarasti, E. (2012). Signs of music: A guide to musical semiotics. Mouton de Gruyter.

van der Schyff, D., Schiavio, A., & Elliott, D. J. (2016). Critical ontology for an enactive music pedagogy. Action, Criticism, and Theory for Music Education, 15(5), 81–121.

Vincs, K. (2010). Rhythmic movement and the dancer's experience: Multisensory awareness and its implications for pedagogy. Research in Dance Education, 11(2), 133–147.