Concatenative Synthesis for Brazilian Sign Language
Resumo
This paper presents an enhanced concatenative synthesis framework for Brazilian Sign Language (Libras) based on motion-capture (MoCap) data. The proposed method extends previous work by incorporating movement dynamics into the unit-selection process, allowing fragment selection to consider both pose similarity and velocity continuity. In addition, a quaternion-based transition smoothing mechanism is introduced to reduce discontinuities between independently recorded sign segments. The framework also employs a compact quaternion-only motion representation and a web-native architecture for real-time synthesis and visualization.
Referências
Hunt, A. and Black, A. (1996). Unit selection in a concatenative speech synthesis system using a large speech database. In 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings, volume 1, pages 373–376 vol. 1.
Martino, J. M. D. and Poeta, E. T. (2021). Método para a síntese concatenativa de línguas de sinais para a geração de avatares sinalizadores tridimensionais realistas. Patente Depósito: BR 10 2019 028311-4; Publicação: BR102019028311A2.
Max Planck Institute for Psycholinguistics (2025). Elan (version 7.1) [computer software]. Accessed: 2026-06-04.
Naert, L., Larboulette, C., and Gibet, S. (2017). Coarticulation analysis for sign language synthesis. In Universal Access in Human-Computer Interaction. Designing Novel Interaction Experiences, volume 10278 of Lecture Notes in Computer Science, pages 55–73. Springer, Cham.
Poeta, E. (2025). Síntese concatenativa de línguas sinais. Msc thesis, Universidade Estadual de Campinas(UNICAMP).
Schwarz, D. (2005). Current research in concatenative sound synthesis. In Proceedings of the International Computer Music Conference (ICMC), pages 1–4, Barcelona, Spain. International Computer Music Association.
Shoemake, K. (1985). Animating rotation with quaternion curves. In Proceedings of the 12th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’85), pages 245–254. ACM.
Song, D., Wang, X., and Xu, X. (2012). Chinese sign language synthesis system on mobile device. Procedia Engineering, 29:986–992.
Martino, J. M. D. and Poeta, E. T. (2021). Método para a síntese concatenativa de línguas de sinais para a geração de avatares sinalizadores tridimensionais realistas. Patente Depósito: BR 10 2019 028311-4; Publicação: BR102019028311A2.
Max Planck Institute for Psycholinguistics (2025). Elan (version 7.1) [computer software]. Accessed: 2026-06-04.
Naert, L., Larboulette, C., and Gibet, S. (2017). Coarticulation analysis for sign language synthesis. In Universal Access in Human-Computer Interaction. Designing Novel Interaction Experiences, volume 10278 of Lecture Notes in Computer Science, pages 55–73. Springer, Cham.
Poeta, E. (2025). Síntese concatenativa de línguas sinais. Msc thesis, Universidade Estadual de Campinas(UNICAMP).
Schwarz, D. (2005). Current research in concatenative sound synthesis. In Proceedings of the International Computer Music Conference (ICMC), pages 1–4, Barcelona, Spain. International Computer Music Association.
Shoemake, K. (1985). Animating rotation with quaternion curves. In Proceedings of the 12th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’85), pages 245–254. ACM.
Song, D., Wang, X., and Xu, X. (2012). Chinese sign language synthesis system on mobile device. Procedia Engineering, 29:986–992.
Publicado
19/10/2026
Como Citar
SILVA, Gustavo Borba da; BENETTI, Ângelo Brandão; MARTINO, José Mario De.
Concatenative Synthesis for Brazilian Sign Language. In: SIMPÓSIO BRASILEIRO DE TECNOLOGIA DA INFORMAÇÃO E DA LINGUAGEM HUMANA (STIL), 17. , 2026, Cuiabá/MT.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2026
.
p. 621-625.
DOI: https://doi.org/10.5753/stil.2026.29829.
