ABSTRACT
Deaf people communicate naturally through visual-gesture languages, called sign languages (LS). As a result, they have a great deal of difficulty absorbing oral content, either in written or spoken form, even in the oral language (LO) of their native country. In addition, if it is already difficult to a deaf to access information in the oral language of your country, obstacles to accessing information in foreign languages become almost insurmountable, reducing the level of access to information. Among the approaches to the problem, one of the most promising ones involves the use of automatic translators to translate written or spoken content into sign language through an avatar. However, the vast majority of these machine translation platforms are focused on translating a single oral language into a single associated sign language. In order to expand the range of oral languages that Brazilian deaf people could have access to, this article investigates the use of "text-to-text" machine translation mechanisms before the "text-to-gloss" machine translation. The idea is to evaluate the offer of a service for automatic translation of digital content (text, audio or video, for example) in any oral language for the Brazilian Language of Signals (LIBRAS). As a way of validating the proposal a prototype based on the Suite VLibras was constructed. A series of computational and user evaluations were carried out to verify if the proposed flow of chained translations allows the suitable understanding of the content in foreign languages.
- Tiago Maritan Ugulino de Araújo. 2012. Uma solucção para geracção automática de trilhas em Língua Brasileira de Sinais em conteúdos multimídia. Ph.D. Dissertation. Universidade Federal do Rio Grande do Norte, Natal.Google Scholar
- Rachel Colacique Gomes. 2011. E-acessibilidade para surdos. Revista Brasileira de Traducção Visual 7, 7 (2011).Google Scholar
- Tiago Maritan U De Araújo, Felipe LS Ferreira, et al. 2014. An approach to generate and embed sign language video tracks into multimedia contents. Information Sciences 281 (2014), 762--780.Google ScholarDigital Library
- T. M. U. de Araújo, F. L. S. Ferreira, D. A. N. dos S. Silva, L. D. Oliveira, E. L. Falcão, L. A. Domingues, V. F. Martins, I. A. C. Portela, Y. S. Nßbrega, G. L. de Souza Filho Lima, T. A. Tavares, and A. N. Duarte. 2014. An approach to generate and embed sign language video tracks into multimedia contents. Information Sciences 281 (Outubro 2014), 762--780. Google ScholarDigital Library
- Maria Cecília Rafael de Gßes. 2002. Linguagem, surdez e educacção. Autores Associados.Google Scholar
- P. Jordan Dorr, B. and J. Benoite. 1999. A survey of current paradigms in machine translation. Advances In Computers, 49, 1--68 (1999).Google ScholarCross Ref
- Instituto ICTS e CTS Ltda. [n. d.]. Rybená Web. http://www.rybena.com.br/site-rybena/conheca-o-rybena/web. ([n. d.]). Accessed 25-Jun-2016.Google Scholar
- Roy T. Fielding and Richard N. Taylor. 2002. Principled Design of the Modern Web Architecture. ACM Trans. Internet Technol. 2, 2 (May 2002), 115--150. https://doi.org/10.1145/514183.514185 Google ScholarDigital Library
- C. Freitas, P. Rocha, and E. Bick. 2008. Floresta sintá(c)tica: bigger, thicker and easier. In Proceedings of the 8th international conference on Computational Processing of the Portuguese Language, PROPOR'08. Aveiro, Portugal, 216--219. Google ScholarDigital Library
- Sang-Woon Kim, Zhe-Xue Li, and Y. Aoki. 2004. On intelligent avatar communication using Korean, Chinese and Japanese sign-languages: an overview. In ICARCV 2004 8th Control, Automation, Robotics and Vision Conference, 2004., Vol. 1. 747--752 Vol. 1. https://doi.org/10.1109/ICARCV.2004.1468921Google Scholar
- M. A.C.B. Lima, T. M.U. Araújo, and E. S. Oliveira. 2015. Incorporation of Syntactic-Semantic Aspects in a LIBRAS Machine Translation Service to Multimedia Platforms. In Proceedings of the 21st Brazilian Symposium on Multimedia and the Web, Webmedia 2015. 133--140. Google ScholarDigital Library
- ProDeaf Tecnologias Assistivas LTDA. 2010. ProDeaf. http://prodeaf.net/O.eE/. (2010). Accessed 25-Jun-2016.Google Scholar
- F. R. Melo, H. C. O. Matos, and E. R. B. Dias. 2014. Aplicacção da Métrica BLEU para Avaliacção Comparativa dos Tradutores Automáticos Bing Tradutor e Google Tradutor. E-scrita 5, 3 (2014), 33--45.Google Scholar
- S. Morrissey and A. Way. 2013. Manual labour: tackling machine translation for sign languages. Machine Translation 27, 1 (Marc¸o 2013), 25--64.Google ScholarDigital Library
- K. Papineni, S. Roukos, T. Ward, and W. Zhu. 2001. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics. 311--318. Google ScholarDigital Library
- Stuart Russell and Peter Norvig. 2003. Inteligência Artificial: uma abordagem moderna. Ed. Campus, 2a Edicção. São Paulo, Brazil (2003).Google Scholar
- R. San-segundo, R. Barra, et al. 2008. Speech to sign language translation system for spanish. Speech Communication 50, 11 (2008), 1009--1020. Google ScholarDigital Library
- Charles Schafer and David Smith. 2006. An Overview of Statistical Machine Translation. http://homedirs.ccs.neu.edu/dasmith/smt-tutorial.pdf. (2006). Accessed 01-April-2017.Google Scholar
- Stephen Shankland. 2009. Google Translate now serves 200 million people daily. https://www.cnet.com/news/ google-translate-now-serves-200-million-people-daily/. (2009). Accessed 10-Fev-2017.Google Scholar
- H. Y. Su and A. H.Wu. 2009. Improving structural statistical machine translation for sign language with small corpus using thematic role templates as translation memory. In IEEE Transactions on Machine Translation, Audio, Speech, and Language Processing. 1305--1315.Google Scholar
- H. Y. Su and C. H. Wu. 2009. Improving Structural Statistical Machine Translation for Sign Language with Small Corpus Using .ematic Role Templates As Translation Memory. Trans. Audio, Speech and Lang. Proc. 17, 7 (Sept. 2009), 1305--1315. https://doi.org/10.1109/TASL.2009.2016234Google Scholar
- Hand Talk. 2012. Hand Talk. http://www.handtalk.me/. (2012). Accessed 25-Jun-2016.Google Scholar
Index Terms
AnyLanguage-To-LIBRAS: Evaluation of an Machine Translation Service of Any Oralized Language for the Brazilian Sign Language
Recommendations
Incorporation of Syntactic-Semantic Aspects in a LIBRAS Machine Translation Service to Multimedia Platforms
WebMedia '15: Proceedings of the 21st Brazilian Symposium on Multimedia and the WebIn scientific literature, there are some solutions that address the machine automatic of sign language contents. These solutions aim to reduce the communication and access to information barriers of deaf people in Information and Communication ...
A Flexible Architecture for Building Ruled-Based Text-to-Gloss Machine Translators: Extended Abstract
WebMedia '17: Proceedings of the 23rd Brazillian Symposium on Multimedia and the WebDeaf people face a number of difficulties in accessing information, primarily in dynamic, high-volume environments such as the Web. One of the major obstacles is due to the fact that this information is available almost entirely in the oral language ...
A study on the use of sequence-to-sequence neural networks for automatic translation of brazilian portuguese to LIBRAS
WebMedia '19: Proceedings of the 25th Brazillian Symposium on Multimedia and the WebThe World Health Organization estimates that approximately 466 million people have some level of hearing loss. This significant portion of the world population faces several challenges in accessing information. The main problem is that the languages in ...
Comments