Manuella A.C.B. Lima
ABSTRACT
In scientific literature, there are some solutions that address the machine automatic of sign language contents. These solutions aim to reduce the communication and access to information barriers of deaf people in Information and Communication Technologies (ICTs). However, the most of these solutions do not explore syntactic and semantic aspects in the machine translation process, especially when they are designed to be general area. As a result, there is a limitation on the quality of the accessible generated contents, and a consequent resistance of deaf users for using these solutions. To reduce this problem, in this paper, we propose a solution that incorporates syntactic and semantic aspects in the translation of VLibras, a service of machine generation of Brazilian Sign Language (LIBRAS) content in for ICT (Digital TV, Web, Digital Cinema and mobile devices). This solution involves a formal rule description language modeled to create translation rules; the definition of a grammar exploiting these features; and their integration with the VLibras service. To evaluate the solution, some computational tests were performed using WER and BLEU metrics to assess the quality of the output generated by the solution. The results show that the proposed approach could improve the results of the current version of VLibras translator.
- L. F. Alencar. Aelius: uma ferramenta para anotação automática de corpora usando o nltk. In IX Encontro de Linguística de Corpus, pages 216--219, Outubro 2010.Google Scholar
- M. Boulares and M. Jemni. Toward a mobile service for hard of hearing people to make information accessible anywhere. In International Conference on Electrical Engineering and Software Applications (ICEESA), pages 1--5, Março 2013.Google ScholarCross Ref
- L. F. Brito. Por uma gramática de língua de sinais. Editora Tempo Brasileiro, Rio de Janeiro, Brasil, 1995.Google Scholar
- W. C. O. Costa. O texto traduzido como re-textualização. Cadernos de Tradução, 2(16):25--54, 2005.Google Scholar
- L. F. de Alencar. Utilização de informações lexicais extraídas automaticamente de corpora na análise sintática computacional do português. Acta Tecnológica, 19(1):7--85, 2011.Google Scholar
- T. M. U. de Araújo, F. L. S. Ferreira, D. A. N. dos S. Silva, F. H. Lemos, G. P. Neto, D. Omaia, G. L. de Souza Filho, and T. A. Tavares. Automatic generation of brazilian sign language windows for digital tv systems. Journal of the Brazilian Computer Society, 19(2):107--125, Junho 2013.Google ScholarCross Ref
- T. M. U. de Araújo, F. L. S. Ferreira, D. A. N. dos S. Silva, L. D. Oliveira, E. L. Falcão, L. A. Domingues, V. F. Martins, I. A. C. Portela, Y. S. Nóbrega, G. L. de Souza Filho Lima, T. A. Tavares, and A. N. Duarte. An approach to generate and embed sign language video tracks into multimedia contents. Information Sciences, 281:762--780, Outubro 2014. Google ScholarDigital Library
- F. R. de Melo, H. C. de O. Matos, and E. R. B. Dias. Aplicação da métrica bleu para avaliação comparativa dos tradutores automáticos bing tradutor e google tradutor. Speech CommuE-scrita, 5(3):33--45, 2014.Google Scholar
- G. A. de Othero. A gramática da Frase em Português: algumas reflexões para a formalização da estrutura frasal em português. EdiPUCRS, Porto Alegre:RS, 2009.Google Scholar
- C. Freitas, P. Rocha, and E. Bick. Floresta sintá(c)tica: bigger, thicker and easier. In Conf comput process port lang, pages 216--219, 2008. Google ScholarDigital Library
- M. Huenerfauth. A multi-path architecture for machine translation of english text into american sign language animation. In Proceedings of the Student Research Workshop at HLTNAACL, number 4, pages 25--30, 2004. Google ScholarDigital Library
- M. Huenerfauth. American sign language generation: multimodal nlg with multiple linguistic channels. In Proceedings of the ACL Student Research Workshop, pages 37--42, Junho 2005. Google ScholarDigital Library
- M. Huenerfauth. Representing coordination and non-coordination in an american sign language animation. In Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility, number 7, pages 44--51, Outubro 2005. Google ScholarDigital Library
- M. Huenerfauth. Generating american sign language animation: overcoming misconceptions and technical challenges. Universal Access in the Information Society, 6(4):419--434, Fevereiro 2008. Google ScholarDigital Library
- M. Huenerfauth, L. Zhao, E. Gu, and J. Allbeck. Evaluating american sign language generation through the participation of native asl signers. ACM Transactions on Accessible Computing, 1(1):211--218, Maio 2008. Google ScholarDigital Library
- S. T. C. Lopes. O processo aquisitivo da escrita da língua portuguesa por surdos. Acta Tecnológica, 5(2):126--138, 2010.Google Scholar
- V. López-Ludeña, C. González-Morcillo, J. López, E. Ferreiro, J. Ferreiros, and R. San-Segundo. Methodology for developing an advanced communications system for the deaf in a new domain. Knowledge-Based Systems, 52:240--252, Janeiro 2014. Google ScholarDigital Library
- V. López-Ludeña, C. González-Morcillo, J. López, E. Ferreiro, J. Ferreiros, and R. San-Segundo. Translating bus information into sign language for deaf people. Engineering Applications of Artificial Intelligence, 32:258--269, Junho 2014.Google ScholarCross Ref
- S. Morrissey and A. Way. Manual labour: tackling machine translation for sign languages. Machine Translation, 27(1):25--64, Março 2013. Google ScholarDigital Library
- R. M. Quadros. Educação de Surdos - Aquisição da Linguagem. Editora Artes Médicas, Porto Alegre, Brasil, 1997.Google Scholar
- R. San-Segundo, A. Pérez, D. Ortiz, L. D'Haro, M. Torres, and F. Casacuberta. Evaluation of alternatives on speech to sign language translation. In Conference of the Internacional Speech Communication Association, pages 2529--2532, 2007.Google Scholar
- R. R. Segala. Tradução Intermodal e intersemiótica/Interlingual: Português brasileiro escrito para Língua Brasileira de Sinais. Universidade Federal de Santa Catarina - UFSC., Florianópolis:SC, 2010.Google Scholar
- R. Segundo, J. M. Montero, J. Macías-Guarasa, R. Córdoba, J. Ferreiros, and J. M. Pardo. Speech to sign language translation system for spanish. Speech Communcation, 50(11--12):1009--1020, Novembro-Dezembro 2008. Google ScholarDigital Library
- H. Y. Su and A. H. Wu. Improving structural statistical machine translation for sign language with small corpus using thematic role templates as translation memory. In IEEE Transactions on Machine Translation, Audio, Speech, and Language Processing, number 17, pages 1305--1315, 2009. Google ScholarDigital Library
Index Terms
- Incorporation of Syntactic-Semantic Aspects in a LIBRAS Machine Translation Service to Multimedia Platforms
Recommendations
Analysis of rule-based machine translation and neural machine translation approaches for translating portuguese to LIBRAS
WebMedia '19: Proceedings of the 25th Brazillian Symposium on Multimedia and the WebIn this paper, we propose a rule-based machine translator for Brazilian Portuguese to Brazilian Sign Language translation. This translator was implemented using the part of speech tagging and lemmatization techniques with implementations in Aelius and ...
Large aligned treebanks for syntax-based machine translation
We present a collection of parallel treebanks that have been automatically aligned on both the terminal and the non-terminal constituent level for use in syntax-based machine translation. We describe how they were constructed and applied to a syntax- ...
Language Modeling for Syntax-Based Machine Translation Using Tree Substitution Grammars: A Case Study on Chinese-English Translation
The poor grammatical output of Machine Translation (MT) systems appeals syntax-based approaches within language modeling. However, previous studies showed that syntax-based language modeling using (Context-Free) Treebank Grammars was not very helpful in ...
Comments