Collaborative approach to supporting the assessment of Portuguese language teaching

• Luiz Carlos Carchedi Federal University of Juiz de Fora (UFJF)
• Eduardo Barrére Federal University of Juiz de Fora (UFJF)
• Jairo Francisco de Souza Federal University of Juiz de Fora (UFJF)

DOI: https://doi.org/10.5753/cbie.sbie.2018.1593

Abstract

During the literacy process, orality is as important as written language. The large-scale evaluation of this process is fundamental for public bodies responsible for education. With the aid of automatic speech recognition (ASR) tools, it is possible to automate the evaluation of orality, which allows its use on a large scale; however, when automated, there are cases where the process can not define the quality of the reading performed. In such cases, it requires human involvement. The goal of this work is present a computational solution to support a orality evaluation in large scale. This work presents a collaborative solution to complement the automatic large scale evaluation of orality. The results presented reinforce the viability of the solution.

Keywords: literacy, speech fluency, educational assessment, automatic speech recognition, collaboration

References

Araújo, A. M. T., de Menezes, C. S., and Cury, D. (2003). Apoio automatizado à avaliação da aprendizagem utilizando mapas conceituais. In Simpósio Brasileiro de Informática na Educação, volume 1, pages 287–296.

Black, M., Tepperman, J., Kazemzadeh, A., Lee, S., and Narayanan, S. S. (2008). Pronunciation verification of English letter-sounds in preliterate children. In Ninth Annual Conference of the International Speech Communication Association.

Black, M., Tepperman, J., Lee, S., Price, P., and Narayanan, S. S. (2007). Automatic detection and classification of disfluent reading miscues in young children's speech for the purpose of assessment. In Eighth Annual Conference of the International Speech Communication Association.

Chaer, M. R. and Guimarães, E. d. G. A. (2012). A importância da oralidade: educação infantil e séries iniciais do ensino fundamental. Disponível em: [link]. Acesso em: 04 abril 2018.

Deeney, T. A. (2010). One-minute fluency measures: Mixed messages in assessment and instruction. The Reading Teacher, 63(6):440–450.

Dixon, J. (2001). Evaluation tools for flexible delivery (workshop version). Melbourne: TAFE frontiers.

Duchateau, J., Cleuren, L., Ghesquière, P., et al. (2007). Automatic assessment of children's reading level. In Proceedings of the European Conference on Speech Communication and Technology, pages 1210–1213.

Ferreira, T. and Fernandes, M. (2017). Detecção de traços de personalidade em textos para apoiar a formação de grupos para colaboração. In Simpósio Brasileiro de Informática na Educação, volume 28, page 1627.

Gerosa, M., Giuliani, D., Narayanan, S., and Potamianos, A. (2009). A review of ASR technologies for children's speech. In Proceedings of the 2nd Workshop on Child, Computer and Interaction, page 7. ACM.

Gomes, A. V. A. (2009). Custo aluno qualidade. Brasília: Câmara dos Deputados.

Hämäläinen, A., Meinedo, H., Tjalve, M., Pellegrini, T., Trancoso, I., and Dias, M. S. (2014). Improving speech recognition through automatic selection of age group-specific acoustic models. In International Conference on Computational Processing of the Portuguese Language, pages 12–23. Springer.

Kuhn, M. R., Schwanenflugel, P. J., and Meisinger, E. B. (2010). Aligning theory and assessment of reading fluency: Automaticity, prosody, and definitions of fluency. Reading Research Quarterly, 45(2):230–251.

Valencia, S. W., Smith, A. T., Reece, A. M., Li, M., Wixson, K. K., and Newman, H. (2010). Oral reading fluency assessment: Issues of construct, criterion, and consequential validity. Reading Research Quarterly, 45(3):270–291.

Wöllmer, M., Schuller, B., Batliner, A., Steidl, S., and Seppi, D. (2011). Tandem decoding of children's speech for keyword detection in a child-robot interaction scenario. ACM Transactions on Speech and Language Processing (TSLP), 7(4):12.