Avaliação do Uso de Métodos Baseados em LSA e WordNet para Correção de Questões Discursivas
Resumo
Neste trabalho são descritas e avaliadas técnicas de análise semântica para correção automática de questões discursivas. Foram utilizados métodos baseados em corpus (LSA) e em conhecimento (WordNet). Os escores calculados foram comparados com aqueles atribuídos pelos professores e observaramse altos coeficientes de correlação e acurácia.
Palavras-chave:
LSA, WordNet, questões discursivas, avaliação automática, similaridade textual
Referências
Ávila, R.L.F. e Soares, J.M. (2013). Uso de técnicas de pré-processamento textual e algoritmos de comparação com o suporte à correção de questões dissertativas: experimentos, análises e contribuições. Anais do Simpósio Brasileiro de Informática na Educação (SBIE 2013).
Burrows, S., Gurevych, I. e Stein, B. (2015). The eras and trends of automatic short answer grading. International Journal of Artificial Intelligence in Education, v.25, n.1, p. 60–117.
Colen, W. (2013). Aprimorando o corretor gramatical CoGrOO. Dissertação de mestrado. Universidade de São Paulo.
Fellbaum, C. (1998). WordNet: A electronic lexical database, Language, Speech, and Communication. MIT Press.
Hirst, G. e St-Onge, D. (1998). Lexical chains as representations of context for the detection and correction of malapropisms. WordNet - An Electronic Lexical Database, n. April, p. 305–332.
Jiang, J.J. e Conrath, D.W. (1997). Semantic similarity based on corpus statistics and lexical taxonomy. Rocling.
Landauer, T.K. e Dutnais, S.T. (1997). A Solution to Plato’s Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. Psychological Review, 104(2), 211–240.
Leacock, C. e Chodorow, M. (1998). Combining local context and WordNet sense similarity for word sense identification. WordNet: an electronic lexical database, language, speech, and communication (c. 11, p. 265–284).
Lin, D. (1998). An Information-Theoretic Definition of Similarity. Proceedings of ICML, p. 296–304.
Meng, L., Huang, R. e Gu, J. (2013). A Review of Semantic Similarity Measures in WordNet. International Journal of Hybrid Information Technology, v.6, n.1, p. 1–12.
Mohler, M. e Mihalcea, R. (2009). Text-to-text Semantic Similarity for Automatic Short Answer Grading. Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics (EACL ’09), April, p. 567–575.
Oliveira, H. G., Paiva, V., Freitas, C., Rademaker, A., Real, L. e Simões, A. (2015). As wordnets do português. Oslo Studies in Language, v. 7, n. 1, p. 397–424.
Pedersen, T., Patwardhan, S. e Michelizzi, J. (2004). WordNet::Similarity: Measuring the Relatedness of Concepts. In Demonstration Papers at HLTNAACL 2004. HLTNAACLDemonstrations’04. Association for Computational Linguistics.
Resnik P. (1995). Using information content to evaluate semantic similarity. Proceedings of the 14th International Joint Conference on Artificial Intelligence, August 1995, p. 2025.
Santos, J. C. A. e Favero, E. L. (2015). Practical use of a latent semantic analysis (LSA) model for automatic evaluation of written answers. Journal of the Brazilian Computer Society, v. 21, n. 1, p. 21.
Paiva, V., Rademaker, A. e Melo, G. (2012). OpenWordNetPT: An Open Brazilian Wordnet for Reasoning. In Proceedings of COLING 2012: Demonstration Papers (pp. 353–360). Mumbai, India: The COLING 2012 Organizing Committee.
Widdows, D. e Ferraro, K. (2008). Semantic Vectors: a Scalable Open Source Package and Online Technology Management Application. LREC’08 Proceedings of the Sixth International Conference on Language Resources and Evaluation, January 2008, p. 1183–1190.
Wu Z. e Palmer M. (1994). Verb semantics and lexical selection. Proceedings of 32nd annual Meeting of the Association for Computational Linguistics, June 1994 p. 2730.
Ziai, R., Ott, N. e Meurers, D. (2012). Short Answer Assessment: Establishing Links Between Research Strands. Proceedings of the Seventh Workshop on Building Educational Applications Using NLP. Association for Computational Linguistics.
Burrows, S., Gurevych, I. e Stein, B. (2015). The eras and trends of automatic short answer grading. International Journal of Artificial Intelligence in Education, v.25, n.1, p. 60–117.
Colen, W. (2013). Aprimorando o corretor gramatical CoGrOO. Dissertação de mestrado. Universidade de São Paulo.
Fellbaum, C. (1998). WordNet: A electronic lexical database, Language, Speech, and Communication. MIT Press.
Hirst, G. e St-Onge, D. (1998). Lexical chains as representations of context for the detection and correction of malapropisms. WordNet - An Electronic Lexical Database, n. April, p. 305–332.
Jiang, J.J. e Conrath, D.W. (1997). Semantic similarity based on corpus statistics and lexical taxonomy. Rocling.
Landauer, T.K. e Dutnais, S.T. (1997). A Solution to Plato’s Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. Psychological Review, 104(2), 211–240.
Leacock, C. e Chodorow, M. (1998). Combining local context and WordNet sense similarity for word sense identification. WordNet: an electronic lexical database, language, speech, and communication (c. 11, p. 265–284).
Lin, D. (1998). An Information-Theoretic Definition of Similarity. Proceedings of ICML, p. 296–304.
Meng, L., Huang, R. e Gu, J. (2013). A Review of Semantic Similarity Measures in WordNet. International Journal of Hybrid Information Technology, v.6, n.1, p. 1–12.
Mohler, M. e Mihalcea, R. (2009). Text-to-text Semantic Similarity for Automatic Short Answer Grading. Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics (EACL ’09), April, p. 567–575.
Oliveira, H. G., Paiva, V., Freitas, C., Rademaker, A., Real, L. e Simões, A. (2015). As wordnets do português. Oslo Studies in Language, v. 7, n. 1, p. 397–424.
Pedersen, T., Patwardhan, S. e Michelizzi, J. (2004). WordNet::Similarity: Measuring the Relatedness of Concepts. In Demonstration Papers at HLTNAACL 2004. HLTNAACLDemonstrations’04. Association for Computational Linguistics.
Resnik P. (1995). Using information content to evaluate semantic similarity. Proceedings of the 14th International Joint Conference on Artificial Intelligence, August 1995, p. 2025.
Santos, J. C. A. e Favero, E. L. (2015). Practical use of a latent semantic analysis (LSA) model for automatic evaluation of written answers. Journal of the Brazilian Computer Society, v. 21, n. 1, p. 21.
Paiva, V., Rademaker, A. e Melo, G. (2012). OpenWordNetPT: An Open Brazilian Wordnet for Reasoning. In Proceedings of COLING 2012: Demonstration Papers (pp. 353–360). Mumbai, India: The COLING 2012 Organizing Committee.
Widdows, D. e Ferraro, K. (2008). Semantic Vectors: a Scalable Open Source Package and Online Technology Management Application. LREC’08 Proceedings of the Sixth International Conference on Language Resources and Evaluation, January 2008, p. 1183–1190.
Wu Z. e Palmer M. (1994). Verb semantics and lexical selection. Proceedings of 32nd annual Meeting of the Association for Computational Linguistics, June 1994 p. 2730.
Ziai, R., Ott, N. e Meurers, D. (2012). Short Answer Assessment: Establishing Links Between Research Strands. Proceedings of the Seventh Workshop on Building Educational Applications Using NLP. Association for Computational Linguistics.
Publicado
24/10/2016
Como Citar
PASSERO, Guilherme; HAENDCHEN FILHO, Aluizio; SCARANTO DAZZI, Rudimar Luís.
Avaliação do Uso de Métodos Baseados em LSA e WordNet para Correção de Questões Discursivas. In: SIMPÓSIO BRASILEIRO DE INFORMÁTICA NA EDUCAÇÃO (SBIE), 27. , 2016, Uberlândia/MG.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2016
.
p. 1136-1145.
DOI: https://doi.org/10.5753/cbie.sbie.2016.1136.
