Semantic enrichment of video lecture repositories: a case study

• João P. R. P. da Silva Federal University of Juiz de Fora (UFJF)
• João Victor de Souza Federal University of Juiz de Fora (UFJF)
• Jairo Francisco de Souza Federal University of Juiz de Fora (UFJF)
• Eduardo Barrére Federal University of Juiz de Fora (UFJF)

DOI: https://doi.org/10.5753/cbie.sbie.2018.1263

Abstract

An important feature in most educational video repositories is the lack of relevant information in keywords and metadata that enables full access to videos through search engines. One of these repositories is Videoaula@RNP, for which a project was developed with a focus on the semantic enrichment of the educational videos stored there, based on audio transcription, semantic annotation and similarity analysis. This article presents this solution and the impacts generated from its application in the repository.

Keywords: educational videos, semantic enrichment, audio transcription, semantic annotation, similarity search

References

Biswas, A., Gandhi, A., and Deshmukh, O. (2015). MMToc: A multimodal method for table of content creation in educational videos. In Proceedings of the 23rd ACM International Conference on Multimedia, pages 621–630.

Casagrande, M. F. R., Kozima, G., and Willrich, R. (2015). A recommendation technique based on metadata for digital repositories oriented to learning. Brazilian Journal of Computers in Education, 23(02):70.

Cheniki, N., Belkhir, A., Sam, Y., and Messai, N. (2016). LODS: A linked open data based similarity measure. In 25th International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises, pages 229–234. IEEE.

Coelho, S. A. and de Souza, J. F. (2014). Anotação semântica de transcritos para indexação e busca de vídeos. In Conferência Ibero Americana WWW/INTERNET.

de Oliveira, F. K., Santana, J. R., and de Oliveira Pontes, M. G. (2010a). O vídeo como ferramenta educacional a partir de múltiplas plataformas. In Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação - SBIE), volume 1.

de Oliveira, F. K., Santana, J. R., and de Oliveira Pontes, M. G. (2010b). O vídeo pela internet como ferramenta educacional. In Anais do Workshop de Informática na Escola, volume 1, pages 1389–1392.

Dias, L. L., Barbosa, J. S., Barrére, E., and de Souza, J. F. (2017). An approach to identify similarity among educational resources using external knowledge bases. Brazilian Journal of Computers in Education, 25(02):18.

Gomes Jr, J., Souza, J., and Barrére, E. (2017). Comparativo entre fontes de dados para anotação automática de videoaulas. In Simpósio Brasileiro de Informática na Educação, volume 28, page 1127.

Gravier, G., Jones, G. F., Larson, M., and Ordelman, R. (2015). Overview of the 2015 workshop on speech, language and audio in multimedia. In Proceedings of the 23rd ACM International Conference on Multimedia, pages 1347–1348.

Grunewald, F. and Meinel, C. (2015). Implementation and evaluation of digital e-lecture annotation in learning groups to foster active learning. IEEE Transactions on Learning Technologies, 8(3):286–298.

Herrera, J. E. T., Casanova, M. A., Nunes, B. P., Lopes, G. R., and Leme, L. (2016). DBpedia profiler tool: Profiling the connectivity of entity pairs in DBpedia. In International Workshop on Intelligent Exploration of Semantic Data.

Ko, T., Peddinti, V., Povey, D., and Khudanpur, S. (2015). Audio augmentation for speech recognition. In Sixteenth Annual Conference of the International Speech Communication Association.

Ko, T., Peddinti, V., Povey, D., Seltzer, M. L., and Khudanpur, S. (2017). A study on data augmentation of reverberant speech for robust speech recognition. In Acoustics, Speech and Signal Processing, 2017 IEEE International Conference on, pages 5220–5224.

Lawrence, R. (2008). Fundamentals of Speech Recognition. Pearson Education India.

Neves, D. E., Ishitani, L., and Brandão, W. C. (2016). Methodology for recommendation and aggregation of learning objects in SCORM. Brazilian Journal of Computers in Education, 24(01):11.

Raimond, Y. and Lowis, C. (2012). Automated interlinking of speech radio archives. LDOW, 937.

Taskiran, C. M., Pizlo, Z., Amir, A., Ponceleon, D., and Delp, E. J. (2006). Automated video program summarization using speech transcripts. IEEE Transactions on Multimedia, 8(4):775–791.

Turnbull, D., Barrington, L., Torres, D., and Lanckriet, G. (2008). Semantic annotation and retrieval of music and sound effects. IEEE Transactions on Audio, Speech, and Language Processing, 16(2):467–476.

Yang, H. and Meinel, C. (2014). Content based lecture video retrieval using speech and video text information. IEEE Transactions on Learning Technologies, 7(2):142–154.

Zhao, B., Xu, S., Lin, S., Luo, X., and Duan, L. (2015). A new visual navigation system for exploring biomedical open educational resource (OER) videos. Journal of the American Medical Informatics Association, 23(e1):e34–e41.

Zhu, G. and Iglesias, C. A. (2017). Computing semantic similarity of concepts in knowledge graphs. IEEE Transactions on Knowledge and Data Engineering, 29(1):72–85.