skip to main content
10.1145/3229345.3229389acmotherconferencesArticle/Chapter ViewAbstractPublication PagessbsiConference Proceedingsconference-collections
research-article

The Use of the Convolutional Neural Network as an Emotion Classifier in a Music Recommendation System

Published:04 June 2018Publication History

ABSTRACT

Currently, social networks has been used for its users, and exploited by mechanisms of quality measurement systems and recommendation of products and services. The Recommendation Systems (SR) have used the data of the social networks and in parallel they have applied the sentiment and affective analysis in such data. However, there is still a concern in increasing the accuracy of the sentiment and affective analysis. This article introduces an SR, which extracts the texts of the users of the social networks and suggests musical styles based on the sentiment analysis by lexical approach and based on the affective analysis through the machine learning. The Convolutional Neural Network algorithm used for the emotion classification of hapiness, sadness, anger, fear, disgust and surprise presented a precision higher than the found in related works. Classification results of the F-Measure were of 0.98 e 0.96 for the emotion of sadness and anger, respectively. In addition, SR was assessed by means of subjective tests and the experimental results show that 97% of users approved the SR proposal.

References

  1. S. N. Ahmad. Emotions and topics in online word of mouth: Application of latent semantic analysis. Publicado em CD-ROM, May 2013.Google ScholarGoogle Scholar
  2. L. F. Brunialti, S. M. Peres, V. Freire, and C. M. Lima. Aprendizado de maquina em sistemas de recomendacao baseados em conteudo textual: Uma revisao sistematica. In Brazilian Symposium on Information System, pages 203--210, Goiania, Brasil, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. R. A. Calix, S. A. Mallepudi, B. Chen, and G. M. Knapp. Emotion recognition in text for 3-d facial expression rendering. IEEE Transactions on Multimedia, 12(6):544--551, Oct 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. J. J. Carnevale, K. Fujita, H. A. Han, and E. Amit. Immersion versus transcendence: How pictures and words impact evaluative associations assessed by the implicit association test. Social Psychological and Personality Science, 6(1):92--100, 2015.Google ScholarGoogle ScholarCross RefCross Ref
  5. A. Cem, C. Alexander, W. Janyce, and M. Rada. Amazon mechanical turk for subjectivity word sense disambiguation. In NAACL-HLT 2010 Workshop on Creating Speech and Language Data With Amazon's Mechanical Turk, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. T. Chen, R. Xu, Y. He, and X. Wang. Improving sentiment analysis via sentence type classification using bilstm-crf and cnn. Expert Systems with Applications, 72:221--230, Nov 2017. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Y. L. Cun, B. Boser, J. S. Denker, R. E. Howard, W. Habbard, L. D. Jackel, and D. Henderson. Advances in Neural Information Processing Systems 2. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1990.Google ScholarGoogle Scholar
  8. K. Dave, S. Lawrence, and D. M. Pennock. Mining the peanut gallery: Opinion extraction and semantic classification of product reviews. In Proceedings of the 12th International Conference on World Wide Web, WWW '03, pages 519--528, New York, NY, USA, 2003. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. E. K. de Assis, E. T. Affonso, D. Z. Rodriguez, and R. L. Rosa. Information system for the improvement of telecommunication service quality. In Proceedings of Brazilian Symposium on Information Systems, pages 452--455, Lavras, Minas Gerais, Brazil, June 2017.Google ScholarGoogle Scholar
  10. E. K. de Assis, E. Tavares, D. Z. Rodríguez, and R. L. Rosa. Information system for the improvement of telecommunication service quality. In Brazilian Symposium on Information System., June 2017.Google ScholarGoogle Scholar
  11. C. dos Santos and M. Gatti. Deep convolutional neural networks for sentiment analysis of short texts. In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, pages 69--78, Dublin, Ireland, August 2014.Google ScholarGoogle Scholar
  12. A. G.-Crespo, R. C. Palacios, J. M. G. Berbis, and F. G. Sanchez. Solar: Social link advanced recommendation system. In Future Gener. Comput. Syst., volume 26, pages 374--380, March 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. A. Gil. Como elaborar projetos de pesquisa. 2002.Google ScholarGoogle Scholar
  14. K. Hornik, M. Stinchcombe, and H. White. Multilayer feedforward networks are universal approximators. Neural Netw., 2(5):359--366, July 1989. Google ScholarGoogle ScholarCross RefCross Ref
  15. M. Hu and B. Liu. Mining and summarizing customer reviews. In Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '04, pages 168--177, New York, NY, USA, 2004. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. S. Koelstra, C. Mehl, M. Soleymani, J.-S. Lee, A. Yazdani, T. Ebrahimi, T. Pun, A. Nijholt, and I. Patras. Deap: A database for emotion analysis; using physiological signals. T. Affective Computing, 3(1):18--31, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. U. Krcadinac, P. Pasquier, J. Jovanovic, and V. Devedzi. Synesketch: An open source library for sentence-based emotion recognition. IEEE Transactions on Affective Computing, 4(3):312--325, September 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. S. Lu. A preliminary analysis of the continuous axis value of the three-dimensional pad speech emotional state model. The 16th edition of the International Conference on Digital Audio Effects (DAFx), 2013.Google ScholarGoogle Scholar
  19. R. Machedon, W. M. Rand, and Y. V. Joshi. Automatic classification of social media messaging using multi-dimensional sentiment analysis and crowdsourcingy. In SSRN, February 2013.Google ScholarGoogle Scholar
  20. B. Meuleman and K. Scherer. Nonlinear appraisal modeling: An application of machine learning to the study of emotion production. IEEE Transactions on Affective Computing, 2014.Google ScholarGoogle Scholar
  21. K. P. Murphy. Machine learning: a probabilistic perspective. MIT Press, Cambridge, Mass., 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. P. Nakov, Z. Kozareva, A. Ritter, S. Rosenthal, V. Stoyanov, and T. Wilson. Semeval-2013 task 2: Sentiment analysis in twitter, 2013.Google ScholarGoogle Scholar
  23. A. Neviarouskaya and M. Aono. Sentiment word relations with affect, judgment, and appreciation. IEEE Transactions on Affective Computing, 4(4):425--438, Oct 2013.Google ScholarGoogle ScholarCross RefCross Ref
  24. F. Å. Nielsen. A new anew: Evaluation of a word list for sentiment analysis in microblogs. CoRR, abs/1103.2903, 2011.Google ScholarGoogle Scholar
  25. A. Pak and P. Paroubek. Twitter based system: Using twitter for disambiguating sentiment ambiguous adjectives. In Proceedings of the 5th International Workshop on Semantic Evaluation, Uppsala University, Uppsala, Sweden, July, 2010, pages 436--439, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. B. Pang, L. Lee, and S. Vaithyanathan. Thumbs up?: Sentiment classification using machine learning techniques. In Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing - Volume 10, EMNLP '02, pages 79--86, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. W. Peng and D. H. Park. Generate adjective sentiment dictionary for social media sentiment analysis using constrained nonnegative matrix factorization. In L. A. Adamic, R. A. Baeza-Yates, and S. Counts, editors, ICWSM, 2011.Google ScholarGoogle Scholar
  28. R. Picard, E.Vyzas, and J. Healey. Toward machine emotional intelligence: analysis of affective physiological state. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(10):1175--1191, October 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. F. Ren and Y. Wu. Predicting user-topic opinions in twitter with social and topical context. IEEE Transactions on Affective Computing, 4(4):412--424, Oct.-Dec. 2013.Google ScholarGoogle ScholarCross RefCross Ref
  30. J. Rodriguez. Sensitivity analysis of k-fold cross validation in prediction error estimation. In IEEE Transactions on Pattern Analysis and Machine Intelligence, pages 569--575, San Sebastian, Spain, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. R. L. Rosa, D. Z. Rodriguez, and G. Bressan. Sentimeter-br: A new social web analysis metric to discover consumers sentiment. In IEEE International Symposium on Consumer Electronics (ISCE), pages 153--154, Las Vegas, USA, Jan 2013. IEEE.Google ScholarGoogle ScholarCross RefCross Ref
  32. R. L. Rosa, D. Z. Rodriguez, and G. Bressan. Sentimeter-br: A social web analysis tool to discover consumers' sentiment. In 2013 IEEE 14th International Conference on Mobile Data Management, volume 2, pages 122--124, June 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. S. Sasaki, T. Hirai, H. Ohya, and S. Morishima. Affective music recommendation system using input images. In ACM SIGGRAPH 2013 Posters, SIGGRAPH '13, pages 90:1--90:1, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. A. Severyn and A. Moschitti. Twitter sentiment analysis with deep convolutional neural networks. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 959--962, New York, NY, USA, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. U. Shardanand and P. Maes. Social information filtering: Algorithms for automating "word of mouth". In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '95, pages 210--217, 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. G. Sidorov, S. Miranda-Jimenez, F. V. Jimenez, A. F. Gelbukh, N. A. Castro-Sanchez, F. Velasquez, I. Diaz-Rangel, S. S. Guerra, A. Trevisao, and J. Gordon. Empirical study of machine learning based approach for opinion mining in tweets. In MICAI, page 1--14, 2012. Publicado em CD-ROM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. M. Skowron, M. Theunis, S. Rank, and A. Kappas. Affect and social processes in online communication--experiments with an affective dialog system. IEEE Transactions on Affective Computing, 4(3):267--279, July-Sept. 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. R. Socher, A. Perelygin, J. Wu, J. Chuang, C. D. Manning, A. Ng, and C. Potts. Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pages 1631--1642, Oct. 2013.Google ScholarGoogle Scholar
  39. P. K. M. Vieira and N. Q. Lino. Multimedia content recommendation in digital convergence environments: An approach based on data mining and semantic web. In Proceedings of Brazilian Symposium on Information Systems, pages 103--110, Goias, Brazil, May 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. K. Yessenov. Sentiment analysis of movie review comments. In Methodology, 2009.Google ScholarGoogle Scholar
  41. Z. Yuan and M. Purver. Predicting Emotion Labels for Chinese Microblog Texts, pages 129--149. Springer International Publishing, Cham, 2015.Google ScholarGoogle Scholar
  42. X. Zhang, J. Zhao, and Y. LeCun. Character-level convolutional networks for text classification. In Proceedings of the 28th International Conference on Neural Information Processing Systems, pages 649--657, Montreal, Canada, Apr 2015. MIT Press. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. The Use of the Convolutional Neural Network as an Emotion Classifier in a Music Recommendation System

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        SBSI '18: Proceedings of the XIV Brazilian Symposium on Information Systems
        June 2018
        578 pages
        ISBN:9781450365598
        DOI:10.1145/3229345

        Copyright © 2018 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 4 June 2018

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed limited

        Acceptance Rates

        Overall Acceptance Rate181of557submissions,32%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader