Sentiment Analysis in Outdoor Images Using Deep Learning

• Wyverson Bonasoli UTFPR
• Leyza Baldo Dorini UTFPR
• Rodrigo Minetto Unicamp
• Thiago H. Silva UTFPR

Resumo

In this work, we explore how Convolutional Neural Networks can be applied to the task of sentiment analysis in visual media. We compare four different architectures and propose a new approach where attributes that represent the main categories used for scenes description are combined with the output of the convolutional layers before the classification process. In the first dataset, composed of image tweets, we obtained accuracy improvements over previous works. The second dataset, constructed in this paper, contains only images from outdoor areas and labeled in three sentiment classes: positive, neutral and negative. Sentiment analysis of outdoor images helps to enable new services, e.g., to better uncover the semantics of areas compared to indoor images. In general, the use of the attributes improves the accuracy of the results.

Palavras-chave: Image Processing, Sentiment Analysis, Social Networks, Deep Learning