Análise de Sentimentos: Comparando o uso de ferramentas e a análise humana
Resumo
Análise de Sentimentos emergiu a partir da necessidade de se tratar e avaliar textos, opiniões e comentários realizados por usuários na Internet, no intuito de compreender como eles se relacionam com uma determinada entidade. Diversos métodos de análise têm sido desenvolvidos na tentativa de melhor traduzir as incertezas e a subjetividade dos sentimentos humanos. Esta pesquisa utilizou os dados de interações de alunos em uma rede social para identificar os sentimentos envolvidos em cada comentário. A partir dos textos coletados foram usadas análises de sentimento manual e automática e os resultados encontrados foram comparados com a avaliação realizada pelos autores dos comentários, a fim de identificar qual método mais aproximava dos reais. A comparação realizada indicou diferenças entre os resultados obtidos e o real: enquanto as ferramentas utilizadas classificaram mais de 40% dos comentários como neutros, a análise dos autores das mensagens indicou que 71% dos comentários eram positivos. Na classificação foram identificados outliers e divergências na categorização da intensidade dos sentimentos por cada método. Nenhuma abordagem, incluindo a realizada pelo pesquisador, foi considerada suficientemente eficiente, uma vez que o maior nível de acurácia obtido foi inferior a 70%.
Palavras-chave:
Análise de sentimentos, Redes Sociais Online, Emoções, Sistemas de Informação Cognitivos
Referências
Bandinelli, R; D'Avllio, E; Rinaldi, R. (2014). "Assessing the maturity of collaborative networks: a case study analysis in the Italian fashion SMEs". 20th IEEE Int. Conference on Engineering, Technology and Innovation, p. 1-9.
Binz, T.; Exertier, F.; Krebs, R.; Le Jeune, G.; Pelletier, B.; Rodero-Merino, L.; Niemoller, J.; Souillard, C.; Spriestersbach, A.; Strauch, S. (2011). "4CaaST - Building the PaaS Cloud of the Future. Immigrant PaaS Technologies: Scientific and Technical Report". European Union's Seventh Framework Programme (FP7/2007-2013).
Café, L; Santos, C D; Macedo, F. (2001). Proposta de um método para escolha de software de automação de bibliotecas. Ciência da Informação, Brasília, 30(2), 70-79.
Camarinha-Matos, LM; Afsarmanesh, H. (1999). "The virtual enterprise concept". Proc. 1st IFIP Working Conference on Virtual Enterprises, Springer, p. 3-14.
Camarinha-Matos, LM; Afsarmanesh, H. (2005). "Collaborative networks: A new scientific discipline", in Journal of Intelligent Manufacturing. V 16 (4-5), p. 439-452.
Camarinha-Matos, LM; Afsarmanesh, H; Oliveira, AI; Ferrada, F. (2014). "Cloud-based Collaborative Business Services Provision". Enterprise Information Systems. Springer. Volume 190, p. 366-384.
Camarinha-Matos, LM; Afsarmanesh, H; Ollus, M. (2008). "Methods and Tools for Collaborative Networked Organizations". Springer.
Cancian, MH; Rabelo, RJ; Wangenheim, C G V. (2013). "Supporting Processes for Collaborative SaaS". Proc. 14th IFIP Working Conference on Virtual Enterprises, Springer, p. 183-190.
Gao, J; Ma, J; Zhang, X; Lu, D. (2012). "Cloud computing based logistics resource dynamic integration and collaboration". Proc. IEEE 16th Int. Conference on Computer Supported Cooperative Work, p. 939-943.
Gil, AC. (2002). Como elaborar projetos de pesquisa. 4. ed. São Paulo.
Google, INC. (2015). "Google Cloud Platform". Disponível em:
Goscinski, A; Brock, M. (2010). "Toward dynamic and attribute based publication, discovery and selection for clouding computing". Future Generation Computer Systems 26 (2010) p. 947–970.
Gueye, A D; Sanogo, I; Ouya, S; Saliah-Hassane, H; Lishou, C. (2014). "Proposal for a Cloud Computing solution and application in a pedagogical virtual organization". Proc. International Conference on Information Technology, INEER, p. 349-359.
Hyvonen, T; Jarvinen, J; Pellinen, J. (2008). A virtual integration - The management control system in a multinational enterprise. Management Accounting Research, Volume 19, p. 45–61.
Jiang, N; Xu, L; Vrieze, P; Lim, M; Jarabo, O. (2012). "A Cloud Based Data Integration Framework". Proc. 13th IFIP WG 5.5 Working Conference on Virtual Enterprises, Springer, p. 177-185.
Jingjing, C; Haitao, S. (2011). "Industrial clusters information based on SaaS model". Proc. 2011 International Conference on Business Management and Electronic Information (BMEI), p. 28-31.
Kasunic, M; Anderson, W. (2004). "Measuring Systems Interoperability: Challenges and Opportunities". Technical Note, Software Engineering Institute, Carnegie Mellon University, Pittsburgh.
Kitchenham, B. (2007). "Guidelines for performing Systematic Literature Reviews in Software Engineering". Department of Computer Science, Durham, UK.
Kourtesis, D; Bratanis, K; Bibikas, D; Paraskakis, I. (2012). "Software Co-development in the Era of Cloud Application Platforms and Ecosystems: The Case of CAST". Proc. 13th IFIP WG 5.5 Working Conference on Virtual Enterprises, Springer, p. 196-204.
Lai, IKW; Tam, SKT; Chan, MFS. (2012). "Knowledge cloud system for network collaboration: A case study in medical service industry in China". Expert Systems with Applications, Volume 39, Issue 15, p. 12205–12212.
Li, J; Li, B; Du, Z; Meng, L. (2010). "CloudVO: Building a Secure Virtual Organization for Multiple Clouds Collaboration". Proc. 11th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing, p. 181-186.
Mezgar, I; Rauschecker, U. (2014). "The challenge of networked enterprises for cloud computing interoperability". Computers in Industry, Volume 65, p. 657-674.
Microsoft, INC. (2015). "Microsoft Corporation". Disponível em:
Miller, M. (2008). "Cloud Computing: Web-Based Applications That Change the Way You Work and Collaborate Online". Que Publishing.
Munch, T; Buchmann, R; Pfeffer, J; Ortiz, P; Christl, C; Hladik, J; Ziegler, J; Lazaro, O; Karagiannis, D; Urbas, L. (2013). "An Innovative Virtual Enterprise Approach to Agile Micro and SME-Based Collaboration Networks". Proc. 14th IFIP WG 5.5 Working Conference on Virtual Enterprises, Springer, p. 121-128.
Mvelase, P; Dlodlo, N; Williams, Q; Adigun, M. (2011). "Virtual enterprise model for enabling cloud computing for SMMEs". Proc. 2011 International Conference on Intelligent Semantic Web-Services and Applications (paper n. 13).
Mvelase, P; Sibiya, G; Dlodlo, N; Oladosu, J; Adigun, M. (2013). "A comparative analysis of pricing models for enterprise cloud platforms". AFRICON, 2013, p.1-7.
Myers, J. (2006). "Future Value Systems: Next Generation Economic Growth Engines & Manufacturing", in IMS Vision Forum 2006, IMS International, Seoul, p. 30-47.
Nist (Nacional Institute of Standards and Technology). "Guidelines on Security and Privacy in Public Cloud Computing". (2011). Disponível em: http://csrc.nist.gov/publications/nistpubs/800-144/SP800-144.pdf
Nist (Nacional Institute of Standards and Technology). US Government Cloud Computing Technology Roadmap. (2014). Disponível em: http://nvlpubs.nist.gov/nistpubs/SpecialPublications/NIST.SP.500-293.pdf
Sanchez, NG; Zubiaga, DAG; González, JAI; Molina, A. (2005). Virtual Breeding Environment: A First Approach to Understanding Working and Sharing Principles. Proc. International Conference on Interoperability of Information Systems, Interoperability of enterprise software and applications, p. 99-110.
Taurion, C. (2009). Cloud Computing: Computação em nuvem: transformando o mundo da Tecnologia da Informação. Rio de Janeiro: Brasport, 2009.
Veloudis, S; Paraskakis, I; Petsos, C. (2015). Cloud Service Brokerage: Strengthening Service Resilience in Cloud-Based Virtual Enterprises. Proc. 16th IFIP Working Conference on Virtual Enterprises, Springer, p. 122-135.
Veras, M. (2012). Cloud Computing: nova Arquitetura da TI. Rio de Janeiro: Brasport, 2012.
Westphal, I; Thoben, KD; Seifert, M. (2010). "Managing Collaboration Performance to Govern Virtual Organizations". Journal of Intelligent Manufacturing, 21-3, p. 311-320.
Zhang, K; Ma, B; Dong, PJ; Tang, BY; Cai,H. (2010) "Research on producer service innovation in home-textile industrial cluster based on cloud computing platform". Proc. 2010 IEEE International Conference on Service Operations and Logistics and Informatics (SOLI), p. 155-160.
Binz, T.; Exertier, F.; Krebs, R.; Le Jeune, G.; Pelletier, B.; Rodero-Merino, L.; Niemoller, J.; Souillard, C.; Spriestersbach, A.; Strauch, S. (2011). "4CaaST - Building the PaaS Cloud of the Future. Immigrant PaaS Technologies: Scientific and Technical Report". European Union's Seventh Framework Programme (FP7/2007-2013).
Café, L; Santos, C D; Macedo, F. (2001). Proposta de um método para escolha de software de automação de bibliotecas. Ciência da Informação, Brasília, 30(2), 70-79.
Camarinha-Matos, LM; Afsarmanesh, H. (1999). "The virtual enterprise concept". Proc. 1st IFIP Working Conference on Virtual Enterprises, Springer, p. 3-14.
Camarinha-Matos, LM; Afsarmanesh, H. (2005). "Collaborative networks: A new scientific discipline", in Journal of Intelligent Manufacturing. V 16 (4-5), p. 439-452.
Camarinha-Matos, LM; Afsarmanesh, H; Oliveira, AI; Ferrada, F. (2014). "Cloud-based Collaborative Business Services Provision". Enterprise Information Systems. Springer. Volume 190, p. 366-384.
Camarinha-Matos, LM; Afsarmanesh, H; Ollus, M. (2008). "Methods and Tools for Collaborative Networked Organizations". Springer.
Cancian, MH; Rabelo, RJ; Wangenheim, C G V. (2013). "Supporting Processes for Collaborative SaaS". Proc. 14th IFIP Working Conference on Virtual Enterprises, Springer, p. 183-190.
Gao, J; Ma, J; Zhang, X; Lu, D. (2012). "Cloud computing based logistics resource dynamic integration and collaboration". Proc. IEEE 16th Int. Conference on Computer Supported Cooperative Work, p. 939-943.
Gil, AC. (2002). Como elaborar projetos de pesquisa. 4. ed. São Paulo.
Google, INC. (2015). "Google Cloud Platform". Disponível em:
Goscinski, A; Brock, M. (2010). "Toward dynamic and attribute based publication, discovery and selection for clouding computing". Future Generation Computer Systems 26 (2010) p. 947–970.
Gueye, A D; Sanogo, I; Ouya, S; Saliah-Hassane, H; Lishou, C. (2014). "Proposal for a Cloud Computing solution and application in a pedagogical virtual organization". Proc. International Conference on Information Technology, INEER, p. 349-359.
Hyvonen, T; Jarvinen, J; Pellinen, J. (2008). A virtual integration - The management control system in a multinational enterprise. Management Accounting Research, Volume 19, p. 45–61.
Jiang, N; Xu, L; Vrieze, P; Lim, M; Jarabo, O. (2012). "A Cloud Based Data Integration Framework". Proc. 13th IFIP WG 5.5 Working Conference on Virtual Enterprises, Springer, p. 177-185.
Jingjing, C; Haitao, S. (2011). "Industrial clusters information based on SaaS model". Proc. 2011 International Conference on Business Management and Electronic Information (BMEI), p. 28-31.
Kasunic, M; Anderson, W. (2004). "Measuring Systems Interoperability: Challenges and Opportunities". Technical Note, Software Engineering Institute, Carnegie Mellon University, Pittsburgh.
Kitchenham, B. (2007). "Guidelines for performing Systematic Literature Reviews in Software Engineering". Department of Computer Science, Durham, UK.
Kourtesis, D; Bratanis, K; Bibikas, D; Paraskakis, I. (2012). "Software Co-development in the Era of Cloud Application Platforms and Ecosystems: The Case of CAST". Proc. 13th IFIP WG 5.5 Working Conference on Virtual Enterprises, Springer, p. 196-204.
Lai, IKW; Tam, SKT; Chan, MFS. (2012). "Knowledge cloud system for network collaboration: A case study in medical service industry in China". Expert Systems with Applications, Volume 39, Issue 15, p. 12205–12212.
Li, J; Li, B; Du, Z; Meng, L. (2010). "CloudVO: Building a Secure Virtual Organization for Multiple Clouds Collaboration". Proc. 11th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing, p. 181-186.
Mezgar, I; Rauschecker, U. (2014). "The challenge of networked enterprises for cloud computing interoperability". Computers in Industry, Volume 65, p. 657-674.
Microsoft, INC. (2015). "Microsoft Corporation". Disponível em:
Miller, M. (2008). "Cloud Computing: Web-Based Applications That Change the Way You Work and Collaborate Online". Que Publishing.
Munch, T; Buchmann, R; Pfeffer, J; Ortiz, P; Christl, C; Hladik, J; Ziegler, J; Lazaro, O; Karagiannis, D; Urbas, L. (2013). "An Innovative Virtual Enterprise Approach to Agile Micro and SME-Based Collaboration Networks". Proc. 14th IFIP WG 5.5 Working Conference on Virtual Enterprises, Springer, p. 121-128.
Mvelase, P; Dlodlo, N; Williams, Q; Adigun, M. (2011). "Virtual enterprise model for enabling cloud computing for SMMEs". Proc. 2011 International Conference on Intelligent Semantic Web-Services and Applications (paper n. 13).
Mvelase, P; Sibiya, G; Dlodlo, N; Oladosu, J; Adigun, M. (2013). "A comparative analysis of pricing models for enterprise cloud platforms". AFRICON, 2013, p.1-7.
Myers, J. (2006). "Future Value Systems: Next Generation Economic Growth Engines & Manufacturing", in IMS Vision Forum 2006, IMS International, Seoul, p. 30-47.
Nist (Nacional Institute of Standards and Technology). "Guidelines on Security and Privacy in Public Cloud Computing". (2011). Disponível em: http://csrc.nist.gov/publications/nistpubs/800-144/SP800-144.pdf
Nist (Nacional Institute of Standards and Technology). US Government Cloud Computing Technology Roadmap. (2014). Disponível em: http://nvlpubs.nist.gov/nistpubs/SpecialPublications/NIST.SP.500-293.pdf
Sanchez, NG; Zubiaga, DAG; González, JAI; Molina, A. (2005). Virtual Breeding Environment: A First Approach to Understanding Working and Sharing Principles. Proc. International Conference on Interoperability of Information Systems, Interoperability of enterprise software and applications, p. 99-110.
Taurion, C. (2009). Cloud Computing: Computação em nuvem: transformando o mundo da Tecnologia da Informação. Rio de Janeiro: Brasport, 2009.
Veloudis, S; Paraskakis, I; Petsos, C. (2015). Cloud Service Brokerage: Strengthening Service Resilience in Cloud-Based Virtual Enterprises. Proc. 16th IFIP Working Conference on Virtual Enterprises, Springer, p. 122-135.
Veras, M. (2012). Cloud Computing: nova Arquitetura da TI. Rio de Janeiro: Brasport, 2012.
Westphal, I; Thoben, KD; Seifert, M. (2010). "Managing Collaboration Performance to Govern Virtual Organizations". Journal of Intelligent Manufacturing, 21-3, p. 311-320.
Zhang, K; Ma, B; Dong, PJ; Tang, BY; Cai,H. (2010) "Research on producer service innovation in home-textile industrial cluster based on cloud computing platform". Proc. 2010 IEEE International Conference on Service Operations and Logistics and Informatics (SOLI), p. 155-160.
Publicado
17/05/2016
Como Citar
MOREIRA, Vanessa de Sales; SIQUEIRA, Sean Wolfgand; ANDRADE, Leila; PIMENTEL, Mariano.
Análise de Sentimentos: Comparando o uso de ferramentas e a análise humana. In: SIMPÓSIO BRASILEIRO DE SISTEMAS DE INFORMAÇÃO (SBSI), 12. , 2016, Florianópolis.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2016
.
p. 441-448.
DOI: https://doi.org/10.5753/sbsi.2016.5993.
