Abstract
Reviews are valuable sources of information to support the decision making process. Therefore, the task of classifying reviews according to their helpfulness has paramount importance to facilitate the access of truly informative content. In this context, previous studies have unveiled several aspects and architectures that are beneficial for the task of review perceived helpfulness prediction. The present work aims to further investigate the influence of the text specificity aspect, defined as the level of details conveyed in a text, with the same purpose. First, we explore an unsupervised domain adaptation approach for assigning text specificity scores for sentences from product reviews and we propose an evaluation measure named Specificity Prediction Evaluation (SPE) in order to achieve more reliable specificity predictions. Then, we present domain-oriented guidelines on how to incorporate, into a CNN architecture, either hand-crafted features based on text specificity or the text specificity prediction task as an auxiliary task in a multitask learning setting. In the experiments, the perceived helpfulness classification models embodied with text specificity showed significant higher precision results in comparison to a popular SVM baseline.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Basiri, M.E., Habibi, S.: Review helpfulness prediction using convolutional neural networks and gated recurrent units. In: 2020 6th International Conference on Web Research (ICWR), pp. 191–196 (2020)
Caruana, R.: Multitask learning. Mach. Learn. 28(1), 41–75 (1997)
Chen, C., Yang, Y., Zhou, J., Li, X., Bao, F.S.: Cross-domain review helpfulness prediction based on convolutional neural networks with auxiliary domain discriminators. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 2 (Short Papers), pp. 602–607 (2018)
Fan, M., Feng, Y., Sun, M., Li, P., Wang, H., Wang, J.: Multi-task neural learning architecture for end-to-end identification of helpful reviews. In: 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), pp. 343–350 (2018)
Fan, M., Feng, C., Sun, M., Li, P.: Reinforced product metadata selection for helpfulness assessment of customer reviews. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, pp. 1675–1683 (2019)
Ghose, A., Ipeirotis, P.G.: Estimating the helpfulness and economic impact of product reviews: mining text and reviewer characteristics. IEEE Trans. Knowl. Data Eng. 23(10), 1498–1512 (2011)
Kang, Y., Zhou, L.: Longer is better? a case study of product review helpfulness prediction. In: Americas Conference on Information Systems (2016)
Kim, S.M., Pantel, P., Chklovski, T., Pennacchiotti, M.: Automatically assessing review helpfulness. In: Conference on Empirical Methods in Natural Language Processing, pp. 423–430 (2006)
Kim, Y.: Convolutional neural networks for sentence classification. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 1746–1751 (2014)
Ko, W.J., Durrett, G., Li, J.J.: Domain agnostic real-valued specificity prediction. In: Proceedings of the AAAI Conference on Artificial Intelligence (2019)
Li, J.J., Nenkova, A.: Fast and accurate prediction of sentence specificity. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 2281–2287 (2015)
Lima, B., Nogueira, T.: Novel features based on sentence specificity for helpfulness prediction of online reviews. In: 2019 8th Brazilian Conference on Intelligent Systems (BRACIS), pp. 84–89 (2019)
Liu, J., Cao, Y., Lin, C.Y., Huang, Y., Zhou, M.: Low-quality product review detection in opinion summarization. In: Conference on Empirical Methods in Natural Language Processing, vol. 7, pp. 334–342 (2007)
Louis, A., Nenkova, A.: Automatic identification of general and specific sentences by leveraging discourse annotations. In: Proceedings of 5th International Joint Conference on Natural Language Processing, pp. 605–613 (2011)
Louis, A., Nenkova, A.: Text specificity and impact on quality of news summaries. In: Proceedings of the Workshop on Monolingual Text-To-Text Generation, pp. 34–42 (2011)
McAuley, J., Targett, C., Shi, Q., Van Den Hengel, A.: Image-based recommendations on styles and substitutes. In: Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 43–52 (2015)
Mudambi, S.M., Schuff, D.: What makes a helpful online review? a study of customer reviews on amazon.com. MIS Q. 34(1), 185–200 (2010)
Ocampo Diaz, G., Ng, V.: Modeling and prediction of online product review helpfulness: a survey. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, vol. 1: Long Papers, pp. 698–708 (2018)
Pennington, J., Socher, R., Manning, C.: GloVe: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, pp. 1532–1543 (2014)
Saumya, S., Singh, J.P., Dwivedi, Y.K.: Predicting the helpfulness score of online reviews using convolutional neural network. Soft Comput. 24(15), 10989–11005 (2019). https://doi.org/10.1007/s00500-019-03851-5
Zhang, Y., Wallace, B.: A sensitivity analysis of (and practitioners’ guide to) convolutional neural networks for sentence classification. In: Proceedings of the Eighth International Joint Conference on Natural Language Processing, vol. 1: Long Papers, pp. 253–263. Asian Federation of Natural Language Processing (2017)
Zhang, Y., Lin, Z.: Predicting the helpfulness of online product reviews: a multilingual approach. Electron. Commer. Res. Appl. 27, 1–10 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Lima, B., Nogueira, T. (2021). Incorporating Text Specificity into a Convolutional Neural Network for the Classification of Review Perceived Helpfulness. In: Britto, A., Valdivia Delgado, K. (eds) Intelligent Systems. BRACIS 2021. Lecture Notes in Computer Science(), vol 13074. Springer, Cham. https://doi.org/10.1007/978-3-030-91699-2_33
Download citation
DOI: https://doi.org/10.1007/978-3-030-91699-2_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-91698-5
Online ISBN: 978-3-030-91699-2
eBook Packages: Computer ScienceComputer Science (R0)