JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE) ›› 2021, Vol. 56 ›› Issue (11): 15-23.doi: 10.6040/j.issn.1671-9352.0.2021.425

Previous Articles    

Sentiment classification combining graph convolution neural network

YIN Ai-ying1,3, LIN Jian-zhou2,3, WU Yun-bing2,3*, LIAO Xiang-wen2,3   

  1. 1. Department of Computer Engineering, Zhicheng College of Fuzhou University, Fuzhou 350002, Fujian, China;
    2.College of Computer and Big Data, Fuzhou University, Fuzhou 350108, Fujian, China;
    3. Digital Fujian Institute of Financial Big Data, Fuzhou 350108, Fujian, China
  • Published:2021-11-15

PDF (PC)

390

Abstract: Document-level sentiment classification aims to predict users sentiment polarity labels on review text. Recent studies have found that incorporating user and product information can effectively improve the performance of review sentiment classification. However, most of the pervious arts only concentrate on the relation between users and reviews, products and reviews, ignoring the inhere correlation between users and users, products and products. Therefore, we propose a sentiment classification combining graph convolution neural network. Firstly, we construct a relation graph of user-to-user and a relation graph of user-to-product based on the datasets and merge them into a heterogeneous graph. Secondly, utilize the graph convolutional neural network to learn the inhere correlation between users and users, products and products to obtain better user and product representation. Finally, use a hierarchical user attention and product attention network combined with CNN to make sentiment polarity classification. Experiments on benchmark datasets of IMDB, Yelp2013 and Yelp2014 show that our method can achieve state-of-the-art performance.

Key words: sentiment classification, graph convolutional neural network, heterogeneous graph, hierarchical network

CLC Number: 

  • TP391
[1] 吴璠,王中卿,周夏冰,等. 基于用户和产品表示的情感分析和评论质量检测联合模型[J].软件学报, 2020, 31(8):2492-2507. WU Fan, WANG Zhongqing, ZHOU Xiabing, et al. Joint model for sentiment analysis and review quality detection with user and product representations[J]. Journal of Software, 2020, 31(8):2492-2507.
[2] CHEN H, SUN M, TU C. Neural sentiment classification with user and product attention[C] //Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Austin: ACL, 2016: 1650-1659.
[3] WU Z, DAI X Y, YIN C, et al. Improving review representations with user attention and product attention for sentiment classification[C] //The Thirty-Second AAAI Conference on Artificial Intelligence. Louisiana: AAAI Press, 2018: 5989-5996.
[4] YUAN Z, WU F, LIU J, et al. Neural review rating prediction with user and product memory[C] // Proceedings of the 28th ACM International Conference on Information and Knowledge Management. New York: ACM, 2019: 2341-2344.
[5] KIM Y. Convolutional neural networks for sentence classification[C] //The 2014 Conference on Empirical Methods in Natural Language Processing. Doha: ACL, 2014: 1746-1751.
[6] QIAN Q, HUANG M, LEI J, et al. Linguistically regularized lstm for sentiment classification[C] //Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics. Vancouver: ACL, 2017: 1679-1689.
[7] JELODAR H, WANG Y, ORJI R, et al. Deep sentiment classification and topic discovery on novel coronavirus or COVID-19 online discussions: nlp using lstm recurrent neural network approach[J]. IEEE Journal of Biomedical and Health Informatics, 2020, 24(10):2733-2742.
[8] CHENG Y, YAO L, XIANG G, et al. Text sentiment orientation analysis based on multi-channel CNN and bidirectional GRU with attention mechanism[J]. IEEE Access, 2020(8):134964-134975.
[9] SUN K, ZHANG R, MENSAH S,et al. Aspect-level sentiment analysis via convolution over dependency tree[C] // Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. Hong Kong: ACL, 2019: 5683-5692.
[10] LETARTE G, PARADIS F, GIGU RE P, et al. Importance of self-attention for sentiment analysis[C] // Proceedings of the 2018 EMNLP Workshop Blackbox NLP: analyzing and Interpreting Neural Networks for NLP. Brussels: ACL, 2018: 267-275.
[11] YIN D, MENG T, CHANG K W. SentiBERT: a transferable transformer-based architecture for compositional sentiment semantics[C] //Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.[S.l.] : ACL, 2020: 3695-3706.
[12] DEVLIN J, CHANG M W, LEE K, et al. BERT: pre-training of deep bidirectional transformers for language understanding[C] //Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Minneapolis: ACL, 2019: 4171-4186.
[13] KE P, JI H, LIU S, et al. SentiLARE: sentiment-aware language representation learning with linguistic knowledge[C] //Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. [S.l.] : ACL, 2020: 6975-6988.
[14] BACCIANELLA S, ESULI A, SEBASTIANI F. SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining[C] //Proceedings of the International Conference on Language Resources and Evaluation. Valletta: European Language Resources Association, 2010: 17-23.
[15] TIAN H, GAO C, XIAO X, et al. SKEP: sentiment knowledge enhanced pre-training for sentiment analysis[C] //Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.[S.l.] : ACL, 2020: 4067-4076.
[16] SIAMI-NAMINIS, TAVAKOLI N, NAMIN A S. The performance of LSTM and BiLSTM in forecasting time series[C] //2019 IEEE International Conference on Big Data. Los Angeles: IEEE, 2019: 3285-3292.
[17] HUANG L, WANG W, CHEN J, et al. Attention on attention for image captioning[C] //International Conference on Computer Vision. Seoul: IEEE, 2019: 4633-4642.
[18] TANG D, QIN B, LIU T. Learning semantic representations of users and products for document level sentiment classification[C] //Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing. Beijing: ACL, 2015: 1014-1023.
[19] AMPLAYO R K, KIM J, SUNG S, et al. Cold-start aware user and product attention for sentiment classification[C] //Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics. Melbourne: ACL, 2018: 2535-2544.
[20] MIKOLOV T, SUTSKEVER I, CHEN K, et al. Distributed representations of words and phrases and their compositionality[C] //Proceedings of the 26th International Conference on Neural Information Processing Systems. Nevada: Curran Associates Inc, 2013: 3111-3119.
[21] YANG Z, YANG D, DYER C, et al. Hierarchical attention networks for document classification[C] //The 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. San Diego California: ACL, 2016: 1480-1489.
[1] YANG Yan, XU Bing, YANG Mu-yun, ZHAO Jing-jing. An emotional classification method based on joint deep learning model [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2017, 52(9): 19-25.
[2] LUO Yi, LI Li, TAN Song-bo, CHENG Xue-qi. Sentiment analysis on Chinese Micro-blog corpus [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2014, 49(11): 1-7.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright 2018 © Editorial office of JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE)
Supported by Beijing Magtech Co.Ltd