JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE) ›› 2014, Vol. 49 ›› Issue (11): 68-73.doi: 10.6040/j.issn.1671-9352.3.2014.025

Previous Articles     Next Articles

Key sentiment sentence prediction using SVM and RNN

LIU Ming, ZAN Hong-ying, YUAN Hui-bin   

  1. School of Information Engineering, Zhengzhou University, Zhengzhou 450001, Henan, China
  • Received:2014-08-28 Revised:2014-10-21 Online:2014-11-20 Published:2014-11-25

Abstract: Key sentiment sentences play an important role in predicting the sentiment distribution in texts, and therefore it improves the performance after correctly judging these key sentences. After analyzing the advantages and disadvantages of the state-of-the-art approaches which are mainly based on rules and statistics, it is found that rule-based methods achieve high accuracy but with low coverage, the statistic method is quite the opposite. In this paper, a novel deep learning framework to predict sentiment distributions based on Recursive Neural Network as well as Support Vector Machine was introduced. There are sentiment features including not only grammar information such as sentiment and negative words, but also statistical information like word vector in deep learning. Meanwhile, text features like sentence pattern and position were also involved. This method combines SVM and RNN in deep learning to predict sentiment distributions in texts, which outperforms other traditional approaches. The result from COAE2014 Task 1 shows that our method achieves a MicroF1 value of 0.388, higher than the average level.

Key words: recursive neural network, machine learning, RNN, deep learning, sentiment analysis

CLC Number: 

  • TP391
[1] PANG Bo, LEE L, VAITHYANATHAN S. Thumbs up? sentiment classification using machine learning techniques[C]//Proceedings of the 2002 Conference on Empirical Methods In Natural Language Processing. Somerset: ACL, 2002:79-86.
[2] PANG Bo, LEE L. Opinion mining and sentiment analysis[M]. Boston, Delft: Now Publishers Inc, 2008, 2(1-2):1-135.
[3] MICHAEL G. Sentiment classification on customer feedback data: noisy data, large feature vectors, and the role of linguistic analysis [C]//Proceedings of the International Conference on Computational Linguistics. New York: ACM,2004:491-503.
[4] LI Shoushan, HUANG Churen, ZHOU Guodong, et al. Employing personal/impersonal views in supervised and semi-supervised sentiment classification[C]//Proceedings of the International Conference on Computational Linguistics. New York: ACM, 2010:414-423.
[5] TANG Duyu, QIN Bing, LIU Ting, et al. Learning sentence representation for emotion classification on microblogs[C]//Natural Language Processing and Chinese Computing.[S.l.]: Springer-Verlag, 2013:212-223.
[6] TURNEY P D. Thumbs up or down? semantic orientation applied to unsupervised of reviews[C]//Proceedongs of 40th Annual Meeting of the Association for Computation Linguistics. Somerset: ACL, 2002:417-424.
[7] SOCHER R, PENNINGTON J, HUANG E H, et al. Semi-supervised recursive auto-encoders for predicting sentiment distributions[C]//Proceedings of the Conference on Empirical Methods in Natural Language Processing. PA, USA:Association for Computational Linguistics, 2011:151-161.
[8] DASGUPTA Sajib, NG Vincent. Mine the easy, classify the hard: a semi-supervised approach to automatic sentiment classification[C]//Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP. Singapore: ACM, 2009:701-709.
[9] SOCHER R, PERELYGIN A, WU J Y, et al. Recursive deep models for semantic compositionality over a sentiment treebank[C]//Proceedings of the Conference on Empirical Methods in Natural Language Processing. Edinburgh, UK: Elsevier BV, 2011:1631-1642.
[10] LI Tao, ZHANG Yi, SINDHWANI Vikas. A non-negative matrix tri-factorization approach to sentiment classification with lexical prior knowledge[C]//Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP. Somerset: ACL, 2009:244-252.
[11] YESSENALINA A, CARDIE C. Compositional matrix-space models for sentiment analysis[C]//Proceedings of the Conference on Empirical Methods in Natural Language Processing. Edinburgh, UK: Elsevier B V, 2011:172-182.
[1] YU Chuan-ming, FENG Bo-lin, TIAN Xin, AN Lu. Deep representative learning based sentiment analysis in the cross-lingual environment [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2018, 53(3): 13-23.
[2] PANG Bo, LIU Yuan-chao. Fusion of pointwise and deep learning methods for passage ranking [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2018, 53(3): 30-35.
[3] CHEN Xin, XUE Yun, LU Xin, LI Wan-li, ZHAO Hong-ya, HU Xiao-hui. Text feature extraction method for sentiment analysis based on order-preserving submatrix and frequent sequential pattern mining [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2018, 53(3): 36-45.
[4] LIU Ming-ming, ZHANG Min-qing, LIU Jia, GAO Pei-xian. Steganalysis method based on shallow convolution neural network [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2018, 53(3): 63-70.
[5] HE Yan-xiang, LIU Jian-bo, SUN Song-tao, WEN Wei-dong. Product reviews sentiment classification in Micro-blog based on cascaded conditional random field [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2015, 50(11): 67-73.
[6] ZHU Zhu, LI Shou-shan, DAI Min, ZHOU Guo-dong. Opinion target extraction with active-learning and automatic annotation [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2015, 50(07): 38-44.
[7] ZHOU Wen, ZHANG Shu-qing, OUYANG Chun-ping, LIU Zhi-ming, YANG Xiao-hua. Topic sentiment analysis of Chinese news based on emotional dependency tuple [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2014, 49(12): 1-6.
[8] YANG Jia-neng, YANG Ai-min, ZHOU Yong-mei. Sentiment classification method of Chinese Micro-blog based on semantic analysis [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2014, 49(11): 14-21.
[9] ZHU Xi, DONG Xi-shuang, GUAN Yi, LIU Zhi-guang. Sentiment analysis of Chinese Micro-blog based on semi-supervised learning [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2014, 49(11): 37-42.
[10] SUN Song-tao, HE Yan-xiang, CAI Rui, LI Fei, HE Fei-yan. Comparative study of methods for Micro-blog sentiment evaluation tasks [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2014, 49(11): 43-50.
[11] PAN Qing-qing, ZHOU Feng, YU Zheng-tao, GUO Jian-yi, XIAN Yan-tuan. Recognition method of Vietnamese named entity based on#br# conditional random fields [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2014, 49(1): 76-79.
[12] DU Rui-ying, YANG Yong, CHEN Jing, WANG Chi-heng. An efficient network traffic classification scheme based on similarity [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2014, 49(09): 109-114.
[13] DONG Yuan1, XU Ya-bin1,2*, LI Zhuo1,2, LI Yan-ping1. Research on spam identification based on social computing and machine learning [J]. J4, 2013, 48(7): 72-78.
[14] HUANG Lin-sheng1, DENG Zhi-hong1,2, TANG Shi-wei1,2, WANG Wen-qing3, CHEN Ling3. A Chinese organization′s full name and matching abbreviation  algorithm based on edit-distance [J]. J4, 2012, 47(5): 43-48.
[15] ZHANG Cheng-gong 1, 2, LIU Pei-yu1, 2*, ZHU Zhen-fang1,2, FANG Ming1,2. A sentiment analysis method based on a polarity lexicon [J]. J4, 2012, 47(3): 47-50.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!