JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE) ›› 2014, Vol. 49 ›› Issue (11): 68-73.doi: 10.6040/j.issn.1671-9352.3.2014.025

Previous Articles     Next Articles

Key sentiment sentence prediction using SVM and RNN

LIU Ming, ZAN Hong-ying, YUAN Hui-bin   

  1. School of Information Engineering, Zhengzhou University, Zhengzhou 450001, Henan, China
  • Received:2014-08-28 Revised:2014-10-21 Online:2014-11-20 Published:2014-11-25

Abstract: Key sentiment sentences play an important role in predicting the sentiment distribution in texts, and therefore it improves the performance after correctly judging these key sentences. After analyzing the advantages and disadvantages of the state-of-the-art approaches which are mainly based on rules and statistics, it is found that rule-based methods achieve high accuracy but with low coverage, the statistic method is quite the opposite. In this paper, a novel deep learning framework to predict sentiment distributions based on Recursive Neural Network as well as Support Vector Machine was introduced. There are sentiment features including not only grammar information such as sentiment and negative words, but also statistical information like word vector in deep learning. Meanwhile, text features like sentence pattern and position were also involved. This method combines SVM and RNN in deep learning to predict sentiment distributions in texts, which outperforms other traditional approaches. The result from COAE2014 Task 1 shows that our method achieves a MicroF1 value of 0.388, higher than the average level.

Key words: recursive neural network, machine learning, RNN, deep learning, sentiment analysis

CLC Number: 

  • TP391
[1] PANG Bo, LEE L, VAITHYANATHAN S. Thumbs up? sentiment classification using machine learning techniques[C]//Proceedings of the 2002 Conference on Empirical Methods In Natural Language Processing. Somerset: ACL, 2002:79-86.
[2] PANG Bo, LEE L. Opinion mining and sentiment analysis[M]. Boston, Delft: Now Publishers Inc, 2008, 2(1-2):1-135.
[3] MICHAEL G. Sentiment classification on customer feedback data: noisy data, large feature vectors, and the role of linguistic analysis [C]//Proceedings of the International Conference on Computational Linguistics. New York: ACM,2004:491-503.
[4] LI Shoushan, HUANG Churen, ZHOU Guodong, et al. Employing personal/impersonal views in supervised and semi-supervised sentiment classification[C]//Proceedings of the International Conference on Computational Linguistics. New York: ACM, 2010:414-423.
[5] TANG Duyu, QIN Bing, LIU Ting, et al. Learning sentence representation for emotion classification on microblogs[C]//Natural Language Processing and Chinese Computing.[S.l.]: Springer-Verlag, 2013:212-223.
[6] TURNEY P D. Thumbs up or down? semantic orientation applied to unsupervised of reviews[C]//Proceedongs of 40th Annual Meeting of the Association for Computation Linguistics. Somerset: ACL, 2002:417-424.
[7] SOCHER R, PENNINGTON J, HUANG E H, et al. Semi-supervised recursive auto-encoders for predicting sentiment distributions[C]//Proceedings of the Conference on Empirical Methods in Natural Language Processing. PA, USA:Association for Computational Linguistics, 2011:151-161.
[8] DASGUPTA Sajib, NG Vincent. Mine the easy, classify the hard: a semi-supervised approach to automatic sentiment classification[C]//Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP. Singapore: ACM, 2009:701-709.
[9] SOCHER R, PERELYGIN A, WU J Y, et al. Recursive deep models for semantic compositionality over a sentiment treebank[C]//Proceedings of the Conference on Empirical Methods in Natural Language Processing. Edinburgh, UK: Elsevier BV, 2011:1631-1642.
[10] LI Tao, ZHANG Yi, SINDHWANI Vikas. A non-negative matrix tri-factorization approach to sentiment classification with lexical prior knowledge[C]//Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP. Somerset: ACL, 2009:244-252.
[11] YESSENALINA A, CARDIE C. Compositional matrix-space models for sentiment analysis[C]//Proceedings of the Conference on Empirical Methods in Natural Language Processing. Edinburgh, UK: Elsevier B V, 2011:172-182.
[1] ZHANG Yong, JI Wei, ZHONG YI. Methods of named entity recognition and applications in electric power domain [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2026, 61(5): 1-17.
[2] CHEN Zhongyuan, LU Chong. Center moment discrepancy multimodal sentiment analysis based on self-attention mechanism [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2026, 61(3): 86-95.
[3] CHEN Zijie, ZHAO Dongxia, WANG Yiyan. Stability analysis of recurrent neural network systems with three delays [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2026, 61(2): 43-49.
[4] ZHAO Yulin, LIANG Fengning, ZHAO Teng, CAO Yaru, WANG Lin, ZHU Hong. Method for glioma gene status prediction based on deep truth discovery [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2025, 60(7): 13-21.
[5] CHEN Yunfan, WANG Yechen, WANG Long, AN Qi, FENG Zeguo. Application of SERS collaborative machine learning in biomedical detection [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2025, 60(10): 23-41.
[6] Xia LIANG,Jie GUO. A method of online teaching platform selection based on online reviews [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2024, 59(9): 108-118.
[7] CHEN Yumin, ZHENG Guangyu, JIAO Na. Multi-label learning based on granular neural networks [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2024, 59(5): 1-11.
[8] Xueqiang ZENG,Yu SUN,Ye LIU,Zhongying WAN,Jiali ZUO,Mingwen WANG. Emoji embedded representation based on emotion distribution [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2024, 59(3): 81-94.
[9] WANG Tinghua, HU Zhenwei, ZHAN Hongxiang. A novel unsupervised feature selection method [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2024, 59(12): 130-140.
[10] Yiran LI,Ning ZHAO,Zhijian ZHANG. Prediction of average queue time in multi-server tandem queueing systems [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2024, 59(1): 17-26.
[11] Cheng LI,Wengang CHE,Shengxiang GAO. A object detection algorithm for aerial images [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2023, 58(9): 59-70.
[12] Chan LU,Junjun GUO,Kaiwen TAN,Yan XIANG,Zhengtao YU. Multimodal sentiment analysis based on text-guided hierarchical adaptive fusion [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2023, 58(12): 31-40, 51.
[13] Chengcheng ZHONG,Heng ZHOU,Zitong ZHANG,Chunlei ZHANG. LAC-UNet: semantic segmentation model based on capsules for representing part-whole hierarchical features [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2023, 58(11): 116-126.
[14] LI Ying, ZHANG Guo-lin. Modeling for dissolved gases concentration based on mutual information and kernel entropy component analysis [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2022, 57(7): 43-52.
[15] ZHANG Jie, PENG Guo-jun, YANG Xiu-zhang. Malicious evasion sample detection based on dynamic API call sequence and machine learning [J]. JOURNAL OF SHANDONG UNIVERSITY(NATURAL SCIENCE), 2022, 57(7): 85-93.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!