Sentiment Analysis Method based on Piecewise Convolutional Neural Network and Generative Adversarial Network

  • Changshun Du
  • Lei Huang School of Economics and Management Beijing Jiaotong University Beijing 100044, China

Abstract

Text sentiment analysis is one of the most important tasks in the field of public opinion monitoring, service evaluation and satisfaction analysis under network environments. Compared with the traditional Natural Language Processing analysis tools, convolution neural networks can automatically learn useful features from sentences and improve the performance of the affective analysis model. However, the original convolution neural network model ignores sentence structure information which is very important for text sentiment analysis. In this paper, we add piece-wise pooling to the convolution neural network, which allows the model to obtain the sentence structure. And the main features of different sentences are extracted to analyze the emotional tendencies of the text. At the same time, the user’s feedback involves many different fields, and there is less labeled data. In order to alleviate the sparsity of the data, this paper also uses the generative adversarial network to make common feature extractions, so that the model can obtain the common features associated with emotions in different fields, and improves the model’s Generalization ability with less training data. Experiments on different datasets demonstrate the effectiveness of this method.

References

[1] Chen, X. (2012); Research on Sentiment Dictionary based Emotional Tendency Analysls of Chinese MicroBlog, Huazhong University of Science & Technology, 2012.(in Chinese)

[2] Cui, H.; Mittal, V.; Datar, M. (2006); Comparative experiments on sentiment classification for online product reviews, AAAI, 6, 1265-1270, 2006.

[3] Goodfellow, I.J.; Pouget-Abadie, J.; Mirza, M. et al. (2014); Generative adversarial nets, Intl Conf. on Neural Information Processing Systems, MIT Press, 2672-2680, 2014.

[4] Li, D.; Qiao, B.; Yuanda, Y.; et al. (2008); Word Orientation Recognition Based on Semantic Analysis, Pattern Recognition & Artificial Intelligence, 2008.(in Chinese)

[5] Luong, T.; Socher, R.; Manning, C.(2013); Better word representations with recursive neural networks for morphology, Proc. of the Seventeenth Conf. on Computational Natural Language Learning, 104-113,2013.

[6] Socher, R. (2014); Recursive deep learning for natural language processing and computer vision, Stanford University, 2014.

[7] Socher, R.; Huval, B.; Manning, C.D. et al.(2012); Semantic compositionality through recursive matrix-vector spaces, Proc. of the 2012 joint conf. on empirical methods in natural language processing and computational natural language learning, Association for Computational Linguistics, 1201-1211, 2012.

[8]Socher, R.; Chen, D.; Manning, C.D. et al (2013); Reasoning with neural tensor networks for knowledge base completion, Advances in neural information processing systems, 926-934, 2013.

[9] Socher, R.; Perelygin, A.; Wu, J. et al.(2013); Recursive deep models for semantic compositionality over a sentiment treebank, Proc. of the 2013 conf. on empirical methods in natural language processing, 1631-1642, 2013.

[10]Srinivas, S.; Sarvadevabhatla, R.K.; Mopuri, K.R. et al. (2016); A taxonomy of deep convolutional neural nets for computer vision, Frontiers in Robotics and AI, 2:36, 2016.

[11] Taigman, Y.; Polyak, A.; Wolf, L. (2016); Unsupervised Cross-Domain Image Generation, arXiv preprint arXiv, 1611.02200, 2016.

[12] Zeng, D.; Liu. K.; Lai, S. et al. (2014); Relation classification via convolutional deep neural network, Proc, of COLING 2014, the 25th Intl Conf. on Computational Linguistics: Technical Papers, 2335-2344, 2014.

[13] Zhang, W., Zhang, Z., Chao, H.C. et al. (2018); Kernel mixture model for probability density estimation in Bayesian classifiers, Data Mining and Knowledge Discovery, 32(3), 675-707, 2018.
https://doi.org/10.1007/s10618-018-0550-5

[14] Zhang, W.; Zhang, Z.; Qi, D. et al. (2014); Automatic crack detection and classification method for subway tunnel safety monitoring, Sensors, 14(10), 19307-19328, 2018.
Published
2019-02-14
How to Cite
DU, Changshun; HUANG, Lei. Sentiment Analysis Method based on Piecewise Convolutional Neural Network and Generative Adversarial Network. INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, [S.l.], v. 14, n. 1, p. 7-20, feb. 2019. ISSN 1841-9844. Available at: <http://univagora.ro/jour/index.php/ijccc/article/view/3374>. Date accessed: 13 july 2020. doi: https://doi.org/10.15837/ijccc.2019.1.3374.

Keywords

Sentiment analysis, Piecewise Convolution Neural Network, Generative Adversarial Network