Text Classification of Public Feedbacks using Convolutional Neural Network Based on Differential Evolution Algorithm

Authors

  • Shuai Zhang Zhejiang University of Finance and Economics http://orcid.org/0000-0002-6405-584X
  • Yong Chen Zhejiang University of Finance and Economics
  • Xiaoling Huang Zhejiang University of Finance and Economics
  • Yishuai Cai Zhejiang University of Finance and Economics

Keywords:

public feedback, deep learning, text classification, convolutional neural network, differential evolution algorithm

Abstract

Online feedback is an effective way of communication between government departments and citizens. However, the daily high number of public feedbacks has increased the burden on government administrators. The deep learning method is good at automatically analyzing and extracting deep features of data, and then improving the accuracy of classification prediction. In this study, we aim to use the text classification model to achieve the automatic classification of public feedbacks to reduce the work pressure of administrator. In particular, a convolutional neural network model combined with word embedding and optimized by differential evolution algorithm is adopted. At the same time, we compared it with seven common text classification models, and the results show that the model we explored has good classification performance under different evaluation metrics, including accuracy, precision, recall, and F1-score.

References

Bai, D.D.; Wang, C.Q.; Zhang, B.; et al. (2018); Sequence searching with CNN features for robust and fast visual place recognition, Computers & Graphics, 70, 270-280, 2018. https://doi.org/10.1016/j.cag.2017.07.019

Bishop, C.M. (1995); Neural Networks for Pattern Recognition, Oxford University Press, UK, 1995.

Breiman, L. (2001); Random forests, Machine Learning, 45(1), 5-32, 2001. https://doi.org/10.1023/A:1010933404324

Chau, R.N.; Yeh, C.S.; Smith, K.A. (2005); A neural network model for hierarchical multilingual text categorization, In Proceedings of the 2nd International Symposium on Neural Networks, May 30-June 1, Chongqing, China, 238-245, 2005.

Chen, J.N.; Huang, H.K.; Tian, S.F.; et al. (2009); Feature selection for text classification with Naive Bayes, Expert Systems with Applications, 36(3), 5432-5435, 2009. https://doi.org/10.1016/j.eswa.2008.06.054

Dai, Y.; Wu, W.; Zhou, H.B.; et al. (2018); Numerical simulation and optimization of oil jet lubrication for rotorcraft meshing gears, International Journal of Simulation Modelling, 17(2), 318-326, 2018. https://doi.org/10.2507/IJSIMM17(2)CO6

Dai, Y.; Zhu, X.; Zhou, H.; et al. (2018); Trajectory tracking control for seafloor tracked vehicle by adaptive neural-fuzzy inference system algorithm, International Journal of Computers Communications & Control, 13(4), 465-476, 2018. https://doi.org/10.15837/ijccc.2018.4.3267

Du, C.; Huang, L. (2018); Text classification research with attention-based recurrent neural networks, International Journal of Computers Communications & Control, 13(1), 50-61, 2018. https://doi.org/10.15837/ijccc.2018.1.3142

Duda, R.O.; Hart, P.E. (1973); Pattern Classification and Scene Analysis, Wiley, USA, 1973.

Ferreira, A.; Giraldi, G. (2017); Convolutional neural network approaches to granite tiles classification, Expert Systems with Applications, 84, 1-11, 2017. https://doi.org/10.1016/j.eswa.2017.04.053

Friedman, J.H. (2001); Greedy function approximation: a gradient boosting machine, Annals of Statistics, 29(5), 1189-1232, 2001. https://doi.org/10.1214/aos/1013203451

Gando, G.; Yamada, T.; Sato, H.; et al. (2016); Fine-tuning deep convolutional neural networks for distinguishing illustrations from photographs, Expert Systems with Applications, 66, 295-301, 2016. https://doi.org/10.1016/j.eswa.2016.08.057

Goodfellow, I.; Bengio, Y.; Courville, A. (2016); Deep Learning, The MIT Press, 2016.

Gupta, V.; Lehal, G.S. (2009); A survey of text mining techniques and applications, Journal of Emerging Technologies in Web Intelligence, 1(1), 60-76, 2009.

Hinton, G.E. (1986); Learning distributed representations of concepts, In Proceedings of the 8th Annual Conference of the Cognitive Science Society, August 15-17, Hillsdale, Canada, 1-12, 1986.

Hochreiter, S.; Schmidhuber, J. (1997); Long short-term memory, Neural Computation, 9(8), 1735-1780, 1997. https://doi.org/10.1162/neco.1997.9.8.1735

Hubel, D.H.; Wiesel, T.N. (1962); Receptive fields, binocular interaction and functional architecture in the cat's visual cortex, The Journal of Physiology, 160(1), 106-154, 1962. https://doi.org/10.1113/jphysiol.1962.sp006837

Ijjina, E. P.; Chalavadi, K.M. (2016); Human action recognition using genetic algorithms and convolutional neural networks, Pattern Recognition, 59, 199-212, 2016. https://doi.org/10.1016/j.patcog.2016.01.012

Li, F.F.; Wang, H.T.; Zhao, R.C.; et al. (2017); Chinese micro-blog sentiment classification through a novel hybrid learning model, Journal of Central South University, 24(10), 2322- 2330, 2017. https://doi.org/10.1007/s11771-017-3644-0

Li, N.; Wu, D.D. (2010); Using text mining and sentiment analysis for online forums hotspot detection and forecast, Decision Support Systems, 48(2), 354-368, 2010. https://doi.org/10.1016/j.dss.2009.09.003

Li, Y.C.; Nie, X.Q.; Huang, R. (2018); Web spam classification method based on deep belief networks, Expert Systems with Applications, 96, 261-270, 2018. https://doi.org/10.1016/j.eswa.2017.12.016

Liu, L.; Peng, T. (2014); Clustering-based method for positive and unlabeled text categorization enhanced by improved TFIDF, Journal of Information Science and Engineering, 30(5), 1463-1481, 2014.

Mou, L.C.; Ghamisi, P.; Zhu, X.X. (2018); Unsupervised spectral-spatial feature learning via deep residual conv-deconv network for hyperspectral image classification, IEEE Transactions on Geoscience and Remote Sensing, 56(1), 391-406, 2018. https://doi.org/10.1109/TGRS.2017.2748160

Nair, V.; Hinton, G.E. (2010); Rectified linear units improve restricted boltzmann machines, In Proceedings of the 27th International Conference on Machine Learning (ICML-10), June 21-24, Haifa, Israel, 807-814, 2010.

Price, K.V. (1996); Differential evolution: a fast and simple numerical optimizer, In Proceedings of the North American Fuzzy Information Processing Society, June 19-22, New York, USA, 524-527, 1996. https://doi.org/10.1109/NAFIPS.1996.534790

Quinlan, J.R. (1987); Simplifying decision trees, International Journal of Man-machine Studies, 27(3), 221-234, 1987. https://doi.org/10.1016/S0020-7373(87)80053-6

Sabbah, T.; Selamat, A.; Selamat, M.H.; et al. (2017); Modified frequency-based term weighting schemes for text classification, Applied Soft Computing, 58, 193-206, 2017. https://doi.org/10.1016/j.asoc.2017.04.069

Socher, R.; Perelygin, A.; Wu, J.; et al. (2013); Recursive deep models for semantic compositionality over a sentiment treebank, In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, October 18-21, Seattle, USA, 1631-1642, 2013.

Sun, X.; Li, C.C.; Ren, F.J. (2016); Sentiment analysis for Chinese microblog based on deep neural networks with convolutional extension features, Neurocomputing, 210, 227-236, 2016. https://doi.org/10.1016/j.neucom.2016.02.077

Suykens, J.A.; Vandewalle, J. (1999); Least squares support vector machine classifiers, Neural Processing Letters, 9(3), 293-300, 1999. https://doi.org/10.1023/A:1018628609742

Trivedi, A.; Srivastava, S.; Mishra, A.; et al. (2018); Hybrid evolutionary approach for devanagari handwritten numeral recognition using convolutional neural network, Procedia Computer Science, 125, 525-532, 2018. https://doi.org/10.1016/j.procs.2017.12.068

Wang, P.; Xu, B.; Xu, J.M.; et al. (2016); Semantic expansion using word embedding clustering and convolutional neural network for improving short text classification, Neurocomputing, 174, 806-814, 2016. https://doi.org/10.1016/j.neucom.2015.09.096

Zhang, W.; Zhang, Z.; Chao, H.C.; et al. (2018); Kernel mixture model for probability density estimation in Bayesian classifiers, Data Mining and Knowledge Discovery, 32(3), 675-707, 2018. https://doi.org/10.1007/s10618-018-0550-5

Zhang, W.; Zhang, Z.; Qi, D.; et al. (2014); Automatic crack detection and classification method for subway tunnel safety monitoring, Sensors, 14(10), 19307-19328, 2014. https://doi.org/10.3390/s141019307

Zhou, Y.; Li, Y.W.; Xia, S.X. (2009); An improved KNN text classification algorithm based on clustering, Journal of Computers, 4(3), 230-237, 2009.

Published

2019-02-14

Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.