Text Classification of Public Feedbacks using Convolutional Neural Network Based on Differential Evolution Algorithm
Keywords:
public feedback, deep learning, text classification, convolutional neural network, differential evolution algorithmAbstract
Online feedback is an effective way of communication between government departments and citizens. However, the daily high number of public feedbacks has increased the burden on government administrators. The deep learning method is good at automatically analyzing and extracting deep features of data, and then improving the accuracy of classification prediction. In this study, we aim to use the text classification model to achieve the automatic classification of public feedbacks to reduce the work pressure of administrator. In particular, a convolutional neural network model combined with word embedding and optimized by differential evolution algorithm is adopted. At the same time, we compared it with seven common text classification models, and the results show that the model we explored has good classification performance under different evaluation metrics, including accuracy, precision, recall, and F1-score.References
Bai, D.D.; Wang, C.Q.; Zhang, B.; et al. (2018); Sequence searching with CNN features for robust and fast visual place recognition, Computers & Graphics, 70, 270-280, 2018. https://doi.org/10.1016/j.cag.2017.07.019
Bishop, C.M. (1995); Neural Networks for Pattern Recognition, Oxford University Press, UK, 1995.
Breiman, L. (2001); Random forests, Machine Learning, 45(1), 5-32, 2001. https://doi.org/10.1023/A:1010933404324
Chau, R.N.; Yeh, C.S.; Smith, K.A. (2005); A neural network model for hierarchical multilingual text categorization, In Proceedings of the 2nd International Symposium on Neural Networks, May 30-June 1, Chongqing, China, 238-245, 2005.
Chen, J.N.; Huang, H.K.; Tian, S.F.; et al. (2009); Feature selection for text classification with Naive Bayes, Expert Systems with Applications, 36(3), 5432-5435, 2009. https://doi.org/10.1016/j.eswa.2008.06.054
Dai, Y.; Wu, W.; Zhou, H.B.; et al. (2018); Numerical simulation and optimization of oil jet lubrication for rotorcraft meshing gears, International Journal of Simulation Modelling, 17(2), 318-326, 2018. https://doi.org/10.2507/IJSIMM17(2)CO6
Dai, Y.; Zhu, X.; Zhou, H.; et al. (2018); Trajectory tracking control for seafloor tracked vehicle by adaptive neural-fuzzy inference system algorithm, International Journal of Computers Communications & Control, 13(4), 465-476, 2018. https://doi.org/10.15837/ijccc.2018.4.3267
Du, C.; Huang, L. (2018); Text classification research with attention-based recurrent neural networks, International Journal of Computers Communications & Control, 13(1), 50-61, 2018. https://doi.org/10.15837/ijccc.2018.1.3142
Duda, R.O.; Hart, P.E. (1973); Pattern Classification and Scene Analysis, Wiley, USA, 1973.
Ferreira, A.; Giraldi, G. (2017); Convolutional neural network approaches to granite tiles classification, Expert Systems with Applications, 84, 1-11, 2017. https://doi.org/10.1016/j.eswa.2017.04.053
Friedman, J.H. (2001); Greedy function approximation: a gradient boosting machine, Annals of Statistics, 29(5), 1189-1232, 2001. https://doi.org/10.1214/aos/1013203451
Gando, G.; Yamada, T.; Sato, H.; et al. (2016); Fine-tuning deep convolutional neural networks for distinguishing illustrations from photographs, Expert Systems with Applications, 66, 295-301, 2016. https://doi.org/10.1016/j.eswa.2016.08.057
Goodfellow, I.; Bengio, Y.; Courville, A. (2016); Deep Learning, The MIT Press, 2016.
Gupta, V.; Lehal, G.S. (2009); A survey of text mining techniques and applications, Journal of Emerging Technologies in Web Intelligence, 1(1), 60-76, 2009.
Hinton, G.E. (1986); Learning distributed representations of concepts, In Proceedings of the 8th Annual Conference of the Cognitive Science Society, August 15-17, Hillsdale, Canada, 1-12, 1986.
Hochreiter, S.; Schmidhuber, J. (1997); Long short-term memory, Neural Computation, 9(8), 1735-1780, 1997. https://doi.org/10.1162/neco.1997.9.8.1735
Hubel, D.H.; Wiesel, T.N. (1962); Receptive fields, binocular interaction and functional architecture in the cat's visual cortex, The Journal of Physiology, 160(1), 106-154, 1962. https://doi.org/10.1113/jphysiol.1962.sp006837
Ijjina, E. P.; Chalavadi, K.M. (2016); Human action recognition using genetic algorithms and convolutional neural networks, Pattern Recognition, 59, 199-212, 2016. https://doi.org/10.1016/j.patcog.2016.01.012
Li, F.F.; Wang, H.T.; Zhao, R.C.; et al. (2017); Chinese micro-blog sentiment classification through a novel hybrid learning model, Journal of Central South University, 24(10), 2322- 2330, 2017. https://doi.org/10.1007/s11771-017-3644-0
Li, N.; Wu, D.D. (2010); Using text mining and sentiment analysis for online forums hotspot detection and forecast, Decision Support Systems, 48(2), 354-368, 2010. https://doi.org/10.1016/j.dss.2009.09.003
Li, Y.C.; Nie, X.Q.; Huang, R. (2018); Web spam classification method based on deep belief networks, Expert Systems with Applications, 96, 261-270, 2018. https://doi.org/10.1016/j.eswa.2017.12.016
Liu, L.; Peng, T. (2014); Clustering-based method for positive and unlabeled text categorization enhanced by improved TFIDF, Journal of Information Science and Engineering, 30(5), 1463-1481, 2014.
Mou, L.C.; Ghamisi, P.; Zhu, X.X. (2018); Unsupervised spectral-spatial feature learning via deep residual conv-deconv network for hyperspectral image classification, IEEE Transactions on Geoscience and Remote Sensing, 56(1), 391-406, 2018. https://doi.org/10.1109/TGRS.2017.2748160
Nair, V.; Hinton, G.E. (2010); Rectified linear units improve restricted boltzmann machines, In Proceedings of the 27th International Conference on Machine Learning (ICML-10), June 21-24, Haifa, Israel, 807-814, 2010.
Price, K.V. (1996); Differential evolution: a fast and simple numerical optimizer, In Proceedings of the North American Fuzzy Information Processing Society, June 19-22, New York, USA, 524-527, 1996. https://doi.org/10.1109/NAFIPS.1996.534790
Quinlan, J.R. (1987); Simplifying decision trees, International Journal of Man-machine Studies, 27(3), 221-234, 1987. https://doi.org/10.1016/S0020-7373(87)80053-6
Sabbah, T.; Selamat, A.; Selamat, M.H.; et al. (2017); Modified frequency-based term weighting schemes for text classification, Applied Soft Computing, 58, 193-206, 2017. https://doi.org/10.1016/j.asoc.2017.04.069
Socher, R.; Perelygin, A.; Wu, J.; et al. (2013); Recursive deep models for semantic compositionality over a sentiment treebank, In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, October 18-21, Seattle, USA, 1631-1642, 2013.
Sun, X.; Li, C.C.; Ren, F.J. (2016); Sentiment analysis for Chinese microblog based on deep neural networks with convolutional extension features, Neurocomputing, 210, 227-236, 2016. https://doi.org/10.1016/j.neucom.2016.02.077
Suykens, J.A.; Vandewalle, J. (1999); Least squares support vector machine classifiers, Neural Processing Letters, 9(3), 293-300, 1999. https://doi.org/10.1023/A:1018628609742
Trivedi, A.; Srivastava, S.; Mishra, A.; et al. (2018); Hybrid evolutionary approach for devanagari handwritten numeral recognition using convolutional neural network, Procedia Computer Science, 125, 525-532, 2018. https://doi.org/10.1016/j.procs.2017.12.068
Wang, P.; Xu, B.; Xu, J.M.; et al. (2016); Semantic expansion using word embedding clustering and convolutional neural network for improving short text classification, Neurocomputing, 174, 806-814, 2016. https://doi.org/10.1016/j.neucom.2015.09.096
Zhang, W.; Zhang, Z.; Chao, H.C.; et al. (2018); Kernel mixture model for probability density estimation in Bayesian classifiers, Data Mining and Knowledge Discovery, 32(3), 675-707, 2018. https://doi.org/10.1007/s10618-018-0550-5
Zhang, W.; Zhang, Z.; Qi, D.; et al. (2014); Automatic crack detection and classification method for subway tunnel safety monitoring, Sensors, 14(10), 19307-19328, 2014. https://doi.org/10.3390/s141019307
Zhou, Y.; Li, Y.W.; Xia, S.X. (2009); An improved KNN text classification algorithm based on clustering, Journal of Computers, 4(3), 230-237, 2009.
Published
Issue
Section
License
ONLINE OPEN ACCES: Acces to full text of each article and each issue are allowed for free in respect of Attribution-NonCommercial 4.0 International (CC BY-NC 4.0.
You are free to:
-Share: copy and redistribute the material in any medium or format;
-Adapt: remix, transform, and build upon the material.
The licensor cannot revoke these freedoms as long as you follow the license terms.
DISCLAIMER: The author(s) of each article appearing in International Journal of Computers Communications & Control is/are solely responsible for the content thereof; the publication of an article shall not constitute or be deemed to constitute any representation by the Editors or Agora University Press that the data presented therein are original, correct or sufficient to support the conclusions reached or that the experiment design or methodology is adequate.
