A Neural Network Classification Model Based on Covering and Immune Clustering Algorithm
Keywords:
Artificial neural network (ANN), covering algorithm (CA), immune clustering algorithm (ICA), constructive neural network (CNN)Abstract
Inspired by the information processing mechanism of the human brain, the artificial neural network (ANN) is a classic data mining method and a powerful soft computing technique. The ANN provides a valuable tool for information processing and pattern recognition, thanks to its advantages in distributed storage, parallel processing, fast problem-solving and adaptive learning. The constructive neural network (CNN) is a popular emerging neural network model suitable for processing largescale data. In this paper, a novel neural network classification model was established based on the covering algorithm (CA) and the immune clustering algorithm (ICA). The CA is highly comprehensible, and enjoys fast computing speed, and high recognition rate. However, the learning effect of this algorithm is rather poor, because the training set is randomly selected from the original data, and the number of nodes (covering number) and area being covered are greatly affected by the learning sequence. To solve the problem, the ICA was introduced to preprocess the data samples, and calculate the cluster centers based on the antibody-antigen affinity. The CA and the ICA work together to determine the covering center and radius automatically, and convert them into the weights and thresholds of the hidden layer of neural network. The number of hidden layer neurons equals the number of covering. In addition, the McCulloch-Pitts (M-P) neurons were adopted for the output layer. Based on the input feature of the hidden layer, the output feature completes the mapping from input to output, creating the final classes of the original data. The introduction of the ICA fully solves the defect of the CA. Finally, our neural network classification model was verified through experiments on real-world datasets.References
Al-Enezi, J. R., Abbod, M. F., Alsharhan, S. (2010)
Artificial immune systems-models, algorithms and applications, International Journal of Research & Reviews in Applied Sciences, 3(2), 118-131, 2010.
Chen, G.C.; Yu, J.S. (2005); Particle swarm optimization neural network and its application in soft-sening modeling, Advances in Natural Computation, 3611, 610-617, 2005. https://doi.org/10.1007/11539117_86
Choubey, H.; Pandey, A. (2018); Classification of healthy, inter-ictal and seizure signal using various classification techniques, Traitement du Signal, 35(1), 75-84, 2018. https://doi.org/10.3166/ts.35.75-84
Gao, H.; Gao, L.; Zhou, C.; Yu, D. (2004); Particle swarm optimization based algorithm for neural network learning, Chinese Journal of Electronics, 32(9), 1572-1574, 2004.
Hruschka, E.R.; Campello, R.J.G.B.; Freitas, A.A. (2009); A survey of evolutionary algorithms for clustering, IEEE Transactions on Systems Man & Cybernetics Part C, 39(2), 133-155, 2009. https://doi.org/10.1109/TSMCC.2008.2007252
Huang, Z. (1998); Extension to the k-means algorithm for clustering large data sets with categorical values, Data Mining and Knowledge Discovery, 2(3), 283-304, 1998. https://doi.org/10.1023/A:1009769707641
Kaufman, L.; Rousseeuw, P.J. (1990); Finding Group in Data: An Introduction to Cluster Analysis, New York: John Wiley & Sons, 1990. https://doi.org/10.1002/9780470316801
Lai, J.Z.C.; Huang, T.J.; Liaw, Y.C. (2009); A fast -means clustering algorithm using cluster center displacement, Pattern Recognition, 42(11), 2551-2556, 2009. https://doi.org/10.1016/j.patcog.2009.02.014
Li, H.; Ding, S.F. (2013); A novel neural network classification model based on covering and affinity propagation clustering algorithm, Journal of Computational Information Systems, 9(7), 2565-2573, 2013.
Malim, M.R.; Halim, F.A. (2013); Immunology and artificial immune systems, International Journal on Artificial Intelligence Tools, 21(06), 1250031-1-1250031-27, 2013. https://doi.org/10.1142/S0218213012500315
Mostefa, T.; Tarak, B.; Hachemi, G. (2018); An automatic diagnosis method for an open switch fault in unified power quality conditioner based on artificial neural network, Traitement du Signal, 35(1), 7-21, 2018. https://doi.org/10.3166/ts.35.7-21
Ng, A.Y.; Jordan, M.I.; Weiss, Y. (2002); On spectral clustering: Analysis and an algorithm, Proceedings of Advances in Neural Information Processing Systems, 14, 849-856, 2002.
Nunes, L.; Jose, F.; Zuben, V. (2001); An artificial immune network for data analysis, In Data Mining: A Heuristic Approach, 2001.
Qian, X.; Wang, X. (2009); A New study of DSS based on neural network and data mining, International Conference on E-Business and Information System Security, 1-4, 2009. https://doi.org/10.1109/EBISS.2009.5137883
Salajegheh, E.; Gholizadeh, S. (2005); Optimum design of structures by an improved genetic algorithm using neural networks, Advances in Engineering Software, 36(11-12), 757-767, 2005. https://doi.org/10.1016/j.advengsoft.2005.03.022
Strikwerda, C. (2008); The danger theory and its application to artificial immune systems, University of Kent at Canterbury, 114-148, 2008.
Tang, C.; Cao, X. (2001); The research development of evolutionary neural networks, Systems Engineering and Electronics, 23(10), 92-97, 2001.
Wang, L.W.; Tan, Y.; Zhang, L. (2005); Constructive fuzzy neural networks and its application, Advance in Neural Network-ISNN2005, 3497, 440-445, 2005. https://doi.org/10.1007/11427391_70
Wang, L.W.; Wu, Y.H.; Tan, Y.; Zhang, L. (2006); A modified constructive Fuzzy Neural Networks for classification of large-scale and complicated data, Advance in Neural Network- ISNN2006, 3972, 14-19, 2006. https://doi.org/10.1007/11760023_3
Watkins, A.; Timmis, J.; Boggess, L. (2004); Artificial immune recognition system (AIRS), an immune-inspired supervised learning algorithm, Genetic Programming and Evolvable Machines, 5(3), 291-317, 2018. https://doi.org/10.1023/B:GENP.0000030197.83685.94
Yao, W.; Wang, Q.; Chen, Z.; Wang, J. (2004); The research overview of evolutionary neural network, Computer Science, 31(3), 125-129, 2004.
Ye, S.Z.; Zhang, B.; Wu, M.R.; Zheng, W.B. (2003); Fuzzy classifier based on the constructive covering approach in neural networks, Journal of Software, 14(3), 429-434, 2003.
Zhang, B.; Zhang, L. (1992); Theory and Applications of Problem Solving, North-Holland, Amsterdam, 1992.
Zhang, L.; Zhang, B. (1999); A geometrical representation of mcCullochpitts neural model and its applications, IEEE Transactions on Neural Networks, 10, 925-929, 1999. https://doi.org/10.1109/72.774263
Published
Issue
Section
License
ONLINE OPEN ACCES: Acces to full text of each article and each issue are allowed for free in respect of Attribution-NonCommercial 4.0 International (CC BY-NC 4.0.
You are free to:
-Share: copy and redistribute the material in any medium or format;
-Adapt: remix, transform, and build upon the material.
The licensor cannot revoke these freedoms as long as you follow the license terms.
DISCLAIMER: The author(s) of each article appearing in International Journal of Computers Communications & Control is/are solely responsible for the content thereof; the publication of an article shall not constitute or be deemed to constitute any representation by the Editors or Agora University Press that the data presented therein are original, correct or sufficient to support the conclusions reached or that the experiment design or methodology is adequate.
