A Neural Network Classification Model Based on Covering and Immune Clustering Algorithm

Fang Zhao

Abstract


Inspired by the information processing mechanism of the human brain, the artificial neural network (ANN) is a classic data mining method and a powerful soft computing technique. The ANN provides a valuable tool for information processing and pattern recognition, thanks to its advantages in distributed storage, parallel processing, fast problem-solving and adaptive learning. The constructive neural network (CNN) is a popular emerging neural network model suitable for processing largescale data. In this paper, a novel neural network classification model was established based on the covering algorithm (CA) and the immune clustering algorithm (ICA). The CA is highly comprehensible, and enjoys fast computing speed, and high recognition rate. However, the learning effect of this algorithm is rather poor, because the training set is randomly selected from the original data, and the number of nodes (covering number) and area being covered are greatly affected by the learning sequence. To solve the problem, the ICA was introduced to preprocess the data samples, and calculate the cluster centers based on the antibody-antigen affinity. The CA and the ICA work together to determine the covering center and radius automatically, and convert them into the weights and thresholds of the hidden layer of neural network. The number of hidden layer neurons equals the number of covering. In addition, the McCulloch-Pitts (M-P) neurons were adopted for the output layer. Based on the input feature of the hidden layer, the output feature completes the mapping from input to output, creating the final classes of the original data. The introduction of the ICA fully solves the defect of the CA. Finally, our neural network classification model was verified through experiments on real-world datasets.

Keywords


Artificial neural network (ANN), covering algorithm (CA), immune clustering algorithm (ICA), constructive neural network (CNN)

Full Text:

PDF

References


Al-Enezi, J. R., Abbod, M. F., Alsharhan, S. (2010)

Artificial immune systems-models, algorithms and applications, International Journal of Research & Reviews in Applied Sciences, 3(2), 118-131, 2010.

Chen, G.C.; Yu, J.S. (2005); Particle swarm optimization neural network and its application in soft-sening modeling, Advances in Natural Computation, 3611, 610-617, 2005.
https://doi.org/10.1007/11539117_86

Choubey, H.; Pandey, A. (2018); Classification of healthy, inter-ictal and seizure signal using various classification techniques, Traitement du Signal, 35(1), 75-84, 2018.
https://doi.org/10.3166/ts.35.75-84

Gao, H.; Gao, L.; Zhou, C.; Yu, D. (2004); Particle swarm optimization based algorithm for neural network learning, Chinese Journal of Electronics, 32(9), 1572-1574, 2004.

Hruschka, E.R.; Campello, R.J.G.B.; Freitas, A.A. (2009); A survey of evolutionary algorithms for clustering, IEEE Transactions on Systems Man & Cybernetics Part C, 39(2), 133-155, 2009.
https://doi.org/10.1109/TSMCC.2008.2007252

Huang, Z. (1998); Extension to the k-means algorithm for clustering large data sets with categorical values, Data Mining and Knowledge Discovery, 2(3), 283-304, 1998.
https://doi.org/10.1023/A:1009769707641

Kaufman, L.; Rousseeuw, P.J. (1990); Finding Group in Data: An Introduction to Cluster Analysis, New York: John Wiley & Sons, 1990.
https://doi.org/10.1002/9780470316801

Lai, J.Z.C.; Huang, T.J.; Liaw, Y.C. (2009); A fast -means clustering algorithm using cluster center displacement, Pattern Recognition, 42(11), 2551-2556, 2009.
https://doi.org/10.1016/j.patcog.2009.02.014

Li, H.; Ding, S.F. (2013); A novel neural network classification model based on covering and affinity propagation clustering algorithm, Journal of Computational Information Systems, 9(7), 2565-2573, 2013.

Malim, M.R.; Halim, F.A. (2013); Immunology and artificial immune systems, International Journal on Artificial Intelligence Tools, 21(06), 1250031-1-1250031-27, 2013.
https://doi.org/10.1142/S0218213012500315

Mostefa, T.; Tarak, B.; Hachemi, G. (2018); An automatic diagnosis method for an open switch fault in unified power quality conditioner based on artificial neural network, Traitement du Signal, 35(1), 7-21, 2018.
https://doi.org/10.3166/ts.35.7-21

Ng, A.Y.; Jordan, M.I.; Weiss, Y. (2002); On spectral clustering: Analysis and an algorithm, Proceedings of Advances in Neural Information Processing Systems, 14, 849-856, 2002.

Nunes, L.; Jose, F.; Zuben, V. (2001); An artificial immune network for data analysis, In Data Mining: A Heuristic Approach, 2001.

Qian, X.; Wang, X. (2009); A New study of DSS based on neural network and data mining, International Conference on E-Business and Information System Security, 1-4, 2009.
https://doi.org/10.1109/EBISS.2009.5137883

Salajegheh, E.; Gholizadeh, S. (2005); Optimum design of structures by an improved genetic algorithm using neural networks, Advances in Engineering Software, 36(11-12), 757-767, 2005.
https://doi.org/10.1016/j.advengsoft.2005.03.022

Strikwerda, C. (2008); The danger theory and its application to artificial immune systems, University of Kent at Canterbury, 114-148, 2008.

Tang, C.; Cao, X. (2001); The research development of evolutionary neural networks, Systems Engineering and Electronics, 23(10), 92-97, 2001.

Wang, L.W.; Tan, Y.; Zhang, L. (2005); Constructive fuzzy neural networks and its application, Advance in Neural Network-ISNN2005, 3497, 440-445, 2005.
https://doi.org/10.1007/11427391_70

Wang, L.W.; Wu, Y.H.; Tan, Y.; Zhang, L. (2006); A modified constructive Fuzzy Neural Networks for classification of large-scale and complicated data, Advance in Neural Network- ISNN2006, 3972, 14-19, 2006.
https://doi.org/10.1007/11760023_3

Watkins, A.; Timmis, J.; Boggess, L. (2004); Artificial immune recognition system (AIRS), an immune-inspired supervised learning algorithm, Genetic Programming and Evolvable Machines, 5(3), 291-317, 2018.
https://doi.org/10.1023/B:GENP.0000030197.83685.94

Yao, W.; Wang, Q.; Chen, Z.; Wang, J. (2004); The research overview of evolutionary neural network, Computer Science, 31(3), 125-129, 2004.

Ye, S.Z.; Zhang, B.; Wu, M.R.; Zheng, W.B. (2003); Fuzzy classifier based on the constructive covering approach in neural networks, Journal of Software, 14(3), 429-434, 2003.

Zhang, B.; Zhang, L. (1992); Theory and Applications of Problem Solving, North-Holland, Amsterdam, 1992.

Zhang, L.; Zhang, B. (1999); A geometrical representation of mcCullochpitts neural model and its applications, IEEE Transactions on Neural Networks, 10, 925-929, 1999.
https://doi.org/10.1109/72.774263




DOI: https://doi.org/10.15837/ijccc.2020.1.3739



Copyright (c) 2020 Fang Zhao

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

IJCCC is an Open Access Journal : CC-BY-NC.

Articles published in IJCCC user license are protected by copyright.

Users can access, download, copy, translate the IJCCC articles for non-commercial purposes provided that users, but cannot redistribute, display or adapt:

  • Cite the article using an appropriate bibliographic citation: author(s), article title, journal, volume, issue, page numbers, year of publication, DOI, and the link to the definitive published version on IJCCC website;
  • Maintain the integrity of the IJCCC article;
  • Retain the copyright notices and links to these terms and conditions so it is clear to other users what can and what cannot be done with the  article;
  • Ensure that, for any content in the IJCCC article that is identified as belonging to a third party, any re-use complies with the copyright policies of that third party;
  • Any translations must prominently display the statement: "This is an unofficial translation of an article that appeared in IJCCC. Agora University  has not endorsed this translation."

This is a non commercial license where the use of published articles for commercial purposes is forbiden. 

Commercial purposes include: 

  • Copying or downloading IJCCC articles, or linking to such postings, for further redistribution, sale or licensing, for a fee;
  • Copying, downloading or posting by a site or service that incorporates advertising with such content;
  • The inclusion or incorporation of article content in other works or services (other than normal quotations with an appropriate citation) that is then available for sale or licensing, for a fee;
  • Use of IJCCC articles or article content (other than normal quotations with appropriate citation) by for-profit organizations for promotional purposes, whether for a fee or otherwise;
  • Use for the purposes of monetary reward by means of sale, resale, license, loan, transfer or other form of commercial exploitation;

    The licensor cannot revoke these freedoms as long as you follow the license terms.

[End of CC-BY-NC  License for Website User]


INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL (IJCCC), With Emphasis on the Integration of Three Technologies (C & C & C),  ISSN 1841-9836.

IJCCC was founded in 2006,  at Agora University, by  Ioan DZITAC (Editor-in-Chief),  Florin Gheorghe FILIP (Editor-in-Chief), and  Misu-Jan MANOLESCU (Managing Editor).

Ethics: This journal is a member of, and subscribes to the principles of, the Committee on Publication Ethics (COPE).

Ioan  DZITAC (Editor-in-Chief) at COPE European Seminar, Bruxelles, 2015:

IJCCC is covered/indexed/abstracted in Science Citation Index Expanded (since vol.1(S),  2006); JCR2018: IF=1.585..

IJCCC is indexed in Scopus from 2008 (CiteScore2018 = 1.56):

Nomination by Elsevier for Journal Excellence Award Romania 2015 (SNIP2014 = 1.029): Elsevier/ Scopus

IJCCC was nominated by Elsevier for Journal Excellence Award - "Scopus Awards Romania 2015" (SNIP2014 = 1.029).

IJCCC is in Top 3 of 157 Romanian journals indexed by Scopus (in all fields) and No.1 in Computer Science field by Elsevier/ Scopus.

 

 Impact Factor in JCR2018 (Clarivate Analytics/SCI Expanded/ISI Web of Science): IF=1.585 (Q3). Scopus: CiteScore2018=1.56 (Q2);

SCImago Journal & Country Rank

Editors-in-Chief: Ioan DZITAC & Florin Gheorghe FILIP.