A New Information Filling Technique Based On Generalized Information Entropy

Shan Han, Lin Chen, Zhi Zhang, Jianxun Li


Multi-sensor decision fusion used for discovering important facts hidden in a mass of data has become a widespread topic in recent years, and has been gradually applied in failure analysis, system evaluation and other fields of big data process. The solution to incompleteness is a key problem of decision fusion during the experiment and has been basically solved by proposed technique in this paper. Firstly, as a generalization of classical rough set, interval similarity relation is employed to classify not only single-valued data but also interval-valued data in the information systems. Then, a new kind of generalized information entropy called "H’-Information Entropy" is suggested based on interval similarity relation to measure the uncertainty and  the classification ability in the information systems. Thus, the innovated information filling technique using the properties of H’-Information Entropy can be applied to replace the missing data by some smaller estimation intervals. Finally, the feasibility and advantage of this technique are testified by two actual applications of decision fusion, whose performance is evaluated by the quantification of E-Condition Entropy.


Multi-Sensor Decision Fusion; Interval-Valued Information System; Generalized Information Entropy; Information Classification; Information Filling

Full Text:



Pawlak, Z.; Skowron, A. (2007); Rudiments of rough sets. Information Science, ISSN 0020- 0255, 177(1): 3-27.

Tay, F.E.H.; Shen, L.-X.(2003); Fault diagnosis based on rough set theory. Engineering Applications of Artificial Intelligence, ISSN 0952-1976, 16(1): 39-43.

Pawlak, Z.(1982); Rough sets. International Journal of Computer & Information Sciences, ISSN 0885-7458, 11(5): 341-356.

Kryszkiewicz, M.(1998); Rough Set Approach to Incomplete Information Systems. Information Sciences, ISSN 0020-0255, 112(1-4): 39-49.

Stefanowski, J.; Tsouki`as, A.(1999); On the Extension of Rough Sets under Incomplete Information. New Directions in Rough Sets, Data Mining, and Granular-Soft Computing, Lecture Notes in Computer Science, ISSN 0302-9743, 1711: 73-81.

Stefanowski, J.; Tsouki`as, A.(2001); Incomplete Information Tables and Rough Classification. Computational Intelligence, ISSN 0824-7935, 17(3): 545-566.

Wang, G.-Y.(2002); Extension of Rough Set Under Incomplete Information Systems. Journal of Computer Research and Development, ISSN 1000-1239, 39(10): 1238-1243.

Greco, S.; Matarazzo, B.; Slowinski, R.(1999); Rough Approximation of A Preference Relation By Dominance Relations. European Journal of Operational Research, ISSN 0377-2217, 117(1): 63-83.

Guan, Y.-Y.; Wang, H.-K.(2006); Set-valued information systems. Information Sciences, ISSN 0020-0255, 176(17): 2507-2525.

Leung, Y.; Wu, W.-Z.; Zhang, W.-X.(2006); Knowledge acquisition in incomplete information systems: A rough set approach. European Journal of Operational Research, ISSN 0377-2217, 168(1): 164-180.

Yang, X.-B.; Yu, D.-J.; Yang, J.-Y.; Song, X.-N.(2009); Difference Relation-Based Rough Set And Negative Rules In Incomplete Information System. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, ISSN 0218-4885, 17(5): 649-665.

Yang, X.-B.; Yu, D.-J.; Yang, J-Y.; Wei, L.-H.(2009); Dominance-based rough set approach to incomplete interval-valued information system. Data & Knowledge Engineering, ISSN 0169- 023X, 68(11): 1331-1347.

Zhao, L.; Zhang, X.; Xue, Z.(2011); Security Assessment for Incomplete Interval-valued Information System. Computer Engineering, ISSN 1000-3428, 37(11): 146-148.

Grzymala-Busse, J.W.; Stefanowski, J.(2001); Three Discretization Methods for Rule Induction. International Journal of Intelligent Systems, ISSN 1098-111X, 16(1): 29-38.

Beynon, M.J.(2004); Stability of continuous value discretisation: An application within rough set theory. International Journal of Approximate Reasoning, ISSN 0888-613X, 35(1): 29-53.

Leung, Y.; Fischer, M.-M.; Wu, W.-Z.; Mi, J.-S.(2008) A rough set approach for the discovery of classification rules in interval-valued information systems. International Journal of Approximate Reasoning, ISSN 0888-613X, 47(2): 233-246.

Yang, X.-B.; Yang, J.-Y.(2012); Incomplete Information System and Rough Set Theory- Models and Attribute Reductions, Springer- Verlag: Berlin, Heidelberg, ISBN 978-3-642- 25934-0.

Zhang, N.; Miao, D.-Q.; Yue, X.-D.(2010); Approaches to Knowledge Reduction in Interval- Valued Information Systems. Journal of Computer Research and Development, ISSN 1000- 1239, 47(8): 1362-1371.

Liang, J.-Y.; Qian, Y.-H.(2008); Information granules and entropy theory in information systems. Science in China Series F: Information Sciences, ISSN 1674-733X, 51(10): 1427- 1444.

D¨untsch, I.; Gediga, G.(1998); Uncertainty Measures of Rough Set Prediction. Artificial Intelligence, ISSN 0004-3702, 106(1): 109-137.

Wang, J.; Miao, D.-Q.(1998); Analysis on Attribute Reduction Strategies of Rough Set. Journal of Computer Science and Technology, ISSN 1000-9000, 13(2): 189-193.

Teng, S.-H.; Zhou, S.-L.; Sun, J.-X.; Li, Z.-Y.(2010); Attribute Reduction Algorithm Based on Conditional Entropy under Incomplete Information System. Journal of National University of Defense Technology, ISSN 1001-2486, 32(1): 90-94.

Liang, J.-Y.; Chin, K.S.; Dang, C.-Y.; Yam, R.C.M.(2002); A new method for measuring uncertainty and fuzziness in rough set theory. International Journal of General Systems, ISSN 0308-1079, 31(4): 331-342.

Xu, J.-C.; Sun, L.(2010); A New Knowledge Reduction Algorithm Based on Decision Power in Rough Set. Transactions on Rough Sets XII, Lecture Notes in Computer Science, ISSN 0302-9743, 6109: 76-89.

Li, F.; Yin, Y.-Q.(2009); Approaches to knowledge reduction of covering decision systems based on information theory. Information Sciences, ISSN 0020-0255, 179(11): 1694-1704.

DOI: https://doi.org/10.15837/ijccc.2014.2.54

Copyright (c) 2017 Shan Han, Lin Chen, Zhi Zhang, Jianxun Li

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

CC-BY-NC  License for Website User

Articles published in IJCCC user license are protected by copyright.

Users can access, download, copy, translate the IJCCC articles for non-commercial purposes provided that users, but cannot redistribute, display or adapt:

  • Cite the article using an appropriate bibliographic citation: author(s), article title, journal, volume, issue, page numbers, year of publication, DOI, and the link to the definitive published version on IJCCC website;
  • Maintain the integrity of the IJCCC article;
  • Retain the copyright notices and links to these terms and conditions so it is clear to other users what can and what cannot be done with the  article;
  • Ensure that, for any content in the IJCCC article that is identified as belonging to a third party, any re-use complies with the copyright policies of that third party;
  • Any translations must prominently display the statement: "This is an unofficial translation of an article that appeared in IJCCC. Agora University  has not endorsed this translation."

This is a non commercial license where the use of published articles for commercial purposes is forbiden. 

Commercial purposes include: 

  • Copying or downloading IJCCC articles, or linking to such postings, for further redistribution, sale or licensing, for a fee;
  • Copying, downloading or posting by a site or service that incorporates advertising with such content;
  • The inclusion or incorporation of article content in other works or services (other than normal quotations with an appropriate citation) that is then available for sale or licensing, for a fee;
  • Use of IJCCC articles or article content (other than normal quotations with appropriate citation) by for-profit organizations for promotional purposes, whether for a fee or otherwise;
  • Use for the purposes of monetary reward by means of sale, resale, license, loan, transfer or other form of commercial exploitation;

    The licensor cannot revoke these freedoms as long as you follow the license terms.

[End of CC-BY-NC  License for Website User]

INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL (IJCCC), With Emphasis on the Integration of Three Technologies (C & C & C),  ISSN 1841-9836.

IJCCC was founded in 2006,  at Agora University, by  Ioan DZITAC (Editor-in-Chief),  Florin Gheorghe FILIP (Editor-in-Chief), and  Misu-Jan MANOLESCU (Managing Editor).

Ethics: This journal is a member of, and subscribes to the principles of, the Committee on Publication Ethics (COPE).

Ioan  DZITAC (Editor-in-Chief) at COPE European Seminar, Bruxelles, 2015:

IJCCC is covered/indexed/abstracted in Science Citation Index Expanded (since vol.1(S),  2006); JCR2018: IF=1.585..

IJCCC is indexed in Scopus from 2008 (CiteScore2018 = 1.56):

Nomination by Elsevier for Journal Excellence Award Romania 2015 (SNIP2014 = 1.029): Elsevier/ Scopus

IJCCC was nominated by Elsevier for Journal Excellence Award - "Scopus Awards Romania 2015" (SNIP2014 = 1.029).

IJCCC is in Top 3 of 157 Romanian journals indexed by Scopus (in all fields) and No.1 in Computer Science field by Elsevier/ Scopus.


 Impact Factor in JCR2018 (Clarivate Analytics/SCI Expanded/ISI Web of Science): IF=1.585 (Q3). Scopus: CiteScore2018=1.56 (Q2);

SCImago Journal & Country Rank

Editors-in-Chief: Ioan DZITAC & Florin Gheorghe FILIP.