Fused LISS IV Image Classification using Deep Convolution Neural Networks

Authors

  • K. Uma Maheswari University College of Engineering, Ramanathapuram, India
  • S. Rajesh Mepco Schlenk Engineering College (Autonomous), Sivakasi, India

DOI:

https://doi.org/10.15837/ijccc.2022.5.4521

Keywords:

Image Fusion, Discrete Contourlet Transform, Image Classification, Remote Sensing Images, Quantization Index Modulation, Deep Convolution Neural Networks

Abstract

These days, earth observation frameworks give a large number of heterogeneous remote sensing information. The most effective method to oversee such fulsomeness in utilizing its reciprocity is a vital test in current remote sensing investigation. Considering optical Very High Spatial Resolution (VHSR) images, satellites acquire both Multi Spectral (MS) and panchromatic (PAN) images at various spatial goals. Information fusion procedures manage this by proposing a technique to consolidate reciprocity among the various information sensors. Classification of remote sensing image by Deep learning techniques using Convolutional Neural Networks (CNN) is increasing a solid decent footing because of promising outcomes. The most significant attribute of CNN-based strategies is that earlier element extraction is not required which prompts great speculation capacities. In this article, we are proposing a novel Deep learning based SMDTR-CNN (Same Model with Different Training Round with Convolution Neural Network) approach for classifying fused (LISS IV + PAN) image next to image fusion. The fusion of remote sensing images from CARTOSAT-1 (PAN image) and IRS P6 (LISS IV image) sensor is obtained by Quantization Index Modulation with Discrete Contourlet Transform (QIM-DCT). For enhancing the image fusion execution, we remove specific commotions utilizing Bayesian channel by Adaptive Type-2 Fuzzy System. The outcomes of the proposed procedures are evaluated with respect to precision, classification accuracy and kappa coefficient. The results revealed that SMDTR-CNN with Deep Learning got the best all-around precision and kappa coefficient. Likewise, the accuracy of each class of fused images in LISS IV + PAN dataset is improved by 2% and 5%, respectively.

References

Nataliia Kussul, Mykola Lavreniuk, Sergii Skakun, and Andrii Shelestov IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, "Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data "VOL. 14, NO. 5, MAY 2017

https://doi.org/10.1109/LGRS.2017.2681128

R. Khatami, G. Mountrakis, and S. V. Stehman, "A meta-analysis of remote sensing research on supervised pixel-based land-cover image classification processes: General guidelines for practitioners and future research," Remote Sens. Environ., vol. 177, pp. 89-100, May 2016.

https://doi.org/10.1016/j.rse.2016.02.028

Y. Chen, Z. Lin, X. Zhao, G.Wang, and Y. Gu, "Deep learning-based classification of hyperspectral data," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 7, no. 6, pp. 2094-2107, Jun. 2014.

https://doi.org/10.1109/JSTARS.2014.2329330

4. Yue, J., Zhao, W., Mao, S., & Liu, H. (2015). Spectral-spatial classification of hyperspectral images using deep convolutional neural networks. Remote Sensing Letters, 6(6), 468-477.

https://doi.org/10.1080/2150704X.2015.1047045

Chen, Y., Z. Lin, X. Zhao, G. Wang, and G. Yanfeng. 2014. "Deep Learning-Based Classification of Hyperspectral Data." IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 7 (6): 2094-2107.

https://doi.org/10.1109/JSTARS.2014.2329330

Wenzhi Zhao and Shihong Du, 2016, "Spectral-Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach" IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, VOL. 54, NO. 8, AUGUST 2016

https://doi.org/10.1109/TGRS.2016.2543748

Wenzhi Zhao, Shihong Du, "Learning multiscale and deep representations for classifying remotely sensed imagery", ISPRS Journal of Photogrammetry and Remote Sensing 113 (2016) 155-165

https://doi.org/10.1016/j.isprsjprs.2016.01.004

Kai Zhang , Feng Zhang and Shuyuan Yang," Fusion of Multispectral and Panchromatic Images via SpatialWeighted Neighbor Embedding", Remote Sens. 2019, 11, 557.

https://doi.org/10.3390/rs11050557

Yalan Zheng , Qinling Dai, Zhigang Tu and Leiguang Wang , "Guided Image Filtering-Based Pan-Sharpening Method: A Case Study of GaoFen-2 Imagery", ISPRS Int. J. Geo-Inf. 2017, 6, 404

https://doi.org/10.3390/ijgi6120404

S. Rajesh, T. Gladima Nisia, S. Arivazhagan and R. Abisekaraj, "Land Cover/Land Use Mapping of LISS IV Imagery Using Object-Based Convolutional Neural Network with Deep Features", Journal of the Indian Society of Remote Sensing, 48 (145-154), 2020.

https://doi.org/10.1007/s12524-019-01064-9

K. Uma Maheswari and S. Rajesh, "A novel QIM-DCT based fusion approach for classification of remote sensing images via PSO and SVM models", Soft Computing, 24(15561-15576), 2020.

https://doi.org/10.1007/s00500-020-04884-x

R. Prabhu , B. Parvathavarthini & R. A. Alagu Raja, "Slum Extraction from High Resolution Satellite Data using Mathematical Morphology based approach", INTERNATIONAL JOURNAL OF REMOTE SENSIN 2021, VOL. 42, NO. 1, 172-190.

https://doi.org/10.1080/01431161.2020.1834167

Rajesh S, Arivazhagan S, Pratheep Moses K (2012a) Land cover/land use mapping using different wavelet packet transforms for LISSIV. J Indian Soc Remote Sens 40(2):313-324

https://doi.org/10.1007/s12524-011-0154-7

Rajesh S, Arivazhagan S, Pratheep Moses K (2012b) Genetic algorithm based feature subset selection for land cover/land use mapping using wavelet packet transform. J Indian Soc Remote Sens 41(2):237-248

https://doi.org/10.1007/s12524-012-0208-5

Rajesh S, Arivazhagan S, Pradeep Moses K, Abisekaraj R (2014) ANFIS based Land cover/land use mapping of LISS IV imagery using optimized wavelet packet features. J Indian Soc Remote Sens 42(2):267-277.

https://doi.org/10.1007/s12524-013-0276-1

JagalingamPushparaj, ArkalVittalHegde (2016) Evaluation of PAN-Sharpening Methods for Spatial and Spectral Quality, Applied Geomatics, Vol. 9, No.1, PP. 1-12

https://doi.org/10.1007/s12518-016-0179-2

Jian Cheng, Haijun Liu, Ting Liu, Feng Wang, Hongsheng Li, (2015) Remote Sensing Image Fusion via Wavelet Transform and Sparse Representation, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 104, PP. 158- 173

https://doi.org/10.1016/j.isprsjprs.2015.02.015

JinyingZhong, Bin Yang, Guoyu Huang, FeiZhong, Zhongze Chen, (2016) Remote Sensing Image Fusion with Convolutional Neural Network, Sensing and Imaging, Vol. 17, No. 10, PP. 1-16

https://doi.org/10.1007/s11220-016-0135-6

JyotiSarup, AkinchanSinghai, (2011) Image Fusion Techniques for Accurate Classification of Remote Sensing Data, International Journal of Geometics and Geosciences, Vol. 2, No. 2, PP. 602-613.

Ava Vali, Sara Comai and Matteo Matteucci, "Deep Learning for Land Use and Land Cover Classification Based on Hyperspectral and Multispectral Earth Observation Data: A Review", Remote Sensing, 2020, 12, 2495, pp. 1-31.

https://doi.org/10.3390/rs12152495

Xiangyong Cao; Jing Yao; Zongben Xu; Deyu Meng, "Hyperspectral Image Classification With Convolutional Neural Network and Active Learning", IEEE Transactions on Geoscience and Remote Sensing, Volume: 58, Issue: 7, July 2020.

https://doi.org/10.1109/TGRS.2020.2964627

Wang, J, Zheng, Y, Wang, M, Shen, Q & Huang, J 2021, 'Object-Scale Adaptive Convolutional Neural Networks for High-Spatial Resolution Remote Sensing Image Classification', IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 14, pp. 283-299.

https://doi.org/10.1109/JSTARS.2020.3041859

Liu, Q, Kampffmeyer, M, Jenssen, R & Salberg, AB 2020, 'Dense Dilated Convolutions Merging Network for Land Cover Classification', IEEE Transactions on Geoscience and Remote Sensing, vol. 58, no. 9, pp. 6309-6320.

https://doi.org/10.1109/TGRS.2020.2976658

Zhang, LH, Deng, ZH & Wang, WB 2021, 'PM2.5 Concentration Prediction Based on Markov Blanke Feature Selection and Hybrid Kernel Support Vector Regression Optimized by Particle Swarm Optimization', Aerosol and Air Quality Research, vol. 21, no. 6, pp. 1-18.

https://doi.org/10.4209/aaqr.200144

Swathika, R & Sharmila, T. (2018). Image fusion for MODIS and Landsat images using top hat based moving technique with FIS. Cluster Computing, 22, 12939-12947.

https://doi.org/10.1007/s10586-018-1802-2

Roya Abedi, Amir Eslam Bonyad, Alireza Yousefi Moridani & Asadollah Shahbahrami (2018): Evaluation of IRS and Landsat 8 OLI imagery data for estimation forest attributes using k nearest neighbour non-parametric method, International Journal of Image and Data Fusion, PP. 1-12.

https://doi.org/10.1080/19479832.2018.1440439

S. K. Chaudhary, D. Kumar & M. K. Jain (2016) Performance analysis of hyperspherical colour sharpening method for IRS satellite images, The Imaging Science Journal, Vol. 64, Issue. 6, PP. 305-312.

https://doi.org/10.1080/13682199.2016.1190898

M. Fallah Yakhdani , A. Azizi, (2010). Quality Assessment of Image Fusion Techniques for Multisensor High Resolution Satellite Images (Case Study: IRS-P5 and IRS-P6), ISPRS TC VII Symposium, PP. 1-6.

K. Venkateswaran, N. Kasthuri, K. Balakrishnan and K. Prakash, (2014). Contourlet-based Multiband Image Fusion for Improving Classification Accuracy in IRS LISS III Images, Advances in Intelligent Systems and Computing, Vol. 325, PP. 201-212

https://doi.org/10.1007/978-81-322-2135-7_23

Additional Files

Published

2022-09-29

Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.