journal article·2022-08-31Open access

A Multispectral and Panchromatic Images Fusion Method Based on Weighted Mean Curvature Filter Decomposition

Yuetao Pan, Danfeng Liu, Liguo Wang, Shishuai Xing, Jón Atli Benediktsson

Applied Sciences· Volume 12· Issue 17

Abstract

Since the hardware limitations of satellite sensors, the spatial resolution of multispectral (MS) images is still not consistent with the panchromatic (PAN) images. It is especially important to obtain the MS images with high spatial resolution in the field of remote sensing image fusion. In order to obtain the MS images with high spatial and spectral resolutions, a novel MS and PAN images fusion method based on weighted mean curvature filter (WMCF) decomposition is proposed in this paper. Firstly, a weighted local spatial frequency-based (WLSF) fusion method is utilized to fuse all the bands of a MS image to generate an intensity component IC. In accordance with an image matting model, IC is taken as the original α channel for spectral estimation to obtain a foreground and background images. Secondly, a PAN image is decomposed into a small-scale (SS), large-scale (LS) and basic images by weighted mean curvature filter (WMCF) and Gaussian filter (GF). The multi-scale morphological detail measure (MSMDM) value is used as the inputs of the Parameters Automatic Calculation Pulse Coupled Neural Network (PAC-PCNN) model. With the MSMDM-guided PAC-PCNN model, the basic image and IC are effectively fused. The fused image as well as the LS and SS images are linearly combined together to construct the last α channel. Finally, in accordance with an image matting model, a foreground image, a background image and the last α channel are reconstructed to acquire the final fused image. The experimental results on four image pairs show that the proposed method achieves superior results in terms of subjective and objective evaluations. In particular, the proposed method can fuse MS and PAN images with different spatial and spectral resolutions in a higher operational efficiency, which is an effective means to obtain higher spatial and spectral resolution images.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Image Fusion Techniques · Image Enhancement Techniques · Remote-Sensing Image Classification

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Information and Communication Engineering, Dalian Minzu University, Dalian 116600, China

Faculty of Electrical and Computer Engineering, University of Iceland, 107 Reykjavik, Iceland

Funding

Leading Talents Project of the State Ethnic Affairs Commission and National Natural Science Foundation of China

References (26)

Show source-provided references
1. Research of improved Gram-Schmidt image fusion algorithm based on IHS transform
2. Jelének, J., Kopačková, V., Koucká, L., and Mišurec, J. (2016). Testing a modified PCA-based sharpening approach for image fusion. Remote Sens., 8.10.3390/rs8100794 ↗
3. Improving component substitution pansharpening through multivariate regression of MS + Pan data10.1109/TGRS.2007.901007 ↗
4. A new adaptive component-substitution based satellite image fusion by using partial replacement10.1109/TGRS.2010.2051674 ↗
5. Robust band-dependent spatial-detail approaches for panchromatic sharpening10.1109/TGRS.2019.2906073 ↗
6. Remote sensing image fusion via wavelet transform and sparse representation10.1016/j.isprsjprs.2015.02.015 ↗
7. High quality multi-spectral and panchromatic image fusion technologies based on curvelet transform10.1016/j.neucom.2015.01.050 ↗
8. Pan, Y., Liu, D., Wang, L., Benediktsson, J.A., and Xing, S. (2022). A Pan-Sharpening Method with Beta-Divergence Non-Negative Matrix Factorization in Non-Subsampled Shear Transform Domain. Remote Sens., 14.10.3390/rs14122921 ↗
9. Fu, X., Lin, Z., Huang, Y., and Ding, X. (2019, January 15–20). A variational pan-sharpening with local gradient constraints. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.01051 ↗
10. Pan-sharpening based on multi-objective decision for multi-band remote sensing images10.1016/j.patcog.2021.108022 ↗
11. Khan, S.S., Ran, Q., Khan, M., and Ji, Z. (2019, January 11–13). Pan-sharpening framework based on laplacian sharpening with Brovey. Proceedings of the 2019 IEEE International Conference on Signal, Information and Data Processing (ICSIDP), Chongqing, China.10.1109/ICSIDP47821.2019.9173129 ↗
12. Pansharpening multispectral remote-sensing images with guided filter for monitoring impact of human behavior on environment10.1002/cpe.5074 ↗
13. Review of pulse-coupled neural networks10.1016/j.imavis.2009.06.007 ↗
14. Remote sensing image fusion via boundary measured dual-channel PCNN in multi-scale morphological gradient domain10.1109/ACCESS.2020.2977299 ↗
15. Zhang, J., Zhou, H., Wei, S., and Tan, W. (2019, January 7–9). Infrared polarization image fusion via multi-scale sparse representation and pulse coupled neural network. Proceedings of the AOPC 2019: Optical Sensing and Imaging Technology, Beijing, China.10.1117/12.2547563 ↗
16. A new automatic parameter setting method of a simplified PCNN for image segmentation10.1109/TNN.2011.2128880 ↗
17. A Closed-Form Solution to Natural Image Matting10.1109/TPAMI.2007.1177 ↗
18. Boundary finding based multi-focus image fusion through multi-scale morphological focus-measure10.1016/j.inffus.2016.09.006 ↗
19. Image quality measures and their performance10.1109/26.477498 ↗
20. Weighted mean curvature10.1016/j.sigpro.2019.06.020 ↗
21. (2019, October 24). US Gov, Available online: https://earthexplorer.usgs.gov/.
22. Comparison of pansharpening algorithms: Outcome of the 2006 GRS-S data-fusion contest10.1109/TGRS.2007.904923 ↗
23. On combining multiple features for hyperspectral remote sensing image classification10.1109/TGRS.2011.2162339 ↗
24. Fusion of high spatial and spectral resolution images: The ARSIS concept and its implementation
25. Chang, C.-I. (July, January 28). Spectral information divergence for hyperspectral image analysis. Proceedings of the IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS’99 (Cat. No.99CH36293), Hamburg, Germany.
26. Multispectral and panchromatic data fusion assessment without reference10.14358/PERS.74.2.193 ↗