Review and Performance Comparison of Pansharpening Algorithms for RASAT Images

Year 2018, Volume: 18 Issue: 1, 109 - 120, 23.02.2018

Sevcan Kahraman Alp Ertürk

Abstract

This study presents the
most extensive performance comparison of pansharpening methodologies by
considering 17 pansharpening algorithms that are applied to the satellite
images obtained from RASAT, which is the first earth observation satellite
designed and manufactured in Turkey. Standard and state-of-the-art
pansharpening approaches from various categories, such as component substitution
(CS), modulation based (MB), multiresolution analysis (MRA), and hybrid and
variational methods, are included in order to gain a better insight and perform
a thorough analysis of the performance of various pansharpening methods. The
experimental validation procedure was designed according to Wald's protocol,
and the performance evaluations were conducted both qualitatively and
quantitatively on the basis of seven quantitative evaluation criteria.

Keywords

RASAT, pansharpening, performance, review

References

• 1. A. Garzelli, F. Nencini, L. Alparone, B. Aiazzi, and S. Baronti, “Pan-sharpening of multispectral images: a critical review and comparison,” IGARSS IEEE International Geoscience and Remote Sensing Symposium, vol.1, pp.81-84, 2004. 2. C. Thomas, T. Ranchin, L Wald and J. Chanussot, “Synthesis of multispectral images to high spatial resolution: A critical review of fusion methods based on bemote sensing physics,” IEEE Transactions on Geoscience and Remote Sensing, vol. 46, pp. 1301 - 1312, 2008. 3. Y. Zhang and. R. K. Mishra, “A review and comparison of commercially available pan-sharpening techniques for high resolution satellite image fusion,” IEEE International Geoscience and Remote Sensing Symposium, pp. 182-185, 2012. 4. J. Marcello, A. Medina F. Eugenio, “Evaluation of spatial and spectral effectiveness of pixel-level fusion techniques,” IEEE Geoscience and Remote Sensing Letters, vol. 10, no. 3, pp. 432–436, 2013. 5. G. Vivone, L. Alparone, J. Chanussot, M. D. Mura, A. Garzelli, L. G. A. Licciardi, R. Restaino, L. Wald, “A critical comparison among pansharpening algorithms,” IEEE Transactions on Geoscience and Remote Sensing, vol. 53, no.5, pp. 2565-2586, 2015. 6. L. Loncan, L. B. de Almeida, J. M. Bioucas-Dias, X. Briottet, J. Chanussot, N. Dobigeon, S. Fabre, L. W. Liao, G. A. Licciardi, M. Simoes, T. J.Y. Tourneret, M. A. Veganzones, G. Vivone, Q. Wei and N. Yokoya, “Hyperspectral pansharpening: A review,” IEEE Geoscience and Remote Sensing Magazine, vol. 3, no. 3, pp. 27-46, 2015. 7. I. Amro, J. Mateos, M. Vega, R. Molina, A. K. Katsaggelos, “A survey of classical methods and new trends in pansharpening of multispectral images,” Journal on Advances in Signal Processing EURASIP, vol. 79, 2011. 8. A. D. Vaiopoulos, K. Karantzalos, “Pansharpening on the narrow VNIR and SWIR spectral bands of Sentinel-2”, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLI-B7, XXIII ISPRS Congress, 2016. 9. M. Teke, M. S. Seyfioğlu, A. Ağçal, S. Z. Gürbüz, “RASAT Uydu görüntülerinin optimal pankeskinleştirilmesi”, IEEE 22. Sinyal İşleme ve İletişim Uygulamaları Kurultayı (SIU), pp. 1967-1970, 2014. 10. İ. S. Açıkgöz, S., T. M. Teke, K. U. Kutbay, F. Hardalaç, “Performance evaluation of pansharpening methods on GPU for RASAT images”, 7th International Conference on Recent Advances in Space Technologies (RAST), pp. 283-288, 2015. 11. M. Teke, “Satellite image processing workflow for RASAT and Göktürk-2,” Journal of Aeronautics and Space Technologies, vol. 9 no. 1 pp. 1-13, 2016. 12. M. Özendi, H. Topan, A. Cam and Ç. Bayık, “RASAT ve GÖKTÜRK-2 görüntülerinin pankeskinleştirilmiş görüntü üretimi ve kalite değerlendirilmesi,” 6. Uzaktan Algılama-CBS Sempozyumu (UZAL-CBS 2016), pp. 447-453, 2016. 13. W. Dou, Y. Chen, X. Li, D. Z. Sui, “A general framework for component substitution image fusion: An implementation using the fast image fusion method”, Computational Geoscience, vol. 33 no.2, pp. 219–228, 2007. 14. B. Aiazzi, S. Baronti, M. Selva, “Improving Component Substitution Pansharpening through multivariate regression of MS+Pan data,” IEEE Transactions on Geoscience and Remote Sensing, vol. 45, no. 10, pp. 3230-3239, 2007. 15. T. M. Tu, S. C. Su, S. H. C. Shyu, P. S. Huang, “A new look at IHS-like image fusion methods,” Information Fusion, vol. 2, no. 3, pp. 177-186, 2001. 16. P. S. Chavez, Jr. S. C. Sides, J. A. Anderson, “Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic,” Photogramm. Eng. Remote Sens., vol. 57, no. 3, pp. 295–303, 1991. 17. C. A. Laben and B. V. Brower, “Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening,” U.S. Patent 6 011 875, 2000. 18. C. Padwick, M. Deskevich, F. Pacifici, S. Smallwood, “WorldView-2 pan-sharpening”, ASPRS Annual Conference, 2010. 19. G. U. G. Gangkofner, P. S. Pradhan, D. W. Holcomb, “Optimizing the high-pass filter addition technique for image fusion,” Photogramm. Eng. Remote Sens., vol. 74, no. 9, pp.1107-1118, 2008. 20. Y. Junghui, Z. Jixian, L. Haitao, S. Yushan, P. Pengxian, “Pixel level fusion methods for remote sensing images: A current review”, ISPRS TC VII Symposium, vol. 38, pp. 680-686, Vienna, Austria, 2010. 21. A. R. Gillespie, A. B. Kahle, R. E. Walker, “Color enhancement of highly correlated images—II. Channel ratio and “chromaticity” transform techniques,” Remote Sensing Env., vol. 22, no. 3, pp. 343-365, 1987. 22. J. G. Liu, “Smoothing filter-based intensity modulation: A spectral preserve image fusion technique for improving spatial details,” International Journal of Remote Sensing, vol. 21, no.18, pp. 3461–3472, 2000. 23. Y. Zhang, “A new merging method and its spectral and spatial effects,” International Journal of Remote Sensing, vol. 20, no. 10, pp. 2003–2014, 1999. 24. N. Yokoya, N. Mayumi, A. Iwasaki, “Cross-calibration for data fusion of EO-1 / Hyperion and Terra / ASTER,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 6, no. 2, pp. 419-426, 2013. 25. S. Baronti, B. Aiazzi, M. Selva, A. Garzelli, L. Alparone, “A theoretical analysis of the effects of aliasing and misregistration on pansharpened imagery,” IEEE Journal of Selected Topics in Signal Processing, vol. 5, no. 3, pp. 446-453, 2011. 26. F. Murtagh, S. J.L. Starck, A. Bijaoui, “Image restoration with noise suppression using a multiresolution support,” Astronomy and Astrophysics supplement series, vol. 112, pp.179-189, 1995. 27. J. Nunez, X. Otazu, O. Fors, A. Prades, V. Pala, R. Arbiol, “Multiresolution-based image fusion with additive wavelet decomposition,” IEEE Transactions on Geoscience and Remote Sensing, vol. 37, no. 3, pp. 1204-1211, 1999. 28. P. Burt and E. Adelson, “The Laplacian Pyramid as compact image code,” IEEE Transactions on Communications, vol. 31, no. 4, pp. 532 - 540, 1983. 29. S. Baronti, A. Casini, F. Lotti, L. Alparone, “Context-driven differential encoding of an enhanced image pyramid,” Signal Processing Image Communication, vol. 6, pp. 463-469, 1994. 30. B. Aiazzi, S. Baronti, L. Alparone, A. Garzelli, M. Selva, “Advantages of Laplacian pyramids over ‘’à trous’’ wavelet transforms for pansharpening of multispectral images,” Proceedings of SPIE-The International Society for Optical Engineering, 2012. 31. B. Aiazzi, A. L. Alparone, S. Baronti, A. Garzelli, “Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis,” IEEE Transactions on Geoscience and Remote Sensing, vol. 40, no. 10, pp. 2300-2312, 2002. 32. B. Aiazzi, L. Alparone, S. Baronti, A. Garzelli, M. Selva, “MTF-tailored multiscale fusion of high resolution MS and Pan imagery,” Photogramm. Eng. Remote Sens., vol. 72, no. 5, pp. 591–596, 2006. 33. J. Lee and C. Lee, “Fast and efficient panchromatic sharpening,” IEEE Trans. Geosci. Remote Sens., vol. 48, no. 1, pp. 155–163, Jan. 2010. 34. Y. Chibani and A. Houacine, “The joint use of IHS transform and redundant wavelet decomposition for fusing multispectral and panchromatic images,” International Journal of Remote Sensing, vol. 23, no. 18, pp. 3821–3833, 2002. 35. S. Klonus and M. Ehlers, “Image fusion using the Ehlers spectral characteristics preservation algorithm,” GIScience & Remote Sensing, vol. 44, no.2, pp. 93-116, 2007. 36. C. Ballester, V. Caselles, L. Igual, J. Verdera, B. Rougé, “A variational model for P+XS image fusion”, International Journal of Computer Vision, vol. 69, no. 1, pp. 43–58, 2006. 37. L. Alparone, B. Aiazzi, S. Baronti, A. Garzelli, F. Nencini and M. Selva, “Multispectral and panchromatic data fusion assessment without reference,” Photogrammetric Engineering & Remote Sensing, vol. 74, no. 2, pp. 193-200, Feb. 2008.