journal article·2023-01-31Open access

A SqueeSAR Spatially Adaptive Filtering Algorithm Based on Hadoop Distributed Cluster Environment

Yongning Li, Weiwei Song, Baoxuan Jin, Xiaoqing Zuo, Yongfa Li, Kai Chen

Applied Sciences· Volume 13· Issue 3

Abstract

Multi-temporal interferometric synthetic aperture radar (MT-InSAR) techniques analyze a study area using a set of SAR image data composed of time series, reaching millimeter surface subsidence accuracy. To effectively acquire the subsidence information in low-coherence areas without obvious features in non-urban areas, an MT-InSAR technique, called SqueeSAR, is proposed to improve the density of the subsidence points in the study area by fusing the distributed scatterers (DS). However, SqueeSAR filters the DS points individually during spatial adaptive filtering, which requires significant computer memory, which leads to low processing efficiency, and faces great challenges in large-area InSAR processing. We propose a spatially adaptive filtering parallelization strategy based on the Spark distributed computing engine in a Hadoop distributed cluster environment, which splits the different DS pixel point data into different computing nodes for parallel processing and effectively improves the filtering algorithm’s performance. To evaluate the effectiveness and accuracy of the proposed method, we conducted a performance evaluation and accuracy verification in and around the main city of Kunming with the original Sentinel-1A SLC data provided by ESA. Additionally, parallel calculation was performed in a YARN cluster comprising three computing nodes, which improved the performance of the filtering algorithm by a factor of 2.15, without affecting the filtering accuracy.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Synthetic Aperture Radar (SAR) Applications and Techniques · Soil Moisture and Remote Sensing · Cryospheric studies and observations

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Land Resources Engineering, Kunming University of Science and Technology, Kunming 650093, China

Department of Natural Resources of Yunnan Province, Kunming 650224, China

Funding

National Natural Science Foundation of China · Yunnan Province Key Research and Development Program

References (54)

Show source-provided references
1. Permanent scatterers in SAR interferometry10.1109/36.898661 ↗
2. A new algorithm for surface deformation monitoring based on small baseline differential SAR interferograms10.1109/TGRS.2002.803792 ↗
3. A multi-temporal InSAR method incorporating both persistent scatterer and small baseline approaches10.1029/2008GL034654 ↗
4. A small-baseline approach for investigating deformations on full-resolution differential SAR interferograms10.1109/TGRS.2004.828196 ↗
5. A new method for measuring deformation on volcanoes and other natural terrains using InSAR persistent scatterers10.1029/2004GL021737 ↗
6. Joint-Scatterer Processing for Time-Series InSAR10.1109/TGRS.2014.2309346 ↗
7. CAESAR: An Approach Based on Covariance Matrix Decomposition to Improve Multibaseline–Multitemporal Interferometric SAR Processing10.1109/TGRS.2014.2352853 ↗
8. Mapping landslide surface displacements with time series SAR interferometry by combining persistent and distributed scatterers: A case study of Jiaju landslide in Danba, China10.1016/j.rse.2017.11.022 ↗
9. Homogeneous pixel selection algorithm for multitemporal InSAR
10. Change detection from synthetic aperture radar images based on channel weighting-based deep cascade network10.1109/JSTARS.2019.2953128 ↗
11. Chen, H., and Shi, Z. (2020). A spatial-temporal attention-based method and a new dataset for remote sensing image change detection. Remote Sens., 12.10.3390/rs12101662 ↗
12. Efficient SAR Imaging Integrated With Autofocus via Compressive Sensing
13. A New Algorithm for Processing Interferometric Data-Stacks: SqueeSAR10.1109/TGRS.2011.2124465 ↗
14. Research progress and methods of InSAR for deformation monitoring
15. Urban infrastructure health monitoring with spaceborne multi-temporal synthetic aperture radar interferometry
16. An Improved Coherent Targets Technology for Monitoring Surface Deformation
17. The Kolmogorov-Smirnov test for goodness of fit10.1080/01621459.1951.10500769 ↗
18. SBAS-DInSAR Parallel Processing for Deformation Time-Series Computation10.1109/JSTARS.2014.2322671 ↗
19. A First Assessment of the P-SBAS DInSAR Algorithm Performances Within a Cloud Computing Environment10.1109/JSTARS.2015.2426054 ↗
20. An On-Demand Web Tool for the Unsupervised Retrieval of Earth’s Surface Deformation from SAR Data: The P-SBAS Service within the ESA G-POD Environment
21. Cloud Computing for Earth Surface Deformation Analysis via Spaceborne Radar Imaging: A Case Study10.1109/TCC.2015.2440267 ↗
22. A Cloud Computing Solution for the Efficient Implementation of the P-SBAS DInSAR Approach10.1109/JSTARS.2016.2598397 ↗
23. Large areas surface deformation analysis through a cloud computing P-SBAS approach for massive processing of DInSAR time series10.1016/j.rse.2017.05.022 ↗
24. Duan, W., Zhang, H., Wang, C., and Tang, Y. (2020). Multi-Temporal InSAR Parallel Processing for Sentinel-1 Large-Scale Surface Deformation Mapping. Remote Sens., 12.10.3390/rs12223749 ↗
25. Tang, Y., Wang, C., Zhang, H., You, H., Zhang, W., Duan, W., Wang, J., and Dong, L. (2021, January 25). Parallel CS-InSAR for Mapping Nationwide Deformation in China. Proceedings of the 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, Brussels, Belgium.10.1109/IGARSS47720.2021.9553545 ↗
26. Airborne SAR real-time imaging algorithm design and implementation with CUDA on NVIDIA GPU
27. Parallel processing of InSAR interferogram filtering with CUDA programming
28. A Fast Search Algorithm for SqueeSAR Distributed Scatterers in the Problem of Calculating Displacement Velocities10.1134/S0361768821060062 ↗
29. Combined Minimum Discontinuity Phase Unwrapping Based on Clusters
30. Understanding the Performance and Potential of Cloud Computing for Scientific Applications10.1109/TCC.2015.2404821 ↗
31. White, T. (2012). Hadoop: The Definitive Guide, O’Reilly Media, Inc.
32. Zaharia, M., Chowdhury, M., Franklin, M.J., Shenker, S., and Stoica, I. (2010, January 22–25). Spark: Cluster computing with working sets. Proceedings of the 2nd USENIX conference on Hot topics in cloud computing, Boston, MA, USA.
33. Ibrahim, S., Jin, H., Lu, L., Wu, S., and Shi, X. (2009, January 1–4). Evaluating MapReduce on Virtual Machines: The Hadoop Case. Proceedings of the Cloud Computing, First International Conference, CloudCom 2009, Beijing, China.10.1007/978-3-642-10665-1_47 ↗
34. Clash of the titans: MapReduce vs. Spark for large scale data analytics10.14778/2831360.2831365 ↗
35. Design and analysis of cloud platform for landslide monitoring in Heifangtai, Gansu province based on GPS and InSAR data
36. In-Memory Parallel Processing of Massive Remotely Sensed Data Using an Apache Spark on Hadoop YARN Model10.1109/JSTARS.2016.2547020 ↗
37. Design of landslide monitoring cloud platform based on cloud computing technology: Taking Jingyang as an example
38. Li, Z., Su, D., Zhu, H., Li, W., Zhang, F., and Li, R. (2017). A Fast Synthetic Aperture Radar Raw Data Simulation Using Cloud Computing. Sens. Multidiscip. Digit. Publ. Inst., 17.10.3390/s17010113 ↗
39. Vavilapalli, V.K., Murthy, A.C., Douglas, C., Agarwal, S., Konar, M., Evans, R., Graves, T., Lowe, J., Shah, H., and Seth, S. (2013, January 1–3). Apache Hadoop YARN: Yet another resource negotiator. Proceedings of the 4th Annual Symposium on Cloud Computing, Santa Clara, CA, USA.10.1145/2523616.2523633 ↗
40. Sadashiv, N., and Kumar, S.M.D. (2011, January 3–5). Cluster, grid and cloud computing: A detailed comparison. Proceedings of the 2011 6th International Conference on Computer Science Education (ICCSE), Singapore.10.1109/ICCSE.2011.6028683 ↗
41. Review of research and application on Hadoop in cloud computing
42. Big Data Analytics in the Cloud: Spark on Hadoop vs MPI/OpenMP on Beowulf10.1016/j.procs.2015.07.286 ↗
43. HDFS architecture guide
44. Big Data and cloud computing: Innovation opportunities and challenges10.1080/17538947.2016.1239771 ↗
45. Verma, A., Mansuri, A.H., and Jain, N. (2016, January 18–19). Big data management processing with Hadoop MapReduce and spark technology: A comparison. Proceedings of the 2016 Symposium on Colossal Data Analysis and Networking (CDAN), Indore, India.10.1109/CDAN.2016.7570891 ↗
46. Pan, F., Yue, Y., Xiong, J., and Hao, D. (2014, January 1). I/O characterization of big data workloads in data centers. Proceedings of the Workshop on Big Data Benchmarks, Performance Optimization, and Emerging Hardware, Salt Lake City, UT, USA.10.1007/978-3-319-13021-7_7 ↗
47. iMapReduce: A distributed computing framework for iterative computation10.1007/s10723-012-9204-9 ↗
48. Kambatla, K., and Chen, Y. (2014, January 9–14). The Truth About {MapReduce} Performance on {SSDs}. Proceedings of the 28th Large Installation System Administration Conference (LISA14), Seattle, WA, USA.
49. Large scale graph data processing on cloud computing environments
50. Application of dual-polarized Sentinel-1 data to subsidence monitoring in Kunming
51. The Study on Land Subsidence in Kunming by Integrating PS, SBAS and DS InSAR
52. Early identification of potential landslide geohazards in alpine-canyon terrain based on SAR interferometry—A case study of the middle section of Yalong river
53. Marinkovic, P.S., Hanssen, R.F., and Kampes, B.M. (2004, January 6–10). Utilization of parallelization algorithms in InSAR/PS-InSAR processing. Proceedings of the Envisat & ERS Symposium, Salzburg, Austria.
54. Hooper, A., Spaans, K., Bekaert, D., Cuenca, M.C., Arıkan, M., and Oyen, A. (2010). StaMPS/MTI Manual, Delft Institute of Earth Observation and Space Systems Delft University of Technology.