A Multi-Level Cross-Modal Edge Filtering Method for High-Resolution Optical-SAR Image Registration.
Saved in:
| Title: | A Multi-Level Cross-Modal Edge Filtering Method for High-Resolution Optical-SAR Image Registration. |
|---|---|
| Authors: | Lan, Jinghong1 (AUTHOR), Ye, Ziqi1,2 (AUTHOR), Li, Rui1,3 (AUTHOR), Qiu, Kunpeng1,3 (AUTHOR), Li, Peixuan1,2 (AUTHOR), Guo, Xiaorong1,3 (AUTHOR), Hu, Fengming1 (AUTHOR) fm_hu@fudan.edu.cn |
| Source: | Remote Sensing. Jun2026, Vol. 18 Issue 11, p1741. 32p. |
| Subjects: | Image registration, Speckle interference, Remote sensing, High resolution imaging, Random forest algorithms, Edge detection (Image processing), Image denoising |
| Geographic Terms: | China |
| Abstract: | Highlights: What are the main findings? We construct a large-scale, high-resolution optical–SAR registration dataset, pairing 3-m SAR imagery from the HongTu-1 satellite with Google Earth optical imagery at zoom level 17, covering the major geographical regions of China, and we release the standardized pipeline—including full-scene pairing, DEM-based terrain correction, geometric refinement, standardized 512 × 512 slicing and multi-stage quality filtering—that was used to build it. Our proposed Log-domain reformulation of the Total Variation (Log-TV) filter substantially improves SAR image preprocessing by converting the multiplicative speckle noise model into an additive one, thereby enabling effective suppression of speckle while preserving edge structures and providing a much cleaner foundation for subsequent keypoint detection. Combining a machine learning-based edge filter (Structured Random Forest, SRF) with the hand-crafted phase congruency filter yields a strong synergistic effect for cross-modal optical–SAR edge filtering, producing more stable and consistent shared structural responses than either component alone. What are the implications of the main findings? Large-scale, high-resolution optical–SAR datasets are both essential and scarce for registration and other downstream tasks. Only on larger and more complex benchmarks do the robustness and the true relative performance of competing algorithms become evident, making such datasets a necessary foundation for future research in this area. Different imaging modalities require different filtering strategies: for heavily speckled data such as SAR imagery, regularisation in the logarithmic domain is more appropriate than directly applying denoisers designed for additive noise, highlighting the importance of modality-aware preprocessing in cross-modal registration. Hybrid pipelines that integrate learning-based components with hand-crafted filters are a promising direction: beyond edge filtering, similar combinations of deep features and classical hand-crafted operators may also benefit cross-modal feature description and matching stages. Optical and Synthetic Aperture Radar (SAR) image registration is a fundamental task in remote sensing information fusion, yet it remains challenging due to significant differences in imaging mechanisms, radiation characteristics, and noise properties between the two modalities. Existing public datasets suffer from limited resolution, small scale, and insufficient scene diversity, and these limitations have hindered algorithm development. This paper constructs a large-scale, high-resolution optical–SAR registration dataset based on the HongTu-1 satellite 3-m SAR imagery and Google Earth optical imagery at zoom level 17, covering diverse scenes across China with a standardized pipeline including terrain correction, geometric alignment, standardized slicing, and quality filtering. Building upon this dataset, a hand-crafted keypoint-based cross-modal registration method is proposed, incorporating multi-level edge filtering and hybrid feature detection. Unlike conventional hand-crafted methods such as RIFT, SRIF, and LNIFT, which mainly refine keypoint detection, description, or matching within a SIFT-style pipeline, the core novelty of this work lies in SAR-specific preprocessing and multi-level hybrid filtering. These components are designed to suppress speckle while extracting more stable and discriminative shared edge responses for cross-modal registration. An improved Log-domain Total Variation (Log-TV) denoising model is introduced for SAR preprocessing. A hybrid edge filtering framework combining phase congruency analysis and Structured Random Forest (SRF) edge detection is constructed within a Gaussian scale space. A dual-branch feature detection scheme integrating blob and corner features is designed with a robust orientation assignment strategy. Feature description uses the Gradient Location–Orientation Histogram (GLOH) descriptor with Principal Component Analysis (PCA) reduction, while geometric estimation employs the Fast Sample Consensus (FSC) algorithm. Experiments on the self-constructed HT dataset and on the public OSdataset and SAR2Opt benchmarks show that the proposed method consistently achieves low RMSE and high success rates. It also maintains competitive efficiency among hand-crafted methods while retaining strong robustness to scale and rotation variations. [ABSTRACT FROM AUTHOR] |
| Copyright of Remote Sensing is the property of MDPI and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | Highlights: What are the main findings? We construct a large-scale, high-resolution optical–SAR registration dataset, pairing 3-m SAR imagery from the HongTu-1 satellite with Google Earth optical imagery at zoom level 17, covering the major geographical regions of China, and we release the standardized pipeline—including full-scene pairing, DEM-based terrain correction, geometric refinement, standardized 512 × 512 slicing and multi-stage quality filtering—that was used to build it. Our proposed Log-domain reformulation of the Total Variation (Log-TV) filter substantially improves SAR image preprocessing by converting the multiplicative speckle noise model into an additive one, thereby enabling effective suppression of speckle while preserving edge structures and providing a much cleaner foundation for subsequent keypoint detection. Combining a machine learning-based edge filter (Structured Random Forest, SRF) with the hand-crafted phase congruency filter yields a strong synergistic effect for cross-modal optical–SAR edge filtering, producing more stable and consistent shared structural responses than either component alone. What are the implications of the main findings? Large-scale, high-resolution optical–SAR datasets are both essential and scarce for registration and other downstream tasks. Only on larger and more complex benchmarks do the robustness and the true relative performance of competing algorithms become evident, making such datasets a necessary foundation for future research in this area. Different imaging modalities require different filtering strategies: for heavily speckled data such as SAR imagery, regularisation in the logarithmic domain is more appropriate than directly applying denoisers designed for additive noise, highlighting the importance of modality-aware preprocessing in cross-modal registration. Hybrid pipelines that integrate learning-based components with hand-crafted filters are a promising direction: beyond edge filtering, similar combinations of deep features and classical hand-crafted operators may also benefit cross-modal feature description and matching stages. Optical and Synthetic Aperture Radar (SAR) image registration is a fundamental task in remote sensing information fusion, yet it remains challenging due to significant differences in imaging mechanisms, radiation characteristics, and noise properties between the two modalities. Existing public datasets suffer from limited resolution, small scale, and insufficient scene diversity, and these limitations have hindered algorithm development. This paper constructs a large-scale, high-resolution optical–SAR registration dataset based on the HongTu-1 satellite 3-m SAR imagery and Google Earth optical imagery at zoom level 17, covering diverse scenes across China with a standardized pipeline including terrain correction, geometric alignment, standardized slicing, and quality filtering. Building upon this dataset, a hand-crafted keypoint-based cross-modal registration method is proposed, incorporating multi-level edge filtering and hybrid feature detection. Unlike conventional hand-crafted methods such as RIFT, SRIF, and LNIFT, which mainly refine keypoint detection, description, or matching within a SIFT-style pipeline, the core novelty of this work lies in SAR-specific preprocessing and multi-level hybrid filtering. These components are designed to suppress speckle while extracting more stable and discriminative shared edge responses for cross-modal registration. An improved Log-domain Total Variation (Log-TV) denoising model is introduced for SAR preprocessing. A hybrid edge filtering framework combining phase congruency analysis and Structured Random Forest (SRF) edge detection is constructed within a Gaussian scale space. A dual-branch feature detection scheme integrating blob and corner features is designed with a robust orientation assignment strategy. Feature description uses the Gradient Location–Orientation Histogram (GLOH) descriptor with Principal Component Analysis (PCA) reduction, while geometric estimation employs the Fast Sample Consensus (FSC) algorithm. Experiments on the self-constructed HT dataset and on the public OSdataset and SAR2Opt benchmarks show that the proposed method consistently achieves low RMSE and high success rates. It also maintains competitive efficiency among hand-crafted methods while retaining strong robustness to scale and rotation variations. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 20724292 |
| DOI: | 10.3390/rs18111741 |
