Search Region-Guided Adaptive Template Update for Robust Multi-Modal UAV Tracking.
Saved in:
| Title: | Search Region-Guided Adaptive Template Update for Robust Multi-Modal UAV Tracking. |
|---|---|
| Authors: | Liu, Lei1,2 (AUTHOR), Li, Qi2 (AUTHOR), Lv, Jiaxin1,2 (AUTHOR), Wang, Jiaxiang1,2 (AUTHOR) 2024117@aust.edu.cn |
| Source: | Remote Sensing. Jun2026, Vol. 18 Issue 11, p1817. 23p. |
| Subjects: | Object tracking (Computer vision), Thresholding algorithms, Computer memory management |
| Abstract: | Highlights: What are the main findings? We propose GTUTrack, a search region-guided adaptive template update framework for robust multi-modal UAV tracking, which jointly performs adaptive template selection, thresholding, and memory management. GTUTrack achieves state-of-the-art performance on VTUAV and also shows strong generalization on RGBT210, RGBT234, and LasHeR under challenging conditions such as occlusion, illumination variation, and scale change. What are the implications of the main findings? The results show that template update in multi-modal UAV tracking should be conditioned on the current search region rather than relying on fixed update intervals and manually designed thresholds. The proposed framework provides an effective solution for robust target tracking in UAV remote sensing and other multi-modal surveillance scenarios with complex appearance variation and modality discrepancy. Existing multi-modal UAV tracking methods typically rely on fixed-interval dynamic template update strategies to capture diverse target appearances, together with predefined thresholds to select high-quality search regions for template update. However, due to the irregular motion of targets and the complexity of real-world scenarios, such passive update mechanisms suffer from notable limitations. Fixed sampling intervals often fail to adequately capture appearance variations, while fixed threshold-based selection is insufficient to accommodate diverse imaging conditions, leading to ineffective updates or the introduction of noisy templates, thereby degrading tracking robustness and accuracy. To address these issues, we propose a search region-guided adaptive dynamic template update framework for robust multi-modal UAV tracking, aiming to improve both scene adaptability and target matching capability. Specifically, we design a Guided Template Selection Transformer, which dynamically matches templates conditioned on the current search region, enabling the tracker to autonomously select the most suitable template for the target's current state. Furthermore, we introduce a Dynamic Threshold Module that adaptively adjusts template selection criteria according to different tracking scenarios, ensuring the reliability and contextual relevance of candidate templates. In addition, we develop a Dynamic Template Memory Module to maintain an ordered repository of target templates under different target states, providing a structured and high-quality template pool for the proposed selection mechanism. Extensive experiments on a standard multi-modal UAV tracking benchmark demonstrate that the proposed method significantly outperforms existing approaches, effectively overcoming the limitations of conventional fixed update strategies. Moreover, the proposed approach exhibits strong generalization capability across three additional multi-modal tracking datasets from typical surveillance scenarios. [ABSTRACT FROM AUTHOR] |
| Copyright of Remote Sensing is the property of MDPI and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | Highlights: What are the main findings? We propose GTUTrack, a search region-guided adaptive template update framework for robust multi-modal UAV tracking, which jointly performs adaptive template selection, thresholding, and memory management. GTUTrack achieves state-of-the-art performance on VTUAV and also shows strong generalization on RGBT210, RGBT234, and LasHeR under challenging conditions such as occlusion, illumination variation, and scale change. What are the implications of the main findings? The results show that template update in multi-modal UAV tracking should be conditioned on the current search region rather than relying on fixed update intervals and manually designed thresholds. The proposed framework provides an effective solution for robust target tracking in UAV remote sensing and other multi-modal surveillance scenarios with complex appearance variation and modality discrepancy. Existing multi-modal UAV tracking methods typically rely on fixed-interval dynamic template update strategies to capture diverse target appearances, together with predefined thresholds to select high-quality search regions for template update. However, due to the irregular motion of targets and the complexity of real-world scenarios, such passive update mechanisms suffer from notable limitations. Fixed sampling intervals often fail to adequately capture appearance variations, while fixed threshold-based selection is insufficient to accommodate diverse imaging conditions, leading to ineffective updates or the introduction of noisy templates, thereby degrading tracking robustness and accuracy. To address these issues, we propose a search region-guided adaptive dynamic template update framework for robust multi-modal UAV tracking, aiming to improve both scene adaptability and target matching capability. Specifically, we design a Guided Template Selection Transformer, which dynamically matches templates conditioned on the current search region, enabling the tracker to autonomously select the most suitable template for the target's current state. Furthermore, we introduce a Dynamic Threshold Module that adaptively adjusts template selection criteria according to different tracking scenarios, ensuring the reliability and contextual relevance of candidate templates. In addition, we develop a Dynamic Template Memory Module to maintain an ordered repository of target templates under different target states, providing a structured and high-quality template pool for the proposed selection mechanism. Extensive experiments on a standard multi-modal UAV tracking benchmark demonstrate that the proposed method significantly outperforms existing approaches, effectively overcoming the limitations of conventional fixed update strategies. Moreover, the proposed approach exhibits strong generalization capability across three additional multi-modal tracking datasets from typical surveillance scenarios. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 20724292 |
| DOI: | 10.3390/rs18111817 |
