ViTrans: Inter-Frame Alignment Enhancement for Moving Vehicle Detection in Satellite Videos with Stabilization Offsets.

Saved in:
Bibliographic Details
Title: ViTrans: Inter-Frame Alignment Enhancement for Moving Vehicle Detection in Satellite Videos with Stabilization Offsets.
Authors: He, Tao1 (AUTHOR), Sun, Kaimin1,2 (AUTHOR) sunkm@whu.edu.cn, Duan, Yu1,3 (AUTHOR), Cui, Wei1 (AUTHOR), Wang, Ziang1,2 (AUTHOR), Gao, Song1,3 (AUTHOR), Yao, Yuan1,2 (AUTHOR), Chen, Zijie3 (AUTHOR)
Source: Remote Sensing. Sep2025, Vol. 17 Issue 17, p2973. 22p.
Subjects: Image registration, Image stabilization, Motion analysis, Image processing, Aerial surveillance, Object recognition (Computer vision)
Abstract: Satellite videos typically employ image registration techniques for video stabilization in order to achieve persistent observation. However, existing methods largely neglect the residual stabilization offsets, particularly when exceeding the physical dimensions of target vehicles, which inevitably causes performance degradation. Furthermore, the detection pipeline struggles with hard-to-discriminate samples that exhibit low contrast, motion blur, or occlusion, while conventional sample assignment strategies fail to address the inherent annotation ambiguity for extremely small objects. We propose an end-to-end method called ViTrans for detecting moving vehicles in satellite video under stabilization offsets. ViTrans consists of three core modules: (1) a feature-aligned stabilization offset correction module (SCM) that mitigates feature misalignment by aligning features between the reference frame and the current frame; (2) a feature adaptive aggregation enhancement module (AAEM) based on vehicle trajectory consistency, which leverages the motion characteristics of objects across consecutive frames to eliminate dynamic clutter and false-alarm artifacts; and (3) a Gaussian distribution-based metric that dynamically adapts to bounding box dimensions, thereby providing more accurate positive sample feedback during model training. Extensive experiments on the VISO and SDM-Car datasets under simulated stabilization offsets demonstrate that ViTrans achieves state-of-the-art performance, improving F1-score by 14.4% on VISO and 6.9% on SDM-Car over existing methods. [ABSTRACT FROM AUTHOR]
Copyright of Remote Sensing is the property of MDPI and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
Description
Abstract:Satellite videos typically employ image registration techniques for video stabilization in order to achieve persistent observation. However, existing methods largely neglect the residual stabilization offsets, particularly when exceeding the physical dimensions of target vehicles, which inevitably causes performance degradation. Furthermore, the detection pipeline struggles with hard-to-discriminate samples that exhibit low contrast, motion blur, or occlusion, while conventional sample assignment strategies fail to address the inherent annotation ambiguity for extremely small objects. We propose an end-to-end method called ViTrans for detecting moving vehicles in satellite video under stabilization offsets. ViTrans consists of three core modules: (1) a feature-aligned stabilization offset correction module (SCM) that mitigates feature misalignment by aligning features between the reference frame and the current frame; (2) a feature adaptive aggregation enhancement module (AAEM) based on vehicle trajectory consistency, which leverages the motion characteristics of objects across consecutive frames to eliminate dynamic clutter and false-alarm artifacts; and (3) a Gaussian distribution-based metric that dynamically adapts to bounding box dimensions, thereby providing more accurate positive sample feedback during model training. Extensive experiments on the VISO and SDM-Car datasets under simulated stabilization offsets demonstrate that ViTrans achieves state-of-the-art performance, improving F1-score by 14.4% on VISO and 6.9% on SDM-Car over existing methods. [ABSTRACT FROM AUTHOR]
ISSN:20724292
DOI:10.3390/rs17172973