Object detection driven composite block motion estimation algorithm for surveillance video coding.

Saved in:
Bibliographic Details
Title: Object detection driven composite block motion estimation algorithm for surveillance video coding.
Authors: Kumar Pal, Arup1 (AUTHOR) arupkrpal@iitism.ac.in, Biswas, Bhaskar1 (AUTHOR), Digamber Jichkar, Mihir1 (AUTHOR), Nandan Jena, Adarsh1 (AUTHOR), Kumar, Manish1 (AUTHOR)
Source: Multimedia Tools & Applications. Sep2025, Vol. 84 Issue 32, p39719-39746. 28p.
Subjects: Motion estimation (Signal processing), Video compression, Deep learning, Object recognition (Computer vision), Motion analysis, Video coding, Computer vision, Video surveillance
Abstract: The accurate estimation of motion in video sequences is a critical task in various computer vision applications, such as video compression, video surveillance, and autonomous navigation. Block matching is a popular motion estimation method through which we find the best match between blocks of pixels in consecutive frames. However, using a single block matching algorithm for the entire frame may be inefficient, especially when dealing with dynamic scenes containing moving objects. In this paper, we propose a novel approach for motion estimation using composite block-matching algorithms based on object detection. Our method first detects the moving objects in the video frame using a deep learning-based object detection algorithm. Then, we use one block-matching algorithm for the area of the frame where the objects are detected and another block-matching algorithm for the remaining part of the frame. The rationale behind using two different algorithms is that the area containing the objects has more complex motion patterns and may require a more sophisticated and rigorous algorithm than the rest of the frame. Our results show that the proposed method achieves higher accuracy and faster processing time compared to any single motion estimation method. The proposed composite block matching algorithm provides more accurate motion estimation in the object regions, leading to better object tracking and fewer motion artefacts. Moreover, using a simpler block-matching algorithm for the non-object regions reduces computational overhead, making the overall process more efficient for compressing surveillance video. [ABSTRACT FROM AUTHOR]
Copyright of Multimedia Tools & Applications is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
Description
Abstract:The accurate estimation of motion in video sequences is a critical task in various computer vision applications, such as video compression, video surveillance, and autonomous navigation. Block matching is a popular motion estimation method through which we find the best match between blocks of pixels in consecutive frames. However, using a single block matching algorithm for the entire frame may be inefficient, especially when dealing with dynamic scenes containing moving objects. In this paper, we propose a novel approach for motion estimation using composite block-matching algorithms based on object detection. Our method first detects the moving objects in the video frame using a deep learning-based object detection algorithm. Then, we use one block-matching algorithm for the area of the frame where the objects are detected and another block-matching algorithm for the remaining part of the frame. The rationale behind using two different algorithms is that the area containing the objects has more complex motion patterns and may require a more sophisticated and rigorous algorithm than the rest of the frame. Our results show that the proposed method achieves higher accuracy and faster processing time compared to any single motion estimation method. The proposed composite block matching algorithm provides more accurate motion estimation in the object regions, leading to better object tracking and fewer motion artefacts. Moreover, using a simpler block-matching algorithm for the non-object regions reduces computational overhead, making the overall process more efficient for compressing surveillance video. [ABSTRACT FROM AUTHOR]
ISSN:13807501
DOI:10.1007/s11042-025-20722-4