Dynamic video summarization using handcrafted features to complement publicly available datasets.
Saved in:
| Title: | Dynamic video summarization using handcrafted features to complement publicly available datasets. |
|---|---|
| Authors: | Solatidehkordi, Zahra1 (AUTHOR), Shanableh, Tamer1 (AUTHOR) tshanableh@aus.edu |
| Source: | Multimedia Tools & Applications. Nov2025, Vol. 84 Issue 37, p46457-46478. 22p. |
| Subjects: | Video summarization, Motion estimation (Signal processing), Data integration |
| Abstract: | In video summarization, four datasets (TvSum, SumMe, OVP, and YouTube) are typically used for training and testing. In this study, we supplement these datasets with novel features based on High Efficiency Video Codec (HEVC) video coding and motion estimation and compensation. Although HEVC coding variables offer valuable information, they are frequently overlooked in deep learning solutions for video analysis. Thus, we introduce a low-level HEVC feature set suitable for dynamic video summarization. Additionally, we supplement the datasets with additional feature vectors based on CNN embeddings of Window-based Accumulated Image Differences with motion estimation and compensation (WAID-MC). We integrate our two proposed feature sets using feature vector fusion and importance score fusion. Furthermore, we enhance the OVP and YouTube datasets by adding ground truth keyshots, importance scores, and user summaries. In the experimental results section, we compare our proposed solutions with four existing approaches, integrating our features and fusion techniques into their codebases. Our findings indicate that in a minimum of three out of the four datasets, the F1 scores achieved by our proposed methodologies are superior to those of existing studies. Moreover, the experimental results predominantly highlight feature vector fusion as superior to importance score fusion. In many instances, the fusion of the WAID-MC features with the HEVC features yields the best F1 scores. In some cases, the utilization of HEVC features alone results in higher F1 scores compared to existing approaches. [ABSTRACT FROM AUTHOR] |
| Copyright of Multimedia Tools & Applications is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 189934467 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Dynamic video summarization using handcrafted features to complement publicly available datasets. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Solatidehkordi%2C+Zahra%22">Solatidehkordi, Zahra</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Shanableh%2C+Tamer%22">Shanableh, Tamer</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> tshanableh@aus.edu</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Multimedia+Tools+%26+Applications%22">Multimedia Tools & Applications</searchLink>. Nov2025, Vol. 84 Issue 37, p46457-46478. 22p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Video+summarization%22">Video summarization</searchLink><br /><searchLink fieldCode="DE" term="%22Motion+estimation+%28Signal+processing%29%22">Motion estimation (Signal processing)</searchLink><br /><searchLink fieldCode="DE" term="%22Data+integration%22">Data integration</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: In video summarization, four datasets (TvSum, SumMe, OVP, and YouTube) are typically used for training and testing. In this study, we supplement these datasets with novel features based on High Efficiency Video Codec (HEVC) video coding and motion estimation and compensation. Although HEVC coding variables offer valuable information, they are frequently overlooked in deep learning solutions for video analysis. Thus, we introduce a low-level HEVC feature set suitable for dynamic video summarization. Additionally, we supplement the datasets with additional feature vectors based on CNN embeddings of Window-based Accumulated Image Differences with motion estimation and compensation (WAID-MC). We integrate our two proposed feature sets using feature vector fusion and importance score fusion. Furthermore, we enhance the OVP and YouTube datasets by adding ground truth keyshots, importance scores, and user summaries. In the experimental results section, we compare our proposed solutions with four existing approaches, integrating our features and fusion techniques into their codebases. Our findings indicate that in a minimum of three out of the four datasets, the F1 scores achieved by our proposed methodologies are superior to those of existing studies. Moreover, the experimental results predominantly highlight feature vector fusion as superior to importance score fusion. In many instances, the fusion of the WAID-MC features with the HEVC features yields the best F1 scores. In some cases, the utilization of HEVC features alone results in higher F1 scores compared to existing approaches. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Multimedia Tools & Applications is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=189934467 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1007/s11042-025-20988-8 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 22 StartPage: 46457 Subjects: – SubjectFull: Video summarization Type: general – SubjectFull: Motion estimation (Signal processing) Type: general – SubjectFull: Data integration Type: general Titles: – TitleFull: Dynamic video summarization using handcrafted features to complement publicly available datasets. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Solatidehkordi, Zahra – PersonEntity: Name: NameFull: Shanableh, Tamer IsPartOfRelationships: – BibEntity: Dates: – D: 25 M: 11 Text: Nov2025 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 13807501 Numbering: – Type: volume Value: 84 – Type: issue Value: 37 Titles: – TitleFull: Multimedia Tools & Applications Type: main |
| ResultId | 1 |