Dynamic video summarization using handcrafted features to complement publicly available datasets.

Saved in:
Bibliographic Details
Title: Dynamic video summarization using handcrafted features to complement publicly available datasets.
Authors: Solatidehkordi, Zahra1 (AUTHOR), Shanableh, Tamer1 (AUTHOR) tshanableh@aus.edu
Source: Multimedia Tools & Applications. Nov2025, Vol. 84 Issue 37, p46457-46478. 22p.
Subjects: Video summarization, Motion estimation (Signal processing), Data integration
Abstract: In video summarization, four datasets (TvSum, SumMe, OVP, and YouTube) are typically used for training and testing. In this study, we supplement these datasets with novel features based on High Efficiency Video Codec (HEVC) video coding and motion estimation and compensation. Although HEVC coding variables offer valuable information, they are frequently overlooked in deep learning solutions for video analysis. Thus, we introduce a low-level HEVC feature set suitable for dynamic video summarization. Additionally, we supplement the datasets with additional feature vectors based on CNN embeddings of Window-based Accumulated Image Differences with motion estimation and compensation (WAID-MC). We integrate our two proposed feature sets using feature vector fusion and importance score fusion. Furthermore, we enhance the OVP and YouTube datasets by adding ground truth keyshots, importance scores, and user summaries. In the experimental results section, we compare our proposed solutions with four existing approaches, integrating our features and fusion techniques into their codebases. Our findings indicate that in a minimum of three out of the four datasets, the F1 scores achieved by our proposed methodologies are superior to those of existing studies. Moreover, the experimental results predominantly highlight feature vector fusion as superior to importance score fusion. In many instances, the fusion of the WAID-MC features with the HEVC features yields the best F1 scores. In some cases, the utilization of HEVC features alone results in higher F1 scores compared to existing approaches. [ABSTRACT FROM AUTHOR]
Copyright of Multimedia Tools & Applications is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 189934467
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Dynamic video summarization using handcrafted features to complement publicly available datasets.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Solatidehkordi%2C+Zahra%22">Solatidehkordi, Zahra</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Shanableh%2C+Tamer%22">Shanableh, Tamer</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> tshanableh@aus.edu</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Multimedia+Tools+%26+Applications%22">Multimedia Tools & Applications</searchLink>. Nov2025, Vol. 84 Issue 37, p46457-46478. 22p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Video+summarization%22">Video summarization</searchLink><br /><searchLink fieldCode="DE" term="%22Motion+estimation+%28Signal+processing%29%22">Motion estimation (Signal processing)</searchLink><br /><searchLink fieldCode="DE" term="%22Data+integration%22">Data integration</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: In video summarization, four datasets (TvSum, SumMe, OVP, and YouTube) are typically used for training and testing. In this study, we supplement these datasets with novel features based on High Efficiency Video Codec (HEVC) video coding and motion estimation and compensation. Although HEVC coding variables offer valuable information, they are frequently overlooked in deep learning solutions for video analysis. Thus, we introduce a low-level HEVC feature set suitable for dynamic video summarization. Additionally, we supplement the datasets with additional feature vectors based on CNN embeddings of Window-based Accumulated Image Differences with motion estimation and compensation (WAID-MC). We integrate our two proposed feature sets using feature vector fusion and importance score fusion. Furthermore, we enhance the OVP and YouTube datasets by adding ground truth keyshots, importance scores, and user summaries. In the experimental results section, we compare our proposed solutions with four existing approaches, integrating our features and fusion techniques into their codebases. Our findings indicate that in a minimum of three out of the four datasets, the F1 scores achieved by our proposed methodologies are superior to those of existing studies. Moreover, the experimental results predominantly highlight feature vector fusion as superior to importance score fusion. In many instances, the fusion of the WAID-MC features with the HEVC features yields the best F1 scores. In some cases, the utilization of HEVC features alone results in higher F1 scores compared to existing approaches. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Multimedia Tools & Applications is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=189934467
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s11042-025-20988-8
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 22
        StartPage: 46457
    Subjects:
      – SubjectFull: Video summarization
        Type: general
      – SubjectFull: Motion estimation (Signal processing)
        Type: general
      – SubjectFull: Data integration
        Type: general
    Titles:
      – TitleFull: Dynamic video summarization using handcrafted features to complement publicly available datasets.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Solatidehkordi, Zahra
      – PersonEntity:
          Name:
            NameFull: Shanableh, Tamer
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 25
              M: 11
              Text: Nov2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 13807501
          Numbering:
            – Type: volume
              Value: 84
            – Type: issue
              Value: 37
          Titles:
            – TitleFull: Multimedia Tools & Applications
              Type: main
ResultId 1