CMFF_VS: A Video Summarization Extraction Model based on Cross-modal Feature Fusion.
Saved in:
| Title: | CMFF_VS: A Video Summarization Extraction Model based on Cross-modal Feature Fusion. |
|---|---|
| Authors: | Xin, Chaoqun1 (AUTHOR) xinchaoqun@nefu.edu.cn, Wang, Mingyang1 (AUTHOR) wangmingyang@nefu.edu.cn, Zhao, Xianhao1 (AUTHOR) soramiaktio@nefu.edu.cn |
| Source: | Arabian Journal for Science & Engineering (Springer Science & Business Media B.V. ). Dec2025, Vol. 50 Issue 23, p19153-19167. 15p. |
| Subjects: | Video summarization, Feature extraction, Machine learning |
| Abstract: | Video summarization aims to present the most relevant and important information in the video stream in the form of a summary. Most existing researches focus on the selection process of keyframes, determining the importance of video frames by obtaining dependency information between them. However, these works overlook the feature extraction process of video frames. In fact, rich and reliable video frame features are an important basis for determining whether video frames can be selected correctly. This article proposes a new video summarization extraction model based on cross-modal feature fusion (CMFF_VS). CMFF_VS model utilizes the mutual enhancement of video modality and text modality to extract richer semantic information of video frames, thereby providing necessary features for the subsequent video frame selection process. To solve the alignment problem between semantic information of two modalities, CMFF_VS introduces a cross-modal attention mechanism, which utilizes the semantic correlation of modalities to achieve cross-modal semantic fusion. At the same time, CMFF_VS introduces the ASPP module to extract and fuse multi-scale semantic features of individual modalities, enriching the capture of advanced semantic information for each modality. The experimental results show that compared with the state-of-the-art unimodal and multimodal video summarization models, CMFF-VS achieves the best performance, indicating that the cross-modal deep feature extraction and fusion strategy proposed in CMFF-VS is reasonable and effective. [ABSTRACT FROM AUTHOR] |
| Copyright of Arabian Journal for Science & Engineering (Springer Science & Business Media B.V. ) is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | Video summarization aims to present the most relevant and important information in the video stream in the form of a summary. Most existing researches focus on the selection process of keyframes, determining the importance of video frames by obtaining dependency information between them. However, these works overlook the feature extraction process of video frames. In fact, rich and reliable video frame features are an important basis for determining whether video frames can be selected correctly. This article proposes a new video summarization extraction model based on cross-modal feature fusion (CMFF_VS). CMFF_VS model utilizes the mutual enhancement of video modality and text modality to extract richer semantic information of video frames, thereby providing necessary features for the subsequent video frame selection process. To solve the alignment problem between semantic information of two modalities, CMFF_VS introduces a cross-modal attention mechanism, which utilizes the semantic correlation of modalities to achieve cross-modal semantic fusion. At the same time, CMFF_VS introduces the ASPP module to extract and fuse multi-scale semantic features of individual modalities, enriching the capture of advanced semantic information for each modality. The experimental results show that compared with the state-of-the-art unimodal and multimodal video summarization models, CMFF-VS achieves the best performance, indicating that the cross-modal deep feature extraction and fusion strategy proposed in CMFF-VS is reasonable and effective. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 2193567X |
| DOI: | 10.1007/s13369-025-10133-w |
