CMFF_VS: A Video Summarization Extraction Model based on Cross-modal Feature Fusion.
Saved in:
| Title: | CMFF_VS: A Video Summarization Extraction Model based on Cross-modal Feature Fusion. |
|---|---|
| Authors: | Xin, Chaoqun1 (AUTHOR) xinchaoqun@nefu.edu.cn, Wang, Mingyang1 (AUTHOR) wangmingyang@nefu.edu.cn, Zhao, Xianhao1 (AUTHOR) soramiaktio@nefu.edu.cn |
| Source: | Arabian Journal for Science & Engineering (Springer Science & Business Media B.V. ). Dec2025, Vol. 50 Issue 23, p19153-19167. 15p. |
| Subject Terms: | *Video summarization, *Feature extraction, *Machine learning |
| Abstract: | Video summarization aims to present the most relevant and important information in the video stream in the form of a summary. Most existing researches focus on the selection process of keyframes, determining the importance of video frames by obtaining dependency information between them. However, these works overlook the feature extraction process of video frames. In fact, rich and reliable video frame features are an important basis for determining whether video frames can be selected correctly. This article proposes a new video summarization extraction model based on cross-modal feature fusion (CMFF_VS). CMFF_VS model utilizes the mutual enhancement of video modality and text modality to extract richer semantic information of video frames, thereby providing necessary features for the subsequent video frame selection process. To solve the alignment problem between semantic information of two modalities, CMFF_VS introduces a cross-modal attention mechanism, which utilizes the semantic correlation of modalities to achieve cross-modal semantic fusion. At the same time, CMFF_VS introduces the ASPP module to extract and fuse multi-scale semantic features of individual modalities, enriching the capture of advanced semantic information for each modality. The experimental results show that compared with the state-of-the-art unimodal and multimodal video summarization models, CMFF-VS achieves the best performance, indicating that the cross-modal deep feature extraction and fusion strategy proposed in CMFF-VS is reasonable and effective. [ABSTRACT FROM AUTHOR] |
| Database: | Energy & Power Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | Video summarization aims to present the most relevant and important information in the video stream in the form of a summary. Most existing researches focus on the selection process of keyframes, determining the importance of video frames by obtaining dependency information between them. However, these works overlook the feature extraction process of video frames. In fact, rich and reliable video frame features are an important basis for determining whether video frames can be selected correctly. This article proposes a new video summarization extraction model based on cross-modal feature fusion (CMFF_VS). CMFF_VS model utilizes the mutual enhancement of video modality and text modality to extract richer semantic information of video frames, thereby providing necessary features for the subsequent video frame selection process. To solve the alignment problem between semantic information of two modalities, CMFF_VS introduces a cross-modal attention mechanism, which utilizes the semantic correlation of modalities to achieve cross-modal semantic fusion. At the same time, CMFF_VS introduces the ASPP module to extract and fuse multi-scale semantic features of individual modalities, enriching the capture of advanced semantic information for each modality. The experimental results show that compared with the state-of-the-art unimodal and multimodal video summarization models, CMFF-VS achieves the best performance, indicating that the cross-modal deep feature extraction and fusion strategy proposed in CMFF-VS is reasonable and effective. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 2193567X |
| DOI: | 10.1007/s13369-025-10133-w |
